00010000:00010000:1.0:1775772594.384336:0:156405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772594.384692:0:156405:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772594.384710:0:156405:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772594.384718:0:156405:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772594.384744:0:156405:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772594.384757:0:156405:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772594.384761:0:156405:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772594.384775:0:156405:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772594.384827:0:156405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.384835:0:156405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.384846:0:156405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772594.384873:0:156405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156405:1862023612123392:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772594.384970:0:156405:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c66313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772594.390934:0:156405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156405:1862023612123392:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775772594.390960:0:156405:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 4/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.390976:0:156405:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 4/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.390988:0:156405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 4/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.390995:0:156405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 3/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391004:0:156405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 4/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391012:0:156405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b9800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775772594.391016:0:156405:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 4/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391023:0:156405:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 4/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391032:0:156405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 5/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391039:0:156405:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775772594.391046:0:156405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 3/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391053:0:156405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e272 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772594.391071:0:156405:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1c2e17480 x1862023612123392/t0(0) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 576/584 e 0 to 0 dl 1775772610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772594.391087:0:156405:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x20001a9e3:0x19fa:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1775772594.391117:0:156405:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1c3ec4c00 type 13 mode 30 res 8590043619/6650 (0 0) 00000080:00200000:1.0:1775772594.391184:0:156405:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772594.391200:0:156405:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772594.391210:0:156405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772594.391222:0:156405:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772594.391229:0:156405:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772594.391234:0:156405:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772594.391237:0:156405:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772594.391243:0:156405:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1d93be8 00010000:00010000:1.0:1775772594.391247:0:156405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772594.391255:0:156405:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772594.391268:0:156405:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772594.391276:0:156405:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=16408 00000080:00200000:1.0:1775772594.391281:0:156405:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772594.391293:0:156405:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=16392 00000080:00200000:1.0:1775772594.391297:0:156405:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772594.391310:0:156405:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772594.391353:0:156405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e279 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391374:0:156405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e279 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.391385:0:156405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e279 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772594.391406:0:156405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156405:1862023612123520:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772594.391471:0:156405:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c66313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772594.523925:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772594.523966:0:33197:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624840960 00000100:00100000:1.0:1775772594.523977:0:33197:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624840960 00000100:00100000:1.0:1775772594.524035:0:33197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9312 00000100:00100000:1.0:1775772594.524046:0:33197:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182789:x1862023624840960:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772594.524078:0:33197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e28e lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da66cd expref: -99 pid: 156408 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.526668:0:33197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772594.526684:0:33197:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182789:x1862023624840960:12345-192.168.201.137@tcp:104: Request processed in 2635us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772594.526695:0:33197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9312 00010000:00010000:1.0:1775772594.547231:0:135298:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3385e00/0x8a9f4e958445e295 lrc: 2/0,0 mode: --/PR res: [0x240002728:0x2b:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da66db expref: -99 pid: 156408 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.547246:0:135298:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772594.547284:0:135298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3385e00/0x8a9f4e958445e295 lrc: 1/0,0 mode: --/PR res: [0x240002728:0x2b:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da66db expref: -99 pid: 156408 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.547291:0:135298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3385e00/0x8a9f4e958445e295 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x2b:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da66db expref: -99 pid: 156408 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.547317:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772594.547319:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772594.547322:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772594.547332:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775772594.547355:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612124800:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772594.562367:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612124800:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772594.662547:0:156415:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156415:1862023612125568:192.168.201.137@tcp:101:rmdir.0 00010000:00010000:1.0:1775772594.662579:0:156415:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 4/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662603:0:156415:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 4/1,0 mode: --/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662610:0:156415:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 4/1,0 mode: --/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662624:0:156415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 4/1,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662634:0:156415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 4/1,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662647:0:156415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 5/2,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662659:0:156415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 5/2,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662665:0:156415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 4/1,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772594.662677:0:156415:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d7480 x1862023612125568/t0(0) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 576/672 e 0 to 0 dl 1775772610 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rmdir.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772594.662689:0:156415:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662701:0:156415:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1c3ec4c00 type 13 mode 4 res 8590043619/7703 (0 0) 00000080:00200000:1.0:1775772594.662707:0:156415:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x20001a9e3:0x19fa:0x0] suppgids 0 -1: rc 0 00000002:00010000:1.0:1775772594.662796:0:156415:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200026560:0x2c:0x0]) in obj [0x200026560:0x2c:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772594.662851:0:156415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e2b8 lrc: 3/1,0 mode: --/CR res: [0x200026560:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 156415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662859:0:156415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e2b8 lrc: 3/1,0 mode: --/CR res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 156415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.662869:0:156415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e2b8 lrc: 3/1,0 mode: --/CR res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 156415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772594.662893:0:156415:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156415:1862023612125696:192.168.201.137@tcp:101:rmdir.0 00000100:00100000:1.0:1775772594.662965:0:156415:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c563e540 going to sleep for 11 seconds 00000100:00100000:1.0:1775772594.716832:0:156415:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156415:1862023612125824:192.168.201.137@tcp:101:rmdir.0 00010000:00010000:1.0:1775772594.716863:0:156415:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 4/1,0 mode: --/CR res: [0x240002728:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716875:0:156415:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 4/1,0 mode: --/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716887:0:156415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716897:0:156415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716909:0:156415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 5/2,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716917:0:156415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 5/2,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716923:0:156415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 4/1,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772594.716934:0:156415:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c7af5880 x1862023612125824/t0(0) o101->lustre-MDT0001-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 576/640 e 0 to 0 dl 1775772610 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rmdir.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772594.716946:0:156415:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716960:0:156415:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1c3ed4400 type 13 mode 4 res 9663686440/44 (0 0) 00010000:00010000:1.0:1775772594.716967:0:156415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 3/1,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.716976:0:156415:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e2bf lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da679f expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772594.717011:0:156415:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x20001a9e3:0x1e17:0x0], updating i_size 8192 00000080:00200000:1.0:1775772594.717015:0:156415:0:(namei.c:147:ll_iget()) got inode: [0x20001a9e3:0x1e17:0x0](ffff8de1c4061148): rc = 0 00000080:00010000:1.0:1775772594.717024:0:156415:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x20001a9e3:0x1e17:0x0](ffff8de1c4061148) for lock 0x8a9f4e958445e2b1 00000080:00010000:1.0:1775772594.717040:0:156415:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x20001a9e3:0x1e17:0x0](ffff8de1c4061148) 00000080:00010000:1.0:1775772594.717043:0:156415:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e2b1 from it ffff9ba1c1c73e08 00010000:00010000:1.0:1775772594.717047:0:156415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.717056:0:156415:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772594.717078:0:156415:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 3 00000080:00200000:1.0:1775772594.717086:0:156415:0:(namei.c:2305:ll_rmdir()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88) 00010000:00010000:1.0:1775772594.718279:0:156415:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.718505:0:156415:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 1/0,0 mode: --/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.718514:0:156415:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772594.718517:0:156415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e34600/0x8a9f4e958445e2b1 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1e17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da6783 expref: -99 pid: 156415 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772594.718550:0:156415:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1c7943800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772594.718562:0:156415:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16680 x1862023612126080/t0(0) o36->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772594.718588:0:156415:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156415:1862023612126080:192.168.201.137@tcp:36:rmdir.0 00000100:00100000:1.0:1775772594.718712:0:156415:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772594.728612:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772594.740658:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772594.797692:0:156422:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772594.797899:0:156422:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772594.797923:0:156422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772594.797940:0:156422:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772594.797949:0:156422:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772594.797957:0:156422:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772594.797961:0:156422:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772594.797969:0:156422:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1d8bb58 00010000:00010000:1.0:1775772594.797972:0:156422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772594.797981:0:156422:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772594.797996:0:156422:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772594.798004:0:156422:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772594.798010:0:156422:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772594.798021:0:156422:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772594.798026:0:156422:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772594.798039:0:156422:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772594.798092:0:156422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e2c6 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.798100:0:156422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e2c6 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772594.798111:0:156422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e2c6 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772594.798142:0:156422:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156422:1862023612126464:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772594.798288:0:156422:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b780 going to sleep for 11 seconds 00000100:00100000:1.0:1775772594.965991:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772594.966024:0:15134:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624844288 00000100:00100000:1.0:1775772594.966035:0:15134:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624844288 00000100:00100000:1.0:1775772594.966085:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9316 00000100:00100000:1.0:1775772594.966094:0:15134:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182022:x1862023624844288:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772594.966113:0:15134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e2e2 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6855 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.966183:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772594.966189:0:15134:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182022:x1862023624844288:12345-192.168.201.137@tcp:104: Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772594.966197:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9316 00000100:00100000:1.0:1775772594.977185:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772594.977221:0:15135:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624844544 00000100:00100000:1.0:1775772594.977232:0:15135:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624844544 00000100:00100000:1.0:1775772594.977285:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9317 00000100:00100000:1.0:1775772594.977296:0:15135:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:8404:x1862023624844544:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772594.977319:0:15135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977408:0:15135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772594.977415:0:15135:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:8404:x1862023624844544:12345-192.168.201.137@tcp:104: Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772594.977423:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9317 00010000:00010000:1.0:1775772594.977504:0:135299:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775772594.977527:0:135299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977536:0:135299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384400 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775772594.977541:0:135299:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977550:0:135299:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977558:0:135299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977618:0:135299:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 2/0,0 mode: --/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977625:0:135299:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772594.977649:0:135299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 1/0,0 mode: --/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977657:0:135299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384400/0x8a9f4e958445e2e9 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x2d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6863 expref: -99 pid: 156428 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772594.977677:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772594.977679:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772594.977681:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772594.977697:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612127872:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772594.981101:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612127872:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772595.112840:0:156443:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0154000 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156443:1862023612128512:192.168.201.137@tcp:36:lfs.0 00000080:00200000:1.0:1775772595.112914:0:156443:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x20001a9e3:0x1e19:0x0](ffff8de1c403ec08) 00000080:00200000:1.0:1775772595.112921:0:156443:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x20001a9e3:0x1e19:0x0], updating i_size 4096 00000080:00200008:1.0:1775772595.112951:0:156443:0:(file.c:447:ll_file_release()) START file d71a.replay-single:[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags 300000 00010000:00010000:1.0:1775772595.112987:0:156443:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512ec00/0x8a9f4e95844536c8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45c5 expref: -99 pid: 152822 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.121671:0:156446:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772595.121701:0:156446:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.121747:0:156446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.121765:0:156446:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.121774:0:156446:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772595.121783:0:156446:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772595.121786:0:156446:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772595.121793:0:156446:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1c73c20 00010000:00010000:1.0:1775772595.121797:0:156446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.121805:0:156446:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.121819:0:156446:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.121826:0:156446:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=24 00000080:00200000:1.0:1775772595.121832:0:156446:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.121843:0:156446:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=0 00000080:00200000:1.0:1775772595.121846:0:156446:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772595.121859:0:156446:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.121911:0:156446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e305 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.121918:0:156446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e305 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.121928:0:156446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e305 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772595.121956:0:156446:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156446:1862023612128640:192.168.201.137@tcp:101:rmdir.0 00000100:00100000:1.0:1775772595.122049:0:156446:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b540 going to sleep for 11 seconds 00000100:00100000:1.0:1775772595.241068:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772595.241112:0:15134:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624846208 00000100:00100000:1.0:1775772595.241121:0:15134:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624846208 00000100:00100000:1.0:1775772595.241175:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9319 00000100:00100000:1.0:1775772595.241186:0:15134:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:171947:x1862023624846208:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772595.241207:0:15134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241280:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772595.241286:0:15134:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:171947:x1862023624846208:12345-192.168.201.137@tcp:104: Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772595.241294:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9319 00010000:00010000:1.0:1775772595.241378:0:135298:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775772595.241384:0:135298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241393:0:135298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384e00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775772595.241399:0:135298:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241407:0:135298:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241416:0:135298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 3/0,0 mode: PR/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241478:0:135298:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 2/0,0 mode: --/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241485:0:135298:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772595.241507:0:135298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 1/0,0 mode: --/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241528:0:135298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3384e00/0x8a9f4e958445e313 lrc: 0/0,0 mode: --/PR res: [0x240002728:0x2e:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6927 expref: -99 pid: 156446 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.241548:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772595.241549:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772595.241551:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772595.241567:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612129408:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772595.355240:0:156455:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156455:1862023612130048:192.168.201.137@tcp:36:lfs.0 00000080:00200000:1.0:1775772595.355297:0:156455:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x20001a9e3:0x1e1a:0x0](ffff8de1c403c2c8) 00000080:00200000:1.0:1775772595.355303:0:156455:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x20001a9e3:0x1e1a:0x0], updating i_size 4096 00000080:00200008:1.0:1775772595.355349:0:156455:0:(file.c:447:ll_file_release()) START file d71a.replay-single:[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags 300000 00010000:00010000:1.0:1775772595.355382:0:156455:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512ec00/0x8a9f4e95844536c8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45c5 expref: -99 pid: 152822 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1775772595.404174:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772595.416077:0:33197:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624855680 00000100:00100000:1.0:1775772595.416090:0:33197:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624855680 00000100:00100000:1.0:1775772595.416153:0:33197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9321 00000100:00100000:1.0:1775772595.416162:0:33197:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:171947:x1862023624855680:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772595.416183:0:33197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d3385400/0x8a9f4e958445e33d lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da69eb expref: -99 pid: 156458 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.416260:0:33197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772595.416266:0:33197:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:171947:x1862023624855680:12345-192.168.201.137@tcp:104: Request processed in 106us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772595.416278:0:33197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9321 00000100:00100000:1.0:1775772595.520104:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612132224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772595.520217:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1775772595.520225:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612132096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772595.520262:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612132352:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772595.544539:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772595.557004:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772595.597287:0:156461:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772595.597315:0:156461:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.597570:0:156461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.597591:0:156461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.597601:0:156461:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772595.597610:0:156461:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772595.597613:0:156461:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772595.597620:0:156461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1563b58 00010000:00010000:1.0:1775772595.597625:0:156461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.597634:0:156461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.597653:0:156461:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.597661:0:156461:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772595.597667:0:156461:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.597677:0:156461:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772595.597682:0:156461:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772595.597694:0:156461:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.597954:0:156461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9600/0x8a9f4e958445e36e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.597964:0:156461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9600/0x8a9f4e958445e36e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.597975:0:156461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9600/0x8a9f4e958445e36e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772595.598004:0:156461:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156461:1862023612132992:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772595.598215:0:156461:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772595.667694:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772595.675080:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772595.705135:0:156463:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772595.705167:0:156463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.705188:0:156463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.705205:0:156463:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.705218:0:156463:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772595.705226:0:156463:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772595.705230:0:156463:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772595.705238:0:156463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1563b58 00010000:00010000:1.0:1775772595.705241:0:156463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.705250:0:156463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.705263:0:156463:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.705272:0:156463:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772595.705278:0:156463:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.705289:0:156463:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772595.705293:0:156463:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772595.705306:0:156463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.705450:0:156463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e398 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.705459:0:156463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e398 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.705469:0:156463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e398 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772595.705497:0:156463:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156463:1862023612134528:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772595.705636:0:156463:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1775772595.770352:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772595.778261:0:15134:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624866816 00000100:00100000:1.0:1775772595.778276:0:15134:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624866816 00000100:00100000:1.0:1775772595.778388:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9327 00000100:00100000:1.0:1775772595.778400:0:15134:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:8404:x1862023624866816:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772595.778432:0:15134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1c512ee00/0x8a9f4e958445e3bb lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x32:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6c37 expref: -99 pid: 156464 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.778537:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772595.778543:0:15134:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:8404:x1862023624866816:12345-192.168.201.137@tcp:104: Request processed in 146us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772595.778549:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9327 00000100:00100000:1.0:1775772595.876907:0:15135:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624868224 00000100:00100000:1.0:1775772595.876920:0:15135:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624868224 00000100:00100000:1.0:1775772595.876981:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9328 00000100:00100000:1.0:1775772595.876991:0:15135:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182022:x1862023624868224:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772595.877013:0:15135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512fc00/0x8a9f4e958445e3de lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6ced expref: -99 pid: 156466 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772595.877113:0:15135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772595.877120:0:15135:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182022:x1862023624868224:12345-192.168.201.137@tcp:104: Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772595.877127:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9328 00000100:00100000:1.0:1775772595.884498:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772595.933975:0:156467:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772595.934005:0:156467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.934026:0:156467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.934141:0:156467:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.934149:0:156467:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772595.934158:0:156467:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772595.934162:0:156467:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772595.934169:0:156467:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1cfbb58 00010000:00010000:1.0:1775772595.934174:0:156467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772595.934183:0:156467:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772595.934199:0:156467:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.934207:0:156467:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772595.934212:0:156467:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772595.934223:0:156467:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772595.934227:0:156467:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772595.934240:0:156467:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772595.934294:0:156467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9600/0x8a9f4e958445e3ec lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.934302:0:156467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9600/0x8a9f4e958445e3ec lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772595.934313:0:156467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9600/0x8a9f4e958445e3ec lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772595.934520:0:156467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156467:1862023612137600:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772595.934660:0:156467:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1775772596.007370:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772596.015215:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772596.084894:0:156469:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772596.084911:0:156469:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.084922:0:156469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.084934:0:156469:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.084940:0:156469:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772596.084945:0:156469:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772596.084948:0:156469:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772596.084954:0:156469:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1bcbbf8 00010000:00010000:1.0:1775772596.084957:0:156469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.084964:0:156469:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.084987:0:156469:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.084995:0:156469:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=267 00000080:00200000:1.0:1775772596.085001:0:156469:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 44 00000080:00200008:1.0:1775772596.085008:0:156469:0:(file.c:1057:ll_file_open()) START file d71a.replay-single:[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags 300000 00000080:00200080:1.0:1775772596.085416:0:156469:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88) cmd=c03066f0 arg=7ffc52bea360 00000080:00200000:1.0:1775772596.085433:0:156469:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88) name=test stripe_offset=0 stripe_count=2, hash_type=0 00010000:00010000:1.0:1775772596.085460:0:156469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e35800/0x8a9f4e958445e424 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da6e21 expref: -99 pid: 156469 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.085476:0:156469:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512e800/0x8a9f4e95844535e8 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45cc expref: -99 pid: 152810 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.085892:0:156469:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e35800/0x8a9f4e958445e424 lrc: 1/0,0 mode: --/PR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da6e21 expref: -99 pid: 156469 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.085901:0:156469:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772596.085904:0:156469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d0e35800/0x8a9f4e958445e424 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da6e21 expref: -99 pid: 156469 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772596.085924:0:156469:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1c7943800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772596.085935:0:156469:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15f80 x1862023612139648/t0(0) o36->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 552/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772596.085961:0:156469:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156469:1862023612139648:192.168.201.137@tcp:36:lfs.0 00000100:00100000:1.0:1775772596.088491:0:156469:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338bf00 going to sleep for 11 seconds 00000080:00200000:1.0:1775772596.115552:0:156470:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772596.115580:0:156470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.115603:0:156470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.115621:0:156470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.115635:0:156470:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772596.115643:0:156470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772596.115646:0:156470:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772596.115654:0:156470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1cfbc20 00010000:00010000:1.0:1775772596.115658:0:156470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.115667:0:156470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.115682:0:156470:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.115689:0:156470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=24 00000080:00200000:1.0:1775772596.115695:0:156470:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.115705:0:156470:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=0 00000080:00200000:1.0:1775772596.115709:0:156470:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772596.115750:0:156470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.115803:0:156470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e42b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.115811:0:156470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e42b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.115821:0:156470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e42b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772596.115849:0:156470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156470:1862023612139776:192.168.201.137@tcp:101:rmdir.0 00000100:00100000:1.0:1775772596.115944:0:156470:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b000 going to sleep for 11 seconds 00000100:00100000:1.0:1775772596.176119:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772596.195838:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772596.341963:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772596.345950:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612141952:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772596.354189:0:33197:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624873472 00000100:00100000:1.0:1775772596.354201:0:33197:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624873472 00000100:00100000:1.0:1775772596.354261:0:33197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9335 00000100:00100000:1.0:1775772596.354273:0:33197:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:171947:x1862023624873472:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772596.354294:0:33197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff8de1c7943800 lock: ffff8de1d0e35000/0x8a9f4e958445e463 lrc: 2/0,0 mode: PR/PR res: [0x240002728:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6f47 expref: -99 pid: 156472 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.354385:0:33197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772596.354392:0:33197:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:171947:x1862023624873472:12345-192.168.201.137@tcp:104: Request processed in 121us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772596.354400:0:33197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9335 00000080:00200000:1.0:1775772596.413132:0:156474:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772596.413241:0:156474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.413264:0:156474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.413282:0:156474:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.413291:0:156474:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772596.413299:0:156474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772596.413303:0:156474:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772596.413473:0:156474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1bebb58 00010000:00010000:1.0:1775772596.413479:0:156474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.413499:0:156474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.413626:0:156474:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.413634:0:156474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772596.413640:0:156474:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.413652:0:156474:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772596.413656:0:156474:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772596.413669:0:156474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.413900:0:156474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e46a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.413912:0:156474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e46a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.413925:0:156474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9a00/0x8a9f4e958445e46a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772596.413953:0:156474:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156474:1862023612142208:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772596.414084:0:156474:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772596.606697:0:15135:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624874880 00000100:00100000:1.0:1775772596.606714:0:15135:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624874880 00000100:00100000:1.0:1775772596.606824:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9336 00000100:00100000:1.0:1775772596.606836:0:15135:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624874880:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772596.606857:0:15135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.606954:0:15135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772596.606962:0:15135:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624874880:12345-192.168.201.137@tcp:104: Request processed in 129us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772596.606970:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9336 00010000:00010000:1.0:1775772596.606995:0:15144:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775772596.607002:0:15144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607011:0:15144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384a00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775772596.607017:0:15144:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607027:0:15144:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607037:0:15144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607105:0:15144:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 2/0,0 mode: --/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607113:0:15144:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772596.607141:0:15144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 1/0,0 mode: --/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607149:0:15144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384a00/0x8a9f4e958445e486 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da6ffd expref: -99 pid: 156480 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772596.607177:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772596.607179:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772596.607181:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772596.607198:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612143488:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772596.616326:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612143488:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772596.623163:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772596.707882:0:156486:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772596.707920:0:156486:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.707944:0:156486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.707962:0:156486:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.707972:0:156486:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772596.707981:0:156486:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772596.707985:0:156486:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772596.707994:0:156486:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1c4bb58 00010000:00010000:1.0:1775772596.707998:0:156486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.708007:0:156486:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.708022:0:156486:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.708032:0:156486:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772596.708040:0:156486:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.708052:0:156486:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772596.708057:0:156486:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772596.708072:0:156486:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.708124:0:156486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e494 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.708134:0:156486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e494 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.708144:0:156486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e494 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772596.708176:0:156486:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156486:1862023612143744:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772596.708280:0:156486:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338bc00 going to sleep for 11 seconds 00010000:00010000:1.0:1775772596.720823:0:156486:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1c3ec4c00 type 13 mode 30 res 8590043619/6650 (0 0) 00000080:00200000:1.0:1775772596.720933:0:156486:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772596.720954:0:156486:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.720968:0:156486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.720982:0:156486:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.720990:0:156486:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772596.720996:0:156486:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772596.721000:0:156486:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772596.721007:0:156486:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1c4bbe8 00010000:00010000:1.0:1775772596.721012:0:156486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772596.721021:0:156486:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772596.721035:0:156486:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.721043:0:156486:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=16408 00000080:00200000:1.0:1775772596.721049:0:156486:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772596.721063:0:156486:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=16392 00000080:00200000:1.0:1775772596.721068:0:156486:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772596.721081:0:156486:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772596.721131:0:156486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e49b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.721138:0:156486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e49b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772596.721150:0:156486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e49b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772596.721182:0:156486:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156486:1862023612143872:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772596.721291:0:156486:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772596.915793:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612145152:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772596.933615:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612145152:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772597.044127:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772597.044171:0:15135:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624878208 00000100:00100000:1.0:1775772597.044183:0:15135:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624878208 00000100:00100000:1.0:1775772597.044240:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9340 00000100:00100000:1.0:1775772597.044249:0:15135:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624878208:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772597.044270:0:15135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f800/0x8a9f4e958445e4da lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da7185 expref: -99 pid: 156491 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.044431:0:15135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772597.044438:0:15135:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624878208:12345-192.168.201.137@tcp:104: Request processed in 190us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772597.044445:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9340 00000100:00100000:1.0:1775772597.063200:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772597.272066:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772597.272118:0:15134:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624879872 00000100:00100000:1.0:1775772597.272129:0:15134:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624879872 00000100:00100000:1.0:1775772597.272194:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9342 00000100:00100000:1.0:1775772597.272205:0:15134:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624879872:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772597.272229:0:15134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384c00/0x8a9f4e958445e504 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da7249 expref: -99 pid: 156500 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.272319:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772597.272326:0:15134:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624879872:12345-192.168.201.137@tcp:104: Request processed in 123us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772597.272332:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9342 00000100:00100000:1.0:1775772597.428938:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772597.428996:0:33197:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624881536 00000100:00100000:1.0:1775772597.429008:0:33197:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624881536 00000100:00100000:1.0:1775772597.429073:0:33197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9344 00000100:00100000:1.0:1775772597.429086:0:33197:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624881536:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772597.429109:0:33197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3384c00/0x8a9f4e958445e52e lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da730d expref: -99 pid: 156505 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.429203:0:33197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772597.429210:0:33197:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182023:x1862023624881536:12345-192.168.201.137@tcp:104: Request processed in 127us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772597.429218:0:33197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9344 00000100:00100000:1.0:1775772597.457163:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772597.588659:0:156517:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772597.588704:0:156517:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772597.588755:0:156517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772597.588776:0:156517:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772597.588786:0:156517:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772597.588796:0:156517:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772597.588801:0:156517:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772597.588809:0:156517:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c0dd3c20 00010000:00010000:1.0:1775772597.588813:0:156517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772597.588822:0:156517:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772597.588842:0:156517:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772597.588851:0:156517:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=24 00000080:00200000:1.0:1775772597.588858:0:156517:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772597.588872:0:156517:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=0 00000080:00200000:1.0:1775772597.588876:0:156517:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772597.588891:0:156517:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772597.588939:0:156517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e551 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772597.588947:0:156517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e551 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772597.588958:0:156517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e551 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772597.588990:0:156517:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job rmdir:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156517:1862023612150528:192.168.201.137@tcp:101:rmdir.0 00000100:00100000:1.0:1775772597.589271:0:156517:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1775772597.637846:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772597.645263:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000080:00200000:1.0:1775772597.689087:0:156525:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772597.689118:0:156525:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772597.689140:0:156525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772597.689155:0:156525:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772597.689169:0:156525:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772597.689179:0:156525:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772597.689183:0:156525:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772597.689191:0:156525:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c151fb58 00010000:00010000:1.0:1775772597.689196:0:156525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772597.689204:0:156525:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772597.689218:0:156525:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772597.689227:0:156525:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71a.replay-single, flags=29 00000080:00200000:1.0:1775772597.689234:0:156525:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), inode mode 41ed mask 1 00000080:00200000:1.0:1775772597.689247:0:156525:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), flags=13 00000080:00200000:1.0:1775772597.689252:0:156525:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=test, dir=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88), intent=getattr 00000002:00010000:1.0:1775772597.689265:0:156525:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test,[0x0:0x0:0x0]) in obj [0x20001a9e3:0x19fa:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772597.689304:0:156525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e566 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 156525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772597.689312:0:156525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e566 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772597.689322:0:156525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e566 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 156525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772597.689341:0:156525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156525:1862023612151680:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772597.689408:0:156525:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d338bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1775772597.841552:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772597.841601:0:15134:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624884864 00000100:00100000:1.0:1775772597.841613:0:15134:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624884864 00000100:00100000:1.0:1775772597.841670:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9348 00000100:00100000:1.0:1775772597.841680:0:15134:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182789:x1862023624884864:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772597.841702:0:15134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841806:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772597.841813:0:15134:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca02a1e2-6d34-42cd-ba91-ef9776e58226+5:182789:x1862023624884864:12345-192.168.201.137@tcp:104: Request processed in 135us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772597.841821:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9348 00010000:00010000:1.0:1775772597.841845:0:33194:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775772597.841851:0:33194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841861:0:33194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c512f000 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775772597.841866:0:33194:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841875:0:33194:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841885:0:33194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841950:0:33194:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 2/0,0 mode: --/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841963:0:33194:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772597.841985:0:33194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 1/0,0 mode: --/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.841992:0:33194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512f000/0x8a9f4e958445e582 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da7495 expref: -99 pid: 156527 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772597.842017:0:33194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772597.842019:0:33194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772597.842020:0:33194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772598.401254:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772604.561789:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1775772605.875194:0:157103:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73a: open(O_CREAT), unlink, replay, reconnect before open replay, close ========================================================== 18:10:04 (1775772604) 00000080:00200000:1.0:1775772606.236638:0:157116:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772606.236676:0:157116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772606.236703:0:157116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.236880:0:157116:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772606.236891:0:157116:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772606.236900:0:157116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772606.236904:0:157116:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772606.236914:0:157116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1cb3bf8 00010000:00010000:1.0:1775772606.236920:0:157116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.236932:0:157116:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772606.236950:0:157116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772606.236967:0:157116:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772606.236974:0:157116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772606.236983:0:157116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.236992:0:157116:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772606.236997:0:157116:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772606.237000:0:157116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772606.237002:0:157116:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445c56f 00000080:00010000:1.0:1775772606.237005:0:157116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445c56f from it ffff9ba1c1cb3b38 00010000:00010000:1.0:1775772606.237008:0:157116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.237013:0:157116:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1775772606.237019:0:157116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772606.237024:0:157116:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f73a.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1d155a1c8), file ffff8de1d2d65500, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772606.237032:0:157116:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f73a.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1d155a1c8), intent=open|creat 00000002:00010000:1.0:1775772606.237052:0:157116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f73a.replay-single,[0x20001a9e3:0x1e29:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772606.237065:0:157116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.237120:0:157116:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.237127:0:157116:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772606.237129:0:157116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445c56f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da45d3 expref: -99 pid: 154692 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1775772606.237372:0:157116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e590 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 157116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772606.237380:0:157116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e590 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 157116 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772606.237393:0:157116:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1c7943800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772606.237407:0:157116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16a00 x1862023612154880/t0(0) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772606.237838:0:157116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9000/0x8a9f4e958445e590 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 157116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772606.237864:0:157116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job multiop:ca02a1e2-6d34-42cd-ba91-ef9776e58226:157116:1862023612154880:192.168.201.137@tcp:101:multiop.0 00000100:00100000:1.0:1775772606.238041:0:157116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192780 going to sleep for 11 seconds 00000080:00200008:1.0:1775772607.640083:0:157127:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1d155a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775772607.640100:0:157127:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772607.640605:0:157127:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772607.640686:0:157127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445e5a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 157127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772607.640705:0:157127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445e5a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 157127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772607.640716:0:157127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9200/0x8a9f4e958445e5a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 157127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772607.640865:0:157127:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job lfs:ca02a1e2-6d34-42cd-ba91-ef9776e58226:157127:1862023612155520:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772607.644040:0:157127:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192a80 going to sleep for 11 seconds 00010000:00010000:1.0:1775772610.688212:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772616.844556:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772621.129380:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612158208:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772621.129552:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612158464:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772621.129585:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612158720:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772621.129620:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1775772621.129626:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612158336:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772621.129651:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612158592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772621.135144:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612158720:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772621.964454:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772622.978348:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772624.003799:0:115739:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772626.053877:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772628.097677:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772629.120060:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772630.144242:0:115739:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772631.363130:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2403:1862023612159616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772631.363209:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612160128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772631.363241:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775772631.363248:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612159872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772631.374031:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612160128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772631.384394:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612159872:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772635.264137:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1775772637.315762:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775772621/real 1775772621] req@ffff8de1c2e15180 x1862023612158208/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775772637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772637.315818:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c2e15180 x1862023612158208/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775772637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775772637.315830:0:2402:0:(import.c:65:import_set_state_nolock()) ffff8de1c3c62800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1775772637.315835:0:2402:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.137@tcp: Connection to MGS (at 192.168.201.137@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1775772637.315838:0:2402:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.201.137@tcp for MGC192.168.201.137@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1775772637.315841:0:2402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1775772637.315845:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c2e15180 x1862023612158208/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775772637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772637.315854:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d01ec700 x1862023612158976/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775772642 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772637.315881:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c67d4e00 x1862023612159616/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775772647 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772637.315904:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d01edc00 x1862023612160256/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775772652 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1775772637.315920:0:2402:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1775772637.315923:0:2402:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1775772637.315925:0:2402:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1775772637.315928:0:2402:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1775772637.315964:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612158208:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772640.385820:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772641.413197:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775772642.632131:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) fb81e7b4-eadc-47ba-96a6-77277e1be7e5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772642.632146:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) fb81e7b4-eadc-47ba-96a6-77277e1be7e5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775772642.632149:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca02a1e2-6d34-42cd-ba91-ef9776e58226->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772642.632153:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775772642.632159:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c944c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772642.632172:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: connect to NID 192.168.201.137@tcp last attempt 8614 00000100:00080000:1.0:1775772642.632188:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775772642.632197:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: import ffff8de1c944c800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772642.632212:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772642.632256:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15180 x1862023612161280/t0(0) o38->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772642.632434:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612161408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772642.632489:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775772642.632497:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612161536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772642.651238:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612161408:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772646.527973:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772647.551917:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772650.624329:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772650.953639:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00010000:00010000:1.0:1775772651.649814:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772652.682250:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772652.868291:0:2402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 0/0 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1775772652.868302:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612164096:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772654.721878:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772656.770504:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772657.998182:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612164480:192.168.201.137@tcp:400:kworker.0 00000080:00200008:1.0:1775772659.626544:0:157549:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1d155a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775772659.626556:0:157549:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772659.626580:0:157549:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772659.626653:0:157549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 157549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772659.626664:0:157549:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 157549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772659.626675:0:157549:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 157549 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775772659.626706:0:157549:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY) req@ffff8de1c2e17100 x1862023612164608/t0(0) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 576/1152 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1775772659.626718:0:157549:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c1358000 going to sleep for 0 seconds 00000100:00100000:1.0:1775772660.673374:0:157549:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c1358000 going to sleep for 0 seconds 00010000:00010000:1.0:1775772660.864078:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772661.695846:0:157549:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c1358000 going to sleep for 0 seconds 00000100:00100000:1.0:1775772662.721572:0:157549:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c1358000 going to sleep for 0 seconds 00010000:00010000:1.0:1775772662.911965:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772663.743857:0:157549:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c1358000 going to sleep for 0 seconds 00000100:00100000:1.0:1775772664.767860:0:157549:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c1358000 going to sleep for 0 seconds 00010000:00010000:1.0:1775772667.008771:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772669.059428:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772675.206178:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772676.224885:0:135299:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775772676.668177:0:157116:0:(llite_lib.c:2274:ll_setattr_raw()) START file f73a.replay-single:[0x20001a9e3:0x1e29:0x0](ffff8de1c407a1c8) current size 0, valid attrs 41, mode 8000, uid 1, gid 0, new size 18446744071601548005, atime 1775772676.000000000, mtime 1775772676.000000000, ctime 1775772676.000000000 00000020:00100000:1.0:1775772676.668265:0:157116:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1c7943800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772676.668280:0:157116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16d80 x1862023612167936/t0(0) o36->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772676.668306:0:157116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job multiop:ca02a1e2-6d34-42cd-ba91-ef9776e58226:157116:1862023612167936:192.168.201.137@tcp:36:multiop.0 00000100:00100000:1.0:1775772676.668407:0:157116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0bae3c0 going to sleep for 11 seconds 00000080:00200000:1.0:1775772676.719341:0:157116:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1e29:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1775772676.719367:0:157116:0:(llite_lib.c:2524:ll_setattr_raw()) COMPLETED file f73a.replay-single:[0x20001a9e3:0x1e29:0x0](ffff8de1c407a1c8) current size 0, valid attrs 41, mode 8000, uid 1, gid 0, new size 18446744071601548005, atime 1775772676.000000000, mtime 1775772676.000000000, ctime 1775772676.000000000, rc 0 00000080:00200008:1.0:1775772676.719397:0:157116:0:(file.c:6226:ll_getattr_dentry()) START file f73a.replay-single:[0x20001a9e3:0x1e29:0x0](ffff8de1c407a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775772676.719404:0:157116:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x20001a9e3:0x1e29:0x0](ffff8de1c407a1c8),name=f73a.replay-single 00000002:00010000:1.0:1775772676.719427:0:157116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x20001a9e3:0x1e29:0x0]) in obj [0x20001a9e3:0x1e29:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772676.719443:0:157116:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1c3ec4c00 type 13 mode 30 res 8590043619/7721 (0 0) 00010000:00010000:1.0:1775772676.719498:0:157116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e5eb lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1e29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 157116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772676.719508:0:157116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e5eb lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1e29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 157116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772676.719519:0:157116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e5eb lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x1e29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 157116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772676.719545:0:157116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job multiop:ca02a1e2-6d34-42cd-ba91-ef9776e58226:157116:1862023612168320:192.168.201.137@tcp:101:multiop.0 00000100:00100000:1.0:1775772676.719644:0:157116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0bae780 going to sleep for 11 seconds 00000080:00200000:1.0:1775772676.755096:0:156971:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772676.755126:0:156971:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772676.755149:0:156971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da781c expref: -99 pid: 157549 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1775772676.755165:0:156971:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da781c expref: -99 pid: 157549 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:1.0:1775772676.755173:0:156971:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772676.755181:0:156971:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772676.755184:0:156971:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445e5dd 00000080:00010000:1.0:1775772676.755192:0:156971:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e5dd from it ffff9ba1c1563b58 00010000:00010000:1.0:1775772676.755195:0:156971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da781c expref: -99 pid: 157549 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1775772676.755205:0:156971:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8400/0x8a9f4e958445e5dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da781c expref: -99 pid: 157549 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:1.0:1775772676.755223:0:156971:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772676.755237:0:156971:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=f73a.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1d155a1c8), flags=9 00000080:00200000:1.0:1775772676.755242:0:156971:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f73a.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1d155a1c8), intent=getattr 00000002:00010000:1.0:1775772676.755254:0:156971:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f73a.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772676.755305:0:156971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9400/0x8a9f4e958445e5f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 156971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772676.755317:0:156971:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9400/0x8a9f4e958445e5f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 156971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772676.755327:0:156971:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9400/0x8a9f4e958445e5f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 156971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772676.755355:0:156971:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job bash:ca02a1e2-6d34-42cd-ba91-ef9776e58226:156971:1862023612168704:192.168.201.137@tcp:101:bash.0 00000100:00100000:1.0:1775772676.755440:0:156971:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0bae0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1775772677.249928:0:115739:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772678.271930:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772678.466672:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2403:1862023612168832:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772678.469826:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775772678.469856:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612168960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772678.481452:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612168960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772678.481473:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2403:1862023612168832:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772679.297234:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772680.321168:0:33194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772682.639483:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772682.639540:0:15135:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023624950656 00000100:00100000:1.0:1775772682.639561:0:15135:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023624950656 00000100:00100000:1.0:1775772682.639620:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9351 00000100:00100000:1.0:1775772682.639630:0:15135:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:173679:x1862023624950656:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772682.639652:0:15135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8de1c7943800 lock: 000000008d27859c/0x8a9f4e958445e59e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x3797d62297da7505 expref: -99 pid: 157118 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772682.639796:0:15135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772682.639803:0:15135:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:173679:x1862023624950656:12345-192.168.201.137@tcp:104: Request processed in 175us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772682.639810:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9351 00010000:00010000:1.0:1775772683.391971:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772683.592402:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612169728:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.592511:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612169984:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.592545:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1775772683.592551:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612169600:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.592585:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612169856:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.592610:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612170112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.596321:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612169856:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.596341:0:2402:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1c7943800: committing for last_committed 4294975604 gen 39 00000100:00100000:1.0:1775772683.596361:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612170112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.596373:0:2402:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1c7943800: committing for last_committed 339302416386 gen 11 00000100:00100000:1.0:1775772683.596385:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612169728:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.596396:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612169984:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772683.615239:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612169600:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772684.419811:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772685.085353:0:158600:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job rm:ca02a1e2-6d34-42cd-ba91-ef9776e58226:158600:1862023612170880:192.168.201.137@tcp:36:rm.0 00010000:00010000:1.0:1775772685.440062:0:33194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772689.536977:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772690.567037:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772691.584431:0:33194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772693.826695:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612173056:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.828941:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612173312:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.828978:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612173568:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.831322:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612173440:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.835653:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612173184:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.841458:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612173056:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.841481:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612173312:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772693.841494:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612173568:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772695.680232:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772696.704342:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772698.955470:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612173952:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772698.955944:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612174208:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772698.955994:0:2403:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff8de1c7943800 of lustre-MDT0000_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1775772698.956000:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c944c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1775772698.956005:0:2403:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8de1c7943800: Connection to lustre-MDT0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1775772698.956013:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c944c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772698.956018:0:2403:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: connect to NID 192.168.201.137@tcp last attempt 8645 00000100:00080000:1.0:1775772698.956028:0:2403:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: import ffff8de1c944c800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772698.956038:0:2403:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772698.956061:0:2403:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612174336/t0(0) o38->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772698.956083:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612173824:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772701.824844:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772702.848145:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775772704.067274:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca02a1e2-6d34-42cd-ba91-ef9776e58226->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772704.067282:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775772704.067287:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c944c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772704.067300:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: connect to NID 192.168.201.137@tcp last attempt 8675 00000100:00080000:1.0:1775772704.067316:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775772704.067333:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1c7943800: import ffff8de1c944c800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772704.067347:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772704.067368:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612174592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1775772707.967998:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772708.992047:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772714.317576:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612176000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772714.317595:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612176128:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772715.136766:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772719.424163:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612176512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772719.424256:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775772719.424262:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612176640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772719.432762:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612176640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772719.432778:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612176512:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772721.285402:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772724.555104:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612176896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772724.555120:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612177024:192.168.201.137@tcp:400:kworker.0 00000040:00080000:1.0:1775772726.374700:0:158976:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00010000:00010000:1.0:1775772726.408349:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772726.416662:0:15147:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:15147:1862023612178304:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000020:01000000:1.0:1775772726.423751:0:15147:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1775772726.423771:0:15147:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1775772726.423782:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385600/0x8a9f4e958445e631 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da7ce5 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772726.423793:0:15147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3385600/0x8a9f4e958445e631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da7ce5 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775772726.423812:0:15147:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1775772726.423815:0:15147:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-sptlrpc-ffff8de1d33c0000 from 1 10000000:01000000:1.0:1775772726.423818:0:15147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1775772726.423861:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772726.423870:0:15147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772726.423881:0:15147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772726.423911:0:15147:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:15147:1862023612178432:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775772726.424004:0:15147:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bc00 going to sleep for 11 seconds 00010000:00010000:1.0:1775772727.424530:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772731.521018:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772732.544112:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772734.593053:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775772734.638928:0:159034:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1d155a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775772734.638945:0:159034:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772734.638978:0:159034:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772734.639069:0:159034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 159034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772734.639082:0:159034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 159034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772734.639094:0:159034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 159034 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775772734.639126:0:159034:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY) req@ffff8de1c2e15f80 x1862023612179456/t0(0) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 576/1152 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1775772734.639138:0:159034:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1775772737.665563:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772738.688828:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772738.752080:0:159034:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bcc0 going to sleep for 0 seconds 00000100:00100000:1.0:1775772739.777357:0:159034:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1775772740.736461:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772740.800146:0:159034:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bcc0 going to sleep for 0 seconds 00000100:00100000:1.0:1775772741.824135:0:159034:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bcc0 going to sleep for 0 seconds 00000100:00080000:1.0:1775772741.955031:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca02a1e2-6d34-42cd-ba91-ef9776e58226->lustre-MDT0000_UUID: level REPLAY/5 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772741.955038:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca02a1e2-6d34-42cd-ba91-ef9776e58226->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY) 00000100:00100000:1.0:1775772741.955134:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612180096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772741.955260:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1775772741.955267:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2403:1862023612179968:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772741.955305:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612180224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772742.847989:0:159034:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7d9bcc0 going to sleep for 0 seconds 00010000:00080000:1.0:1775772743.122390:0:159050:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-mdc-ffff8de1c7943800 to lustre-MDT0000_UUID@192.168.201.137@tcp 00010000:00010000:1.0:1775772743.122396:0:159050:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-mdc-ffff8de1c7943800 (4) 00010000:00010000:1.0:1775772743.122433:0:159050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b9800/0x8a9f4e958445e5eb lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1e29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0x3797d62297da79f8 expref: -99 pid: 157116 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772743.122459:0:159050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1d3385c00/0x8a9f4e958445e5e4 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1e29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0x3797d62297da79ea expref: -99 pid: 157116 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772743.122478:0:159050:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-mdc-ffff8de1c7943800 00010000:00010000:1.0:1775772743.123590:0:159050:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512ec00/0x8a9f4e95844536c8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da780e expref: -99 pid: 152822 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00080000:1.0:1775772743.124464:0:159050:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(8) 00010000:00010000:1.0:1775772743.124488:0:159050:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c512e800/0x8a9f4e95844535e8 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x19fa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da7807 expref: -99 pid: 152810 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00080000:1.0:1775772743.131439:0:159050:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 2(8) 00010000:00010000:1.0:1775772743.808704:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772744.832143:0:15144:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772746.891808:0:15145:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772747.082483:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612181504:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772747.082510:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612181760:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772747.082523:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612182016:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772747.082535:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612181632:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772747.082546:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612181888:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772749.957212:0:135298:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1775772753.343585:0:158458:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8),name=/ 00000002:00010000:1.0:1775772753.343607:0:158458:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772753.343625:0:158458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da7d6a expref: -99 pid: 159034 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775772753.343640:0:158458:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da7d6a expref: -99 pid: 159034 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775772753.343649:0:158458:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772753.343656:0:158458:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00010000:1.0:1775772753.343659:0:158458:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1d155a1c8) for lock 0x8a9f4e958445e63f 00000080:00010000:1.0:1775772753.343667:0:158458:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e63f from it ffff9ba1c157bb58 00010000:00010000:1.0:1775772753.343672:0:158458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da7d6a expref: -99 pid: 159034 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775772753.343682:0:158458:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8e00/0x8a9f4e958445e63f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da7d6a expref: -99 pid: 159034 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:1.0:1775772753.343700:0:158458:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772753.343714:0:158458:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=f73b.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1d155a1c8), flags=9 00000080:00200000:1.0:1775772753.343719:0:158458:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f73b.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1d155a1c8), intent=getattr 00000002:00010000:1.0:1775772753.343771:0:158458:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f73b.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772753.343817:0:158458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 158458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772753.343826:0:158458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 158458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772753.343836:0:158458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1c7943800 lock: ffff8de1c29b8600/0x8a9f4e958445e654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 158458 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772753.343863:0:158458:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job bash:ca02a1e2-6d34-42cd-ba91-ef9776e58226:158458:1862023612184192:192.168.201.137@tcp:101:bash.0 00000100:00100000:1.0:1775772753.343945:0:158458:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0040180 going to sleep for 11 seconds 00000100:00100000:1.0:1775772757.324221:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612184832:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772757.324247:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612184704:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772757.324257:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612184576:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772757.324268:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2403:1862023612184448:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772757.324277:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2403:1862023612184320:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772758.940053:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000001:02000400:1.0:1775772759.889482:0:160074:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 74: Ensure applications don't fail waiting for OST recovery ========================================================== 18:12:38 (1775772758) 00000100:00100000:1.0:1775772762.450586:0:2402:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1c7943800: committing for last_committed 343597383682 gen 11 00000100:00100000:1.0:1775772762.450631:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612185216:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772762.450649:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612185472:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772762.450660:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2402:1862023612185088:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772762.450681:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612185344:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772762.450693:0:2402:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1c7943800: committing for last_committed 4294975607 gen 39 00000100:00100000:1.0:1775772762.450703:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2402:1862023612185600:192.168.201.137@tcp:400:kworker.0 00000080:00200000:1.0:1775772762.514680:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200026560:0x3d:0x0](ffff8de1c40642c8) 00000080:00200000:1.0:1775772762.514701:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002728:0x3d:0x0](ffff8de1c4081148) 00000080:00200000:1.0:1775772762.526261:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1d155a1c8) 00000080:00200000:1.0:1775772762.526374:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.526389:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.526479:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.526492:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x9:0x0](ffff8de1d155ba88) 00000080:00200000:1.0:1775772762.534970:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0xb:0x0](ffff8de1d155ec08) 00000080:00200000:1.0:1775772762.535008:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200003ab0:0x1:0x0](ffff8de1d1552a08) 00000080:00200000:1.0:1775772762.535025:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240000402:0x1:0x0](ffff8de1d1554b08) 00000080:00200000:1.0:1775772762.535941:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0xc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1775772762.535958:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0xc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.535994:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0xc:0x0](ffff8de1d1559148) 00000080:00200000:1.0:1775772762.536055:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.536066:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.536341:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.536354:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x15:0x0](ffff8de1d1550908) 00000080:00200000:1.0:1775772762.536428:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.536434:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.536454:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.536462:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x16:0x0](ffff8de1d155db88) 00000080:00200000:1.0:1775772762.536508:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x17:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.536514:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.536533:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x17:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.536541:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x17:0x0](ffff8de1d150aa08) 00000080:00200000:1.0:1775772762.536599:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.536604:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.536623:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.536632:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x18:0x0](ffff8de1d150cb08) 00000080:00200000:1.0:1775772762.536675:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x19:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.536680:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.536713:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x19:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.538381:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x19:0x0](ffff8de1d150db88) 00000080:00200000:1.0:1775772762.538526:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x1a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.538537:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.538589:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x1a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.538598:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x1a:0x0](ffff8de1d15500c8) 00000080:00200000:1.0:1775772762.538647:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x1b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.538653:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.538673:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x1b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.538682:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x1b:0x0](ffff8de1d1591988) 00000080:00200000:1.0:1775772762.539265:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x1c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.539275:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.539301:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x1c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.539311:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x1c:0x0](ffff8de1d155c2c8) 00000080:00200000:1.0:1775772762.539363:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x1d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.539368:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.539385:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x1d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.539393:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x1d:0x0](ffff8de1d1557448) 00000080:00200000:1.0:1775772762.539455:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x1e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.539461:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.539479:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x1e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.539488:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x1e:0x0](ffff8de1d15563c8) 00000080:00200000:1.0:1775772762.539527:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x107:0x0](ffff8de1c347b248) 00000080:00200000:1.0:1775772762.539551:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x109:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1775772762.539557:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x109:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.539578:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x109:0x0](ffff8de1c34742c8) 00000080:00200000:1.0:1775772762.539611:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x115:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.539617:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.539637:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x115:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.539645:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x115:0x0](ffff8de1c3467448) 00000080:00200000:1.0:1775772762.539712:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x118:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.539718:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.541281:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x118:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.541303:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x118:0x0](ffff8de1c34600c8) 00000080:00200000:1.0:1775772762.541397:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x122:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.541406:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.541428:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x122:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.541436:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x122:0x0](ffff8de1c347ec08) 00000080:00200000:1.0:1775772762.541488:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x123:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.541494:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.541512:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x123:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.541520:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x123:0x0](ffff8de1c347ba88) 00000080:00200000:1.0:1775772762.541577:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x200001b71:0x12e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.541582:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.541603:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x200001b71:0x12e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.541611:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200001b71:0x12e:0x0](ffff8de1c3461988) 00000080:00200000:1.0:1775772762.541660:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20000fe01:0x1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.541665:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.757606:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x188e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.757612:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.757630:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x188e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.757639:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x188e:0x0](ffff8de1c4b57448) 00000080:00200000:0.0:1775772762.758455:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x188f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.758465:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.758491:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x188f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.758502:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x188f:0x0](ffff8de1c4b480c8) 00000080:00200000:0.0:1775772762.758559:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1890:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.758577:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.758600:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1890:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.758608:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1890:0x0](ffff8de1c37acb08) 00000080:00200000:0.0:1775772762.758656:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1891:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.758661:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.759000:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1891:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.759012:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1891:0x0](ffff8de1c37bba88) 00000080:00200000:0.0:1775772762.759225:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1892:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.759232:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.759252:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1892:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.759260:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1892:0x0](ffff8de1c4b4f448) 00000080:00200000:0.0:1775772762.759307:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1893:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.759313:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.759333:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1893:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.759410:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1893:0x0](ffff8de1c4b563c8) 00000080:00200000:0.0:1775772762.759467:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1894:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.759472:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.759492:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1894:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.759554:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1894:0x0](ffff8de1c4b55348) 00000080:00200000:0.0:1775772762.759614:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1895:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.759620:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.759640:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1895:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.759650:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1895:0x0](ffff8de1c4b4e3c8) 00000080:00200000:0.0:1775772762.760331:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1896:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.760340:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.760472:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1896:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.760482:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1896:0x0](ffff8de1c37bec08) 00000080:00200000:0.0:1775772762.760527:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1897:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.760532:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.760548:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1897:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.760557:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1897:0x0](ffff8de1c37adb88) 00000080:00200000:0.0:1775772762.760614:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1898:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.760618:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.760634:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1898:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.760643:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1898:0x0](ffff8de1c4b4d348) 00000080:00200000:0.0:1775772762.760918:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1899:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.760924:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.760945:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1899:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.760954:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1899:0x0](ffff8de1c4b4b248) 00000080:00200000:0.0:1775772762.761003:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x189a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761008:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761027:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x189a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761036:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x189a:0x0](ffff8de1c4b5e3c8) 00000080:00200000:0.0:1775772762.761076:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x189b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761080:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761098:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x189b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761106:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x189b:0x0](ffff8de1c4b5d348) 00000080:00200000:0.0:1775772762.761147:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x189c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761153:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761172:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x189c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761181:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x189c:0x0](ffff8de1c37b9148) 00000080:00200000:0.0:1775772762.761223:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x189d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761228:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761247:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x189d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761255:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x189d:0x0](ffff8de1c37b9988) 00000080:00200000:0.0:1775772762.761292:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x189e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761297:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761316:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x189e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761325:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x189e:0x0](ffff8de1c4b5b248) 00000080:00200000:0.0:1775772762.761489:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x189f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761495:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761516:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x189f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761525:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x189f:0x0](ffff8de1c4b53248) 00000080:00200000:0.0:1775772762.761592:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761598:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761617:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761624:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a0:0x0](ffff8de1c4b5c2c8) 00000080:00200000:0.0:1775772762.761677:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.761683:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.761702:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.761711:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a1:0x0](ffff8de1c4b5a1c8) 00000080:00200000:0.0:1775772762.762075:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.762081:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.762101:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.762110:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a2:0x0](ffff8de1c4b5ba88) 00000080:00200000:0.0:1775772762.762156:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.762162:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.762181:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.762190:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a3:0x0](ffff8de1c4b5ec08) 00000080:00200000:0.0:1775772762.762324:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.762330:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.762437:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.762447:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a4:0x0](ffff8de1c4b59148) 00000080:00200000:0.0:1775772762.762500:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.762506:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.762524:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.762533:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a5:0x0](ffff8de1c4b59988) 00000080:00200000:1.0:1775772762.764921:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.764937:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.764994:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.765009:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a6:0x0](ffff8de1c4b5aa08) 00000080:00200000:1.0:1775772762.765098:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.765104:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.765125:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.765134:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a7:0x0](ffff8de1c37baa08) 00000080:00200000:1.0:1775772762.765185:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.765191:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.765210:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.765218:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a8:0x0](ffff8de1c4b542c8) 00000080:00200000:1.0:1775772762.765273:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18a9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.765278:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.765297:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18a9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.765305:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18a9:0x0](ffff8de1c4b5cb08) 00000080:00200000:1.0:1775772762.766298:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18aa:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766308:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766340:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18aa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18aa:0x0](ffff8de1c37bcb08) 00000080:00200000:1.0:1775772762.766412:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ab:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766417:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766434:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ab:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766442:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ab:0x0](ffff8de1c4b5db88) 00000080:00200000:1.0:1775772762.766482:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ac:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766486:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766502:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ac:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766510:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ac:0x0](ffff8de1c4b58908) 00000080:00200000:1.0:1775772762.766544:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ad:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766548:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766577:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ad:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766586:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ad:0x0](ffff8de1c4b580c8) 00000080:00200000:1.0:1775772762.766623:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ae:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766628:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766644:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ae:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766652:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ae:0x0](ffff8de1c4b5f448) 00000080:00200000:1.0:1775772762.766699:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18af:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766704:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766721:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18af:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766752:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18af:0x0](ffff8de1c4b66c08) 00000080:00200000:1.0:1775772762.766798:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766803:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766819:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766828:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b0:0x0](ffff8de1c4b61148) 00000080:00200000:1.0:1775772762.766877:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766881:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766897:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766905:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b1:0x0](ffff8de1c4b61988) 00000080:00200000:1.0:1775772762.766940:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.766945:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.766961:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.766969:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b2:0x0](ffff8de1c4b69988) 00000080:00200000:1.0:1775772762.767008:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767012:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767027:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767034:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b3:0x0](ffff8de1c4b62a08) 00000080:00200000:1.0:1775772762.767069:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767074:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767089:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767097:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b4:0x0](ffff8de1c4b6aa08) 00000080:00200000:1.0:1775772762.767134:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767139:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767156:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767163:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b5:0x0](ffff8de1c4b6cb08) 00000080:00200000:1.0:1775772762.767204:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767209:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767225:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767232:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b6:0x0](ffff8de1c4b6db88) 00000080:00200000:1.0:1775772762.767272:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767277:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767295:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767304:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b7:0x0](ffff8de1c4b521c8) 00000080:00200000:1.0:1775772762.767351:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767356:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767374:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767382:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b8:0x0](ffff8de1c4b68908) 00000080:00200000:1.0:1775772762.767421:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18b9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767425:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767442:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18b9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767450:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18b9:0x0](ffff8de1c4b680c8) 00000080:00200000:1.0:1775772762.767490:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ba:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767496:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767514:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ba:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767522:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ba:0x0](ffff8de1c4b53a88) 00000080:00200000:1.0:1775772762.767573:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18bb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767578:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767596:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18bb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767605:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18bb:0x0](ffff8de1c4b64b08) 00000080:00200000:1.0:1775772762.767645:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18bc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767650:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767667:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18bc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767676:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18bc:0x0](ffff8de1c4b56c08) 00000080:00200000:1.0:1775772762.767716:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18bd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767746:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767769:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18bd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767779:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18bd:0x0](ffff8de1c4b75348) 00000080:00200000:1.0:1775772762.767831:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18be:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767835:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767853:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18be:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767861:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18be:0x0](ffff8de1c4b6f448) 00000080:00200000:1.0:1775772762.767904:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18bf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767909:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767926:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18bf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.767934:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18bf:0x0](ffff8de1c4b65b88) 00000080:00200000:1.0:1775772762.767973:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.767978:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.767996:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.768004:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c0:0x0](ffff8de1c4b60908) 00000080:00200000:1.0:1775772762.768047:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.768052:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.768070:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.768078:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c1:0x0](ffff8de1c4b600c8) 00000080:00200000:1.0:1775772762.768121:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.768126:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.768146:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.768155:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c2:0x0](ffff8de1c4b6e3c8) 00000080:00200000:1.0:1775772762.768199:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.768204:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.768224:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.768233:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c3:0x0](ffff8de1c4b67448) 00000080:00200000:1.0:1775772762.768275:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.768280:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.768300:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.768310:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c4:0x0](ffff8de1c4b663c8) 00000080:00200000:0.0:1775772762.769310:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.769322:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.769374:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.769388:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c5:0x0](ffff8de1c4b6d348) 00000080:00200000:0.0:1775772762.769449:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.769454:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.769473:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.769482:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c6:0x0](ffff8de1c4b6b248) 00000080:00200000:0.0:1775772762.769526:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.769532:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.769551:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.769560:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c7:0x0](ffff8de1c4b73248) 00000080:00200000:0.0:1775772762.769619:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.769624:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.769645:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.769653:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c8:0x0](ffff8de1c4b51148) 00000080:00200000:0.0:1775772762.769701:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18c9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.769706:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.769749:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18c9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770049:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18c9:0x0](ffff8de1c4b6c2c8) 00000080:00200000:0.0:1775772762.770108:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ca:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770114:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770134:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ca:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770144:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ca:0x0](ffff8de1c4b65348) 00000080:00200000:0.0:1775772762.770187:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18cb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770192:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770209:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18cb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770217:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18cb:0x0](ffff8de1c4b63248) 00000080:00200000:0.0:1775772762.770256:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18cc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770261:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770278:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18cc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770287:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18cc:0x0](ffff8de1c4b6a1c8) 00000080:00200000:0.0:1775772762.770326:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18cd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770331:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770362:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18cd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18cd:0x0](ffff8de1c4b6ba88) 00000080:00200000:0.0:1775772762.770418:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ce:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770423:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770441:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770450:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ce:0x0](ffff8de1c4b6ec08) 00000080:00200000:0.0:1775772762.770492:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18cf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770497:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770516:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18cf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770525:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18cf:0x0](ffff8de1c4b7c2c8) 00000080:00200000:0.0:1775772762.770582:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.770589:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.770609:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.770618:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d0:0x0](ffff8de1c4b742c8) 00000080:00200000:0.0:1775772762.770660:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.771017:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.771045:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.771055:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d1:0x0](ffff8de1c4b69148) 00000080:00200000:0.0:1775772762.771102:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.771108:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.771126:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.771133:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d2:0x0](ffff8de1c4b721c8) 00000080:00200000:0.0:1775772762.771197:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.771203:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.771221:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.771230:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d3:0x0](ffff8de1c4b73a88) 00000080:00200000:0.0:1775772762.771278:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.771283:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.771303:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.771312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d4:0x0](ffff8de1c4b642c8) 00000080:00200000:1.0:1775772762.781523:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.781546:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.781632:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.781650:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d5:0x0](ffff8de1c4b76c08) 00000080:00200000:1.0:1775772762.782091:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.782099:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.782124:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.782133:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d6:0x0](ffff8de1c4b863c8) 00000080:00200000:1.0:1775772762.782596:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.782604:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.782627:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.782638:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d7:0x0](ffff8de1c4b71148) 00000080:00200000:1.0:1775772762.783021:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.783029:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.783051:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.783060:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d8:0x0](ffff8de1c4b7a1c8) 00000080:00200000:1.0:1775772762.783112:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18d9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.783117:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.783136:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18d9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.783271:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18d9:0x0](ffff8de1c4b621c8) 00000080:00200000:1.0:1775772762.783331:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18da:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.783338:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.783448:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18da:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.783554:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18da:0x0](ffff8de1c4b63a88) 00000080:00200000:1.0:1775772762.783616:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18db:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.783622:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.783642:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18db:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.783651:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18db:0x0](ffff8de1c4b85348) 00000080:00200000:1.0:1775772762.783923:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18dc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.783930:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.783950:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18dc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.783959:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18dc:0x0](ffff8de1c4b83248) 00000080:00200000:1.0:1775772762.784001:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18dd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.784006:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.784026:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18dd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.784034:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18dd:0x0](ffff8de1c4b842c8) 00000080:00200000:1.0:1775772762.784072:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18de:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.784077:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.784097:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18de:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.784107:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18de:0x0](ffff8de1c4b71988) 00000080:00200000:1.0:1775772762.784243:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18df:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.784249:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.784270:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18df:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.784280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18df:0x0](ffff8de1c4b821c8) 00000080:00200000:1.0:1775772762.784324:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.784330:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.784627:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.784638:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e0:0x0](ffff8de1c4b7ba88) 00000080:00200000:1.0:1775772762.784971:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.784978:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.785001:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.785010:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e1:0x0](ffff8de1c4b8cb08) 00000080:00200000:1.0:1775772762.785062:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.785067:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.785086:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.785096:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e2:0x0](ffff8de1c4b83a88) 00000080:00200000:1.0:1775772762.785140:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.785230:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.785253:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.785262:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e3:0x0](ffff8de1c4b8db88) 00000080:00200000:1.0:1775772762.785309:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.785315:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.785334:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.785423:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e4:0x0](ffff8de1c4b86c08) 00000080:00200000:1.0:1775772762.785581:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.785587:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.785607:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.785615:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e5:0x0](ffff8de1c4b72a08) 00000080:00200000:1.0:1775772762.785660:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.785664:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.786637:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.786654:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e6:0x0](ffff8de1c4b74b08) 00000080:00200000:1.0:1775772762.787226:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.787237:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.787267:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.787278:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e7:0x0](ffff8de1c4b75b88) 00000080:00200000:1.0:1775772762.787326:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.787331:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.787432:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.787443:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e8:0x0](ffff8de1c4b81148) 00000080:00200000:1.0:1775772762.787594:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18e9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.787600:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.787619:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18e9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.787628:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18e9:0x0](ffff8de1c4b81988) 00000080:00200000:1.0:1775772762.787670:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.787676:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.787694:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.787704:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ea:0x0](ffff8de1c4b82a08) 00000080:00200000:1.0:1775772762.788022:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18eb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788028:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.788048:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18eb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.788057:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18eb:0x0](ffff8de1c4b88908) 00000080:00200000:1.0:1775772762.788102:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788107:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.788122:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.788130:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ec:0x0](ffff8de1c4b84b08) 00000080:00200000:1.0:1775772762.788243:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ed:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788249:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.788267:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ed:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.788276:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ed:0x0](ffff8de1c4b85b88) 00000080:00200000:1.0:1775772762.788316:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788320:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.788336:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.788575:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ee:0x0](ffff8de1c4b80908) 00000080:00200000:1.0:1775772762.788624:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788629:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.788647:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.788655:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ef:0x0](ffff8de1c4b70908) 00000080:00200000:1.0:1775772762.788913:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788918:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.788936:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.788944:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f0:0x0](ffff8de1c4b700c8) 00000080:00200000:1.0:1775772762.788982:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.788988:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.789005:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.789013:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f1:0x0](ffff8de1c4b880c8) 00000080:00200000:1.0:1775772762.789054:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.789059:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.789077:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.789086:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f2:0x0](ffff8de1c4b8f448) 00000080:00200000:1.0:1775772762.789126:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.789131:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.790620:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.790641:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f3:0x0](ffff8de1c4b800c8) 00000080:00200000:1.0:1775772762.792288:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.792308:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.793023:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.793039:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f4:0x0](ffff8de1c4b7ec08) 00000080:00200000:1.0:1775772762.793140:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.793431:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.794538:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.794559:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f5:0x0](ffff8de1c4b87448) 00000080:00200000:1.0:1775772762.794688:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.794697:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.794750:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.794769:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f6:0x0](ffff8de1c4b8e3c8) 00000080:00200000:1.0:1775772762.794829:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.794836:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.794870:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.794879:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f7:0x0](ffff8de1c4b79148) 00000080:00200000:1.0:1775772762.794929:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.794935:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.794953:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.794962:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f8:0x0](ffff8de1c4b942c8) 00000080:00200000:1.0:1775772762.795006:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18f9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.795012:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.795031:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18f9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.795040:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18f9:0x0](ffff8de1c4b8d348) 00000080:00200000:1.0:1775772762.795084:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18fa:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.795089:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.795109:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18fa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.795118:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18fa:0x0](ffff8de1c4b79988) 00000080:00200000:1.0:1775772762.796523:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18fb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.796539:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.796591:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18fb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.796605:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18fb:0x0](ffff8de1c4b921c8) 00000080:00200000:1.0:1775772762.796676:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18fc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.796681:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.796700:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18fc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.796710:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18fc:0x0](ffff8de1c4b93a88) 00000080:00200000:1.0:1775772762.796794:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18fd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.796800:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.796820:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18fd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.796829:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18fd:0x0](ffff8de1c4b96c08) 00000080:00200000:1.0:1775772762.797383:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18fe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.797391:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.797415:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18fe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.797424:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18fe:0x0](ffff8de1c4b77448) 00000080:00200000:1.0:1775772762.797493:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x18ff:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.797499:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.797518:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x18ff:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.797528:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x18ff:0x0](ffff8de1c4b763c8) 00000080:00200000:1.0:1775772762.797580:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1900:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.797586:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.797609:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1900:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.797618:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1900:0x0](ffff8de1c4b8b248) 00000080:00200000:1.0:1775772762.798303:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1901:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.798310:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.798336:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1901:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.798357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1901:0x0](ffff8de1c4b9ba88) 00000080:00200000:1.0:1775772762.798410:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1902:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.798416:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.798434:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1902:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.798442:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1902:0x0](ffff8de1c4b8c2c8) 00000080:00200000:1.0:1775772762.799100:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1903:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.799109:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.799134:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1903:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.799226:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1903:0x0](ffff8de1c4b9ec08) 00000080:00200000:1.0:1775772762.799281:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1904:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.799288:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.799310:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1904:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.799320:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1904:0x0](ffff8de1c4b91148) 00000080:00200000:1.0:1775772762.799384:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1905:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.799390:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.799410:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1905:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.799419:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1905:0x0](ffff8de1c4b99148) 00000080:00200000:1.0:1775772762.799575:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1906:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.799581:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.799602:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1906:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.799612:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1906:0x0](ffff8de1c4b99988) 00000080:00200000:1.0:1775772762.799657:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1907:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.799664:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.800626:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1907:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.800640:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1907:0x0](ffff8de1c4b9aa08) 00000080:00200000:1.0:1775772762.801220:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1908:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.801230:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.801253:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1908:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.801262:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1908:0x0](ffff8de1c4b91988) 00000080:00200000:1.0:1775772762.801323:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1909:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.801329:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.801348:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1909:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.801357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1909:0x0](ffff8de1c4b8a1c8) 00000080:00200000:1.0:1775772762.801410:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x190a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.801416:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.801435:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x190a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.801444:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x190a:0x0](ffff8de1c4b92a08) 00000080:00200000:1.0:1775772762.802287:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x190b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.802298:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.802328:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x190b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.802339:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x190b:0x0](ffff8de1c4b8ba88) 00000080:00200000:1.0:1775772762.802391:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x190c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.802396:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.802414:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x190c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.802423:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x190c:0x0](ffff8de1c4b9cb08) 00000080:00200000:1.0:1775772762.802555:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x190d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.802570:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.802590:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x190d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.802598:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x190d:0x0](ffff8de1c4b8ec08) 00000080:00200000:1.0:1775772762.802635:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x190e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.802640:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.802657:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x190e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.802664:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x190e:0x0](ffff8de1c4b94b08) 00000080:00200000:1.0:1775772762.803018:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x190f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803024:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803044:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x190f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803052:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x190f:0x0](ffff8de1c4b95b88) 00000080:00200000:1.0:1775772762.803091:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1910:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803096:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803112:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1910:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803119:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1910:0x0](ffff8de1c4b9db88) 00000080:00200000:1.0:1775772762.803235:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1911:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803242:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803261:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1911:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803270:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1911:0x0](ffff8de1c4b98908) 00000080:00200000:1.0:1775772762.803310:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1912:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803314:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803330:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1912:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803337:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1912:0x0](ffff8de1c4b980c8) 00000080:00200000:1.0:1775772762.803370:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1913:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803374:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803389:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1913:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803396:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1913:0x0](ffff8de1c4b90908) 00000080:00200000:1.0:1775772762.803430:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1914:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803434:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803449:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1914:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803543:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1914:0x0](ffff8de1c4b900c8) 00000080:00200000:1.0:1775772762.803598:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1915:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803603:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803621:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1915:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803630:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1915:0x0](ffff8de1c4b9f448) 00000080:00200000:1.0:1775772762.803674:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x1916:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.803680:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.803696:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x1916:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.803705:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x1916:0x0](ffff8de1c4b9e3c8) 00000080:00200000:0.0:1775772762.872577:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19e5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775772762.872589:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775772762.872632:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19e5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775772762.872643:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19e5:0x0](ffff8de1c4bfd348) 00000080:00200000:1.0:1775772762.875333:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19e6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.875355:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.875426:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19e6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.875441:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19e6:0x0](ffff8de1c440d348) 00000080:00200000:1.0:1775772762.875519:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19e7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.876514:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.877238:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19e7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.877258:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19e7:0x0](ffff8de1c440b248) 00000080:00200000:1.0:1775772762.877353:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19e8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.877360:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.877380:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19e8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.877388:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19e8:0x0](ffff8de1c440c2c8) 00000080:00200000:1.0:1775772762.877438:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19e9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.877443:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.877469:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19e9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.877478:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19e9:0x0](ffff8de1c4410908) 00000080:00200000:1.0:1775772762.877513:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19ea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.877518:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.878125:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19ea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.878138:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19ea:0x0](ffff8de1c4be4b08) 00000080:00200000:1.0:1775772762.878327:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19eb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.878333:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.878354:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19eb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.878363:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19eb:0x0](ffff8de1c4406c08) 00000080:00200000:1.0:1775772762.878484:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19ec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.878490:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.878510:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19ec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.878518:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19ec:0x0](ffff8de1c44100c8) 00000080:00200000:1.0:1775772762.879101:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19ed:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.879107:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.879129:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19ed:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.879139:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19ed:0x0](ffff8de1c4401148) 00000080:00200000:1.0:1775772762.879334:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19ee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.879341:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.879361:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19ee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.879368:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19ee:0x0](ffff8de1c4bfb248) 00000080:00200000:1.0:1775772762.879430:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19ef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.879436:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.879456:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19ef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.879475:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19ef:0x0](ffff8de1c4be5b88) 00020000:00200000:1.0:1775772762.883002:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.883096:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.883126:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f0:0x0](ffff8de1c4401988) 00000080:00200000:1.0:1775772762.884479:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.884494:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.884550:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.884571:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f1:0x0](ffff8de1c4417448) 00000080:00200000:1.0:1775772762.884630:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.884636:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.884656:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.884678:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f2:0x0](ffff8de1c44163c8) 00000080:00200000:1.0:1775772762.884771:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.884778:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.884799:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.884809:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f3:0x0](ffff8de1c4402a08) 00000080:00200000:1.0:1775772762.884853:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.884860:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.884879:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.884888:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f4:0x0](ffff8de1c4415348) 00000080:00200000:1.0:1775772762.885001:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.885006:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.885027:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.885037:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f5:0x0](ffff8de1c4413248) 00000080:00200000:1.0:1775772762.885081:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.885086:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.885105:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.885115:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f6:0x0](ffff8de1c4be0908) 00000080:00200000:1.0:1775772762.885183:0:160097:0:(vvp_io.c:1817:vvp_io_init()) [0x20001a9e3:0x19f7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772762.885188:0:160097:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772762.885208:0:160097:0:(vvp_io.c:288:vvp_io_fini()) [0x20001a9e3:0x19f7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772762.885217:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19f7:0x0](ffff8de1c44142c8) 00000080:00200000:1.0:1775772762.885253:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x2400007ed:0x8f3:0x0](ffff8de1c44121c8) 00000080:00200000:1.0:1775772762.885266:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x20001a9e3:0x19fa:0x0](ffff8de1c4405b88) 00000002:00100000:1.0:1775772762.885340:0:160097:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5de2680 x1862023610502912/t330712482168(330712482168) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 520/608 e 0 to 0 dl 1775772759 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772762.885355:0:160097:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1c7943800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772762.885361:0:160097:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e17100 x1862023612185856/t0(0) o35->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772762.885391:0:160097:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job umount:ca02a1e2-6d34-42cd-ba91-ef9776e58226:160097:1862023612185856:192.168.201.137@tcp:35:umount.0 00000100:00100000:1.0:1775772762.885503:0:160097:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0ee7c00 going to sleep for 11 seconds 00000002:00100000:1.0:1775772762.893052:0:160097:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5de2680 x1862023610502912/t330712482168(330712482168) o101->lustre-MDT0000-mdc-ffff8de1c7943800@192.168.201.137@tcp:12/10 lens 520/608 e 0 to 0 dl 1775772759 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772762.893113:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1:0x0](ffff8de1c4bfc2c8) 00000080:00200000:1.0:1775772762.893137:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1:0x0](ffff8de1c4bfa1c8) 00000080:00200000:1.0:1775772762.893227:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4:0x0](ffff8de1c4ab2a08) 00000080:00200000:1.0:1775772762.893237:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4:0x0](ffff8de1c4ab4b08) 00000080:00200000:1.0:1775772762.893248:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5:0x0](ffff8de1c4411988) 00000080:00200000:1.0:1775772762.893258:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5:0x0](ffff8de1c4412a08) 00000080:00200000:1.0:1775772762.893268:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6:0x0](ffff8de1c4ab0908) 00000080:00200000:1.0:1775772762.893277:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6:0x0](ffff8de1c4ab00c8) 00000080:00200000:1.0:1775772762.893285:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7:0x0](ffff8de1c4407448) 00000080:00200000:1.0:1775772762.893294:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7:0x0](ffff8de1c44063c8) 00000080:00200000:1.0:1775772762.893303:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8:0x0](ffff8de1c4ab7448) 00000080:00200000:1.0:1775772762.893311:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8:0x0](ffff8de1c4ab63c8) 00000080:00200000:1.0:1775772762.893320:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9:0x0](ffff8de1c4bfba88) 00000080:00200000:1.0:1775772762.893329:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9:0x0](ffff8de1c4bfec08) 00000080:00200000:1.0:1775772762.893339:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa:0x0](ffff8de1c4bf9988) 00000080:00200000:1.0:1775772762.893350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa:0x0](ffff8de1c4bfaa08) 00000080:00200000:1.0:1775772762.893360:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb:0x0](ffff8de1c4400908) 00000080:00200000:1.0:1775772762.893371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb:0x0](ffff8de1c4404b08) 00000080:00200000:1.0:1775772762.895101:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc:0x0](ffff8de1c44000c8) 00000080:00200000:1.0:1775772762.895148:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc:0x0](ffff8de1c441ec08) 00000080:00200000:1.0:1775772762.895162:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd:0x0](ffff8de1c4419148) 00000080:00200000:1.0:1775772762.895174:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd:0x0](ffff8de1c4419988) 00000080:00200000:1.0:1775772762.895183:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe:0x0](ffff8de1c4414b08) 00000080:00200000:1.0:1775772762.895193:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe:0x0](ffff8de1c4411148) 00000080:00200000:1.0:1775772762.895205:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf:0x0](ffff8de1c4416c08) 00000080:00200000:1.0:1775772762.895216:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf:0x0](ffff8de1c4413a88) 00000080:00200000:1.0:1775772762.895225:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10:0x0](ffff8de1c441db88) 00000080:00200000:1.0:1775772762.895235:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10:0x0](ffff8de1c4418908) 00000080:00200000:1.0:1775772762.895246:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11:0x0](ffff8de1c44180c8) 00000080:00200000:1.0:1775772762.895256:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11:0x0](ffff8de1c441f448) 00000080:00200000:1.0:1775772762.895267:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12:0x0](ffff8de1c4415b88) 00000080:00200000:1.0:1775772762.895278:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12:0x0](ffff8de1c44221c8) 00000080:00200000:1.0:1775772762.895290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13:0x0](ffff8de1c4423a88) 00000080:00200000:1.0:1775772762.895302:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13:0x0](ffff8de1c4426c08) 00000080:00200000:1.0:1775772762.895313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14:0x0](ffff8de1c441b248) 00000080:00200000:1.0:1775772762.895324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14:0x0](ffff8de1c441c2c8) 00000080:00200000:1.0:1775772762.895333:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15:0x0](ffff8de1c441a1c8) 00000080:00200000:1.0:1775772762.895342:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15:0x0](ffff8de1c441ba88) 00000080:00200000:1.0:1775772762.895352:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16:0x0](ffff8de1c441d348) 00000080:00200000:1.0:1775772762.895362:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16:0x0](ffff8de1c441e3c8) 00000080:00200000:1.0:1775772762.895372:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17:0x0](ffff8de1c441aa08) 00000080:00200000:1.0:1775772762.895397:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17:0x0](ffff8de1c442d348) 00000080:00200000:1.0:1775772762.895407:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18:0x0](ffff8de1c4bf9148) 00000080:00200000:1.0:1775772762.895420:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18:0x0](ffff8de1c44300c8) 00000080:00200000:1.0:1775772762.895429:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19:0x0](ffff8de1c4ab42c8) 00000080:00200000:1.0:1775772762.895440:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19:0x0](ffff8de1c4ab21c8) 00000080:00200000:1.0:1775772762.895450:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a:0x0](ffff8de1c4421148) 00000080:00200000:1.0:1775772762.895468:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a:0x0](ffff8de1c4421988) 00000080:00200000:1.0:1775772762.895479:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b:0x0](ffff8de1c4422a08) 00000080:00200000:1.0:1775772762.895488:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b:0x0](ffff8de1c4424b08) 00000080:00200000:1.0:1775772762.895498:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c:0x0](ffff8de1c44363c8) 00000080:00200000:1.0:1775772762.895506:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c:0x0](ffff8de1c4435348) 00000080:00200000:1.0:1775772762.895516:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d:0x0](ffff8de1c4425b88) 00000080:00200000:1.0:1775772762.895535:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d:0x0](ffff8de1c4420908) 00000080:00200000:1.0:1775772762.895547:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e:0x0](ffff8de1c442ba88) 00000080:00200000:1.0:1775772762.895556:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e:0x0](ffff8de1c442ec08) 00000080:00200000:1.0:1775772762.895574:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f:0x0](ffff8de1c4429148) 00000080:00200000:1.0:1775772762.895582:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f:0x0](ffff8de1c4429988) 00000080:00200000:1.0:1775772762.895592:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20:0x0](ffff8de1c44200c8) 00000080:00200000:1.0:1775772762.895601:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20:0x0](ffff8de1c4427448) 00000080:00200000:1.0:1775772762.895610:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21:0x0](ffff8de1c4433248) 00000080:00200000:1.0:1775772762.895619:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21:0x0](ffff8de1c44342c8) 00000080:00200000:1.0:1775772762.895629:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22:0x0](ffff8de1c44263c8) 00000080:00200000:1.0:1775772762.895638:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22:0x0](ffff8de1c4425348) 00000080:00200000:1.0:1775772762.895647:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23:0x0](ffff8de1c4ab3a88) 00000080:00200000:1.0:1775772762.895656:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23:0x0](ffff8de1c4ab6c08) 00000080:00200000:1.0:1775772762.895672:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24:0x0](ffff8de1c44242c8) 00000080:00200000:1.0:1775772762.895681:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24:0x0](ffff8de1c441cb08) 00000080:00200000:1.0:1775772762.895690:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25:0x0](ffff8de1c4ab1988) 00000080:00200000:1.0:1775772762.895698:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25:0x0](ffff8de1c4ab3248) 00000080:00200000:1.0:1775772762.895714:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26:0x0](ffff8de1c443d348) 00000080:00200000:1.0:1775772762.895754:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26:0x0](ffff8de1c443b248) 00000080:00200000:1.0:1775772762.895773:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27:0x0](ffff8de1c443c2c8) 00000080:00200000:1.0:1775772762.895783:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x27:0x0](ffff8de1c443a1c8) 00000080:00200000:1.0:1775772762.895792:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28:0x0](ffff8de1c4ab5b88) 00000080:00200000:1.0:1775772762.895801:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28:0x0](ffff8de1c4ab1148) 00000080:00200000:1.0:1775772762.895810:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29:0x0](ffff8de1c4ab5348) 00000080:00200000:1.0:1775772762.895818:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29:0x0](ffff8de1c44421c8) 00000080:00200000:1.0:1775772762.895828:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a:0x0](ffff8de1c443ba88) 00000080:00200000:1.0:1775772762.895838:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a:0x0](ffff8de1c443ec08) 00000080:00200000:1.0:1775772762.895847:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b:0x0](ffff8de1c44280c8) 00000080:00200000:1.0:1775772762.895857:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b:0x0](ffff8de1c442f448) 00000080:00200000:1.0:1775772762.895866:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c:0x0](ffff8de1c4437448) 00000080:00200000:1.0:1775772762.895875:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c:0x0](ffff8de1c44321c8) 00000080:00200000:1.0:1775772762.895885:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d:0x0](ffff8de1c4436c08) 00000080:00200000:1.0:1775772762.895894:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d:0x0](ffff8de1c4431148) 00000080:00200000:1.0:1775772762.895904:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e:0x0](ffff8de1c4428908) 00000080:00200000:1.0:1775772762.895914:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e:0x0](ffff8de1c442db88) 00000080:00200000:1.0:1775772762.895922:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f:0x0](ffff8de1c4446c08) 00000080:00200000:1.0:1775772762.895933:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f:0x0](ffff8de1c4441148) 00000080:00200000:1.0:1775772762.895944:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30:0x0](ffff8de1c442cb08) 00000080:00200000:1.0:1775772762.895954:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30:0x0](ffff8de1c442aa08) 00000080:00200000:1.0:1775772762.895963:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31:0x0](ffff8de1c4439988) 00000080:00200000:1.0:1775772762.895972:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31:0x0](ffff8de1c443aa08) 00000080:00200000:1.0:1775772762.895980:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x32:0x0](ffff8de1c442c2c8) 00000080:00200000:1.0:1775772762.895989:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x32:0x0](ffff8de1c442b248) 00000080:00200000:1.0:1775772762.895998:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x33:0x0](ffff8de1c442a1c8) 00000080:00200000:1.0:1775772762.896006:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x33:0x0](ffff8de1c442e3c8) 00000080:00200000:1.0:1775772762.896014:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x34:0x0](ffff8de1c443cb08) 00000080:00200000:1.0:1775772762.896023:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x34:0x0](ffff8de1c443db88) 00000080:00200000:1.0:1775772762.896032:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x35:0x0](ffff8de1c444b248) 00000080:00200000:1.0:1775772762.896043:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x35:0x0](ffff8de1c444c2c8) 00000080:00200000:1.0:1775772762.896053:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x36:0x0](ffff8de1c4432a08) 00000080:00200000:1.0:1775772762.896062:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x36:0x0](ffff8de1c4434b08) 00000080:00200000:1.0:1775772762.896070:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x37:0x0](ffff8de1c4435b88) 00000080:00200000:1.0:1775772762.896078:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x37:0x0](ffff8de1c4430908) 00000080:00200000:1.0:1775772762.896086:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x38:0x0](ffff8de1c4431988) 00000080:00200000:1.0:1775772762.896094:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x38:0x0](ffff8de1c4433a88) 00000080:00200000:1.0:1775772762.896103:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x39:0x0](ffff8de1c444ec08) 00000080:00200000:1.0:1775772762.896112:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x39:0x0](ffff8de1c4449148) 00000080:00200000:1.0:1775772762.896122:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x3a:0x0](ffff8de1c444aa08) 00000080:00200000:1.0:1775772762.896132:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x3a:0x0](ffff8de1c444cb08) 00000080:00200000:1.0:1775772762.896142:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x3b:0x0](ffff8de1c44542c8) 00000080:00200000:1.0:1775772762.896152:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x3b:0x0](ffff8de1c44521c8) 00000080:00200000:1.0:1775772762.896161:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x3c:0x0](ffff8de1c444db88) 00000080:00200000:1.0:1775772762.896172:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x3c:0x0](ffff8de1c4448908) 00000080:00200000:1.0:1775772762.896180:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x3d:0x0](ffff8de1c4453a88) 00000080:00200000:1.0:1775772762.896190:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x3d:0x0](ffff8de1c4456c08) 00000080:00200000:1.0:1775772762.896198:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x3e:0x0](ffff8de1c4444b08) 00000080:00200000:1.0:1775772762.896208:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x3e:0x0](ffff8de1c4445b88) 00000080:00200000:1.0:1775772762.896217:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x3f:0x0](ffff8de1c4451148) 00000080:00200000:1.0:1775772762.896226:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x3f:0x0](ffff8de1c4451988) 00000080:00200000:1.0:1775772762.896235:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x40:0x0](ffff8de1c4452a08) 00000080:00200000:1.0:1775772762.896243:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x40:0x0](ffff8de1c4454b08) 00000080:00200000:1.0:1775772762.896251:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x41:0x0](ffff8de1c444d348) 00000080:00200000:1.0:1775772762.896259:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x41:0x0](ffff8de1c444f448) 00000080:00200000:1.0:1775772762.896268:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x42:0x0](ffff8de1c44480c8) 00000080:00200000:1.0:1775772762.896277:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x42:0x0](ffff8de1c4449988) 00000080:00200000:1.0:1775772762.896286:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x43:0x0](ffff8de1c443f448) 00000080:00200000:1.0:1775772762.896295:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x43:0x0](ffff8de1c443e3c8) 00000080:00200000:1.0:1775772762.896304:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x44:0x0](ffff8de1c444ba88) 00000080:00200000:1.0:1775772762.896313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x44:0x0](ffff8de1c444a1c8) 00000080:00200000:1.0:1775772762.896322:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x45:0x0](ffff8de1c4455b88) 00000080:00200000:1.0:1775772762.896332:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x45:0x0](ffff8de1c4450908) 00000080:00200000:1.0:1775772762.896341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x46:0x0](ffff8de1c44380c8) 00000080:00200000:1.0:1775772762.896349:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x46:0x0](ffff8de1c4438908) 00000080:00200000:1.0:1775772762.896360:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x47:0x0](ffff8de1c4423248) 00000080:00200000:1.0:1775772762.896369:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x47:0x0](ffff8de1c445d348) 00000080:00200000:1.0:1775772762.896377:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x48:0x0](ffff8de1c4467448) 00000080:00200000:1.0:1775772762.896386:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x48:0x0](ffff8de1c44663c8) 00000080:00200000:1.0:1775772762.896394:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x49:0x0](ffff8de1c4465348) 00000080:00200000:1.0:1775772762.896404:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x49:0x0](ffff8de1c4463248) 00000080:00200000:1.0:1775772762.896411:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4a:0x0](ffff8de1c44642c8) 00000080:00200000:1.0:1775772762.896420:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4a:0x0](ffff8de1c44621c8) 00000080:00200000:1.0:1775772762.896429:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4b:0x0](ffff8de1c4440908) 00000080:00200000:1.0:1775772762.896439:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4b:0x0](ffff8de1c44400c8) 00000080:00200000:1.0:1775772762.896450:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4c:0x0](ffff8de1c445c2c8) 00000080:00200000:1.0:1775772762.896459:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4c:0x0](ffff8de1c445a1c8) 00000080:00200000:1.0:1775772762.896470:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4d:0x0](ffff8de1c445ba88) 00000080:00200000:1.0:1775772762.896480:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4d:0x0](ffff8de1c445ec08) 00000080:00200000:1.0:1775772762.896488:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4e:0x0](ffff8de1c4466c08) 00000080:00200000:1.0:1775772762.896497:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4e:0x0](ffff8de1c4461148) 00000080:00200000:1.0:1775772762.896506:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x4f:0x0](ffff8de1c4445348) 00000080:00200000:1.0:1775772762.896516:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x4f:0x0](ffff8de1c4443248) 00000080:00200000:1.0:1775772762.896525:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x50:0x0](ffff8de1c4459988) 00000080:00200000:1.0:1775772762.896535:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x50:0x0](ffff8de1c445aa08) 00000080:00200000:1.0:1775772762.896544:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x51:0x0](ffff8de1c44500c8) 00000080:00200000:1.0:1775772762.896554:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x51:0x0](ffff8de1c4457448) 00000080:00200000:1.0:1775772762.896578:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x52:0x0](ffff8de1c4461988) 00000080:00200000:1.0:1775772762.896588:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x52:0x0](ffff8de1c4462a08) 00000080:00200000:1.0:1775772762.896597:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x53:0x0](ffff8de1c44442c8) 00000080:00200000:1.0:1775772762.896607:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x53:0x0](ffff8de1c44463c8) 00000080:00200000:1.0:1775772762.896616:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x54:0x0](ffff8de1c4447448) 00000080:00200000:1.0:1775772762.896624:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x54:0x0](ffff8de1c4442a08) 00000080:00200000:1.0:1775772762.896633:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x55:0x0](ffff8de1c4465b88) 00000080:00200000:1.0:1775772762.896642:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x55:0x0](ffff8de1c4460908) 00000080:00200000:1.0:1775772762.896651:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x56:0x0](ffff8de1c4458908) 00000080:00200000:1.0:1775772762.896661:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x56:0x0](ffff8de1c44580c8) 00000080:00200000:1.0:1775772762.896669:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x57:0x0](ffff8de1c44600c8) 00000080:00200000:1.0:1775772762.896678:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x57:0x0](ffff8de1c4464b08) 00000080:00200000:1.0:1775772762.896687:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x58:0x0](ffff8de1c445e3c8) 00000080:00200000:1.0:1775772762.896696:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x58:0x0](ffff8de1c445db88) 00000080:00200000:1.0:1775772762.896705:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x59:0x0](ffff8de1c445f448) 00000080:00200000:1.0:1775772762.896715:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x59:0x0](ffff8de1c445cb08) 00000080:00200000:1.0:1775772762.896786:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5a:0x0](ffff8de1c445b248) 00000080:00200000:1.0:1775772762.896797:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5a:0x0](ffff8de1c444e3c8) 00000080:00200000:1.0:1775772762.896807:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5b:0x0](ffff8de1c446c2c8) 00000080:00200000:1.0:1775772762.896817:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5b:0x0](ffff8de1c446a1c8) 00000080:00200000:1.0:1775772762.896828:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5c:0x0](ffff8de1c4463a88) 00000080:00200000:1.0:1775772762.896838:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5c:0x0](ffff8de1c4439148) 00000080:00200000:1.0:1775772762.896848:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5d:0x0](ffff8de1c446ba88) 00000080:00200000:1.0:1775772762.896859:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5d:0x0](ffff8de1c446ec08) 00000080:00200000:1.0:1775772762.896868:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5e:0x0](ffff8de1c44763c8) 00000080:00200000:1.0:1775772762.896877:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5e:0x0](ffff8de1c4475348) 00000080:00200000:1.0:1775772762.896886:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x5f:0x0](ffff8de1c4443a88) 00000080:00200000:1.0:1775772762.896897:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x5f:0x0](ffff8de1c4441988) 00000080:00200000:1.0:1775772762.896906:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x60:0x0](ffff8de1c44780c8) 00000080:00200000:1.0:1775772762.896915:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x60:0x0](ffff8de1c447f448) 00000080:00200000:1.0:1775772762.896924:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x61:0x0](ffff8de1c44742c8) 00000080:00200000:1.0:1775772762.896933:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x61:0x0](ffff8de1c44721c8) 00000080:00200000:1.0:1775772762.896942:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x62:0x0](ffff8de1c4473248) 00000080:00200000:1.0:1775772762.896951:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x62:0x0](ffff8de1c4473a88) 00000080:00200000:1.0:1775772762.896959:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x63:0x0](ffff8de1c447e3c8) 00000080:00200000:1.0:1775772762.896968:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x63:0x0](ffff8de1c447d348) 00000080:00200000:1.0:1775772762.896978:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x64:0x0](ffff8de1c447c2c8) 00000080:00200000:1.0:1775772762.896987:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x64:0x0](ffff8de1c447a1c8) 00000080:00200000:1.0:1775772762.896996:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x65:0x0](ffff8de1c446db88) 00000080:00200000:1.0:1775772762.897005:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x65:0x0](ffff8de1c4468908) 00000080:00200000:1.0:1775772762.897014:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x66:0x0](ffff8de1c44680c8) 00000080:00200000:1.0:1775772762.897023:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x66:0x0](ffff8de1c446f448) 00000080:00200000:1.0:1775772762.897033:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x67:0x0](ffff8de1c446e3c8) 00000080:00200000:1.0:1775772762.897042:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x67:0x0](ffff8de1c446d348) 00000080:00200000:1.0:1775772762.897052:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x68:0x0](ffff8de1c4471148) 00000080:00200000:1.0:1775772762.897062:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x68:0x0](ffff8de1c4471988) 00000080:00200000:1.0:1775772762.897071:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x69:0x0](ffff8de1c447ba88) 00000080:00200000:1.0:1775772762.897084:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x69:0x0](ffff8de1c447ec08) 00000080:00200000:1.0:1775772762.897093:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6a:0x0](ffff8de1c4472a08) 00000080:00200000:1.0:1775772762.897102:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6a:0x0](ffff8de1c4474b08) 00000080:00200000:1.0:1775772762.897110:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6b:0x0](ffff8de1c4475b88) 00000080:00200000:1.0:1775772762.897119:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6b:0x0](ffff8de1c4470908) 00000080:00200000:1.0:1775772762.897129:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6c:0x0](ffff8de1c4476c08) 00000080:00200000:1.0:1775772762.897138:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6c:0x0](ffff8de1c4477448) 00000080:00200000:1.0:1775772762.897147:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6d:0x0](ffff8de1c446b248) 00000080:00200000:1.0:1775772762.897158:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6d:0x0](ffff8de1c446cb08) 00000080:00200000:1.0:1775772762.897167:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6e:0x0](ffff8de1c446aa08) 00000080:00200000:1.0:1775772762.897176:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6e:0x0](ffff8de1c4469988) 00000080:00200000:1.0:1775772762.897186:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x6f:0x0](ffff8de1c44700c8) 00000080:00200000:1.0:1775772762.897193:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x6f:0x0](ffff8de1c4484b08) 00000080:00200000:1.0:1775772762.897201:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x70:0x0](ffff8de1c4469148) 00000080:00200000:1.0:1775772762.897208:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x70:0x0](ffff8de1c4459148) 00000080:00200000:1.0:1775772762.897216:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x71:0x0](ffff8de1c4480908) 00000080:00200000:1.0:1775772762.897224:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x71:0x0](ffff8de1c44800c8) 00000080:00200000:1.0:1775772762.897233:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x72:0x0](ffff8de1c4487448) 00000080:00200000:1.0:1775772762.897243:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x72:0x0](ffff8de1c44863c8) 00000080:00200000:1.0:1775772762.897252:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x73:0x0](ffff8de1c4485348) 00000080:00200000:1.0:1775772762.897262:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x73:0x0](ffff8de1c4483248) 00000080:00200000:1.0:1775772762.897270:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x74:0x0](ffff8de1c4488908) 00000080:00200000:1.0:1775772762.897280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x74:0x0](ffff8de1c44880c8) 00000080:00200000:1.0:1775772762.897290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x75:0x0](ffff8de1c4479148) 00000080:00200000:1.0:1775772762.897299:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x75:0x0](ffff8de1c4479988) 00000080:00200000:1.0:1775772762.897308:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x76:0x0](ffff8de1c44842c8) 00000080:00200000:1.0:1775772762.897316:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x76:0x0](ffff8de1c44821c8) 00000080:00200000:1.0:1775772762.897326:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x77:0x0](ffff8de1c4453248) 00000080:00200000:1.0:1775772762.897336:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x77:0x0](ffff8de1c4455348) 00000080:00200000:1.0:1775772762.897344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x78:0x0](ffff8de1c448d348) 00000080:00200000:1.0:1775772762.897352:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x78:0x0](ffff8de1c448b248) 00000080:00200000:1.0:1775772762.897361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x79:0x0](ffff8de1c447aa08) 00000080:00200000:1.0:1775772762.897371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x79:0x0](ffff8de1c447cb08) 00000080:00200000:1.0:1775772762.897381:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7a:0x0](ffff8de1c4486c08) 00000080:00200000:1.0:1775772762.897389:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7a:0x0](ffff8de1c4481148) 00000080:00200000:1.0:1775772762.897399:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7b:0x0](ffff8de1c447db88) 00000080:00200000:1.0:1775772762.897408:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7b:0x0](ffff8de1c4478908) 00000080:00200000:1.0:1775772762.897417:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7c:0x0](ffff8de1c448a1c8) 00000080:00200000:1.0:1775772762.897427:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7c:0x0](ffff8de1c448ba88) 00000080:00200000:1.0:1775772762.897436:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7d:0x0](ffff8de1c448ec08) 00000080:00200000:1.0:1775772762.897446:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7d:0x0](ffff8de1c4489148) 00000080:00200000:1.0:1775772762.897455:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7e:0x0](ffff8de1c447b248) 00000080:00200000:1.0:1775772762.897464:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7e:0x0](ffff8de1c44900c8) 00000080:00200000:1.0:1775772762.897473:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x7f:0x0](ffff8de1c4489988) 00000080:00200000:1.0:1775772762.897480:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x7f:0x0](ffff8de1c448c2c8) 00000080:00200000:1.0:1775772762.897489:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x80:0x0](ffff8de1c448f448) 00000080:00200000:1.0:1775772762.897498:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x80:0x0](ffff8de1c448db88) 00000080:00200000:1.0:1775772762.897509:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x81:0x0](ffff8de1c449a1c8) 00000080:00200000:1.0:1775772762.897518:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x81:0x0](ffff8de1c449ba88) 00000080:00200000:1.0:1775772762.897527:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x82:0x0](ffff8de1c448e3c8) 00000080:00200000:1.0:1775772762.897535:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x82:0x0](ffff8de1c448cb08) 00000080:00200000:1.0:1775772762.897543:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x83:0x0](ffff8de1c449ec08) 00000080:00200000:1.0:1775772762.897552:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x83:0x0](ffff8de1c4499148) 00000080:00200000:1.0:1775772762.899075:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x84:0x0](ffff8de1c44a1988) 00000080:00200000:1.0:1775772762.899111:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x84:0x0](ffff8de1c44a2a08) 00000080:00200000:1.0:1775772762.899123:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x85:0x0](ffff8de1c44a4b08) 00000080:00200000:1.0:1775772762.899134:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x85:0x0](ffff8de1c44a5b88) 00000080:00200000:1.0:1775772762.899223:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x86:0x0](ffff8de1c44a0908) 00000080:00200000:1.0:1775772762.899236:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x86:0x0](ffff8de1c44a00c8) 00000080:00200000:1.0:1775772762.899246:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x87:0x0](ffff8de1c4483a88) 00000080:00200000:1.0:1775772762.899268:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x87:0x0](ffff8de1c4485b88) 00000080:00200000:1.0:1775772762.899278:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x88:0x0](ffff8de1c4481988) 00000080:00200000:1.0:1775772762.899290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x88:0x0](ffff8de1c4482a08) 00000080:00200000:1.0:1775772762.899301:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x89:0x0](ffff8de1c44af448) 00000080:00200000:1.0:1775772762.899312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x89:0x0](ffff8de1c44ae3c8) 00000080:00200000:1.0:1775772762.899323:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8a:0x0](ffff8de1c44a5348) 00000080:00200000:1.0:1775772762.899333:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8a:0x0](ffff8de1c44a3248) 00000080:00200000:1.0:1775772762.899344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8b:0x0](ffff8de1c44963c8) 00000080:00200000:1.0:1775772762.899357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8b:0x0](ffff8de1c4495348) 00000080:00200000:1.0:1775772762.899367:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8c:0x0](ffff8de1c4497448) 00000080:00200000:1.0:1775772762.900960:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8c:0x0](ffff8de1c4493248) 00000080:00200000:1.0:1775772762.900995:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8d:0x0](ffff8de1c44a21c8) 00000080:00200000:1.0:1775772762.901009:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8d:0x0](ffff8de1c44a3a88) 00000080:00200000:1.0:1775772762.901020:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8e:0x0](ffff8de1c44a6c08) 00000080:00200000:1.0:1775772762.901032:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8e:0x0](ffff8de1c44a1148) 00000080:00200000:1.0:1775772762.901042:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x8f:0x0](ffff8de1c44a63c8) 00000080:00200000:1.0:1775772762.901052:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x8f:0x0](ffff8de1c44a7448) 00000080:00200000:1.0:1775772762.901063:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x90:0x0](ffff8de1c448aa08) 00000080:00200000:1.0:1775772762.901074:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x90:0x0](ffff8de1c44b2a08) 00000080:00200000:1.0:1775772762.901085:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x91:0x0](ffff8de1c44b5b88) 00000080:00200000:1.0:1775772762.901097:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x91:0x0](ffff8de1c44b0908) 00000080:00200000:1.0:1775772762.901107:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x92:0x0](ffff8de1c44942c8) 00000080:00200000:1.0:1775772762.901117:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x92:0x0](ffff8de1c44921c8) 00000080:00200000:1.0:1775772762.901128:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x93:0x0](ffff8de1c44b00c8) 00000080:00200000:1.0:1775772762.901139:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x93:0x0](ffff8de1c44b7448) 00000080:00200000:1.0:1775772762.901230:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x94:0x0](ffff8de1c449cb08) 00000080:00200000:1.0:1775772762.901242:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x94:0x0](ffff8de1c449db88) 00000080:00200000:1.0:1775772762.901254:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x95:0x0](ffff8de1c4493a88) 00000080:00200000:1.0:1775772762.901264:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x95:0x0](ffff8de1c4496c08) 00000080:00200000:1.0:1775772762.901276:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x96:0x0](ffff8de1c44b5348) 00000080:00200000:1.0:1775772762.901286:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x96:0x0](ffff8de1c44b3248) 00000080:00200000:1.0:1775772762.901296:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x97:0x0](ffff8de1c44b21c8) 00000080:00200000:1.0:1775772762.901305:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x97:0x0](ffff8de1c44b3a88) 00000080:00200000:1.0:1775772762.901314:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x98:0x0](ffff8de1c44b6c08) 00000080:00200000:1.0:1775772762.901324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x98:0x0](ffff8de1c44b1148) 00000080:00200000:1.0:1775772762.901333:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x99:0x0](ffff8de1c44aa1c8) 00000080:00200000:1.0:1775772762.901342:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x99:0x0](ffff8de1c44aba88) 00000080:00200000:1.0:1775772762.901351:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9a:0x0](ffff8de1c44b42c8) 00000080:00200000:1.0:1775772762.901361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9a:0x0](ffff8de1c44b63c8) 00000080:00200000:1.0:1775772762.901371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9b:0x0](ffff8de1c44b1988) 00000080:00200000:1.0:1775772762.902267:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9b:0x0](ffff8de1c44b4b08) 00000080:00200000:1.0:1775772762.902284:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9c:0x0](ffff8de1c4498908) 00000080:00200000:1.0:1775772762.902294:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9c:0x0](ffff8de1c44980c8) 00000080:00200000:1.0:1775772762.902302:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9d:0x0](ffff8de1c4491148) 00000080:00200000:1.0:1775772762.902313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9d:0x0](ffff8de1c4491988) 00000080:00200000:1.0:1775772762.902322:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9e:0x0](ffff8de1c44b8908) 00000080:00200000:1.0:1775772762.902332:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9e:0x0](ffff8de1c44b80c8) 00000080:00200000:1.0:1775772762.902340:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x9f:0x0](ffff8de1c44a9988) 00000080:00200000:1.0:1775772762.902348:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x9f:0x0](ffff8de1c44aaa08) 00000080:00200000:1.0:1775772762.902357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa0:0x0](ffff8de1c4492a08) 00000080:00200000:1.0:1775772762.902365:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa0:0x0](ffff8de1c4494b08) 00000080:00200000:1.0:1775772762.902653:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa1:0x0](ffff8de1c44bd348) 00000080:00200000:1.0:1775772762.902906:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa1:0x0](ffff8de1c44bb248) 00000080:00200000:1.0:1775772762.902922:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa2:0x0](ffff8de1c44ba1c8) 00000080:00200000:1.0:1775772762.902930:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa2:0x0](ffff8de1c44bba88) 00000080:00200000:1.0:1775772762.902940:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa3:0x0](ffff8de1c44bc2c8) 00000080:00200000:1.0:1775772762.902950:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa3:0x0](ffff8de1c44bec08) 00000080:00200000:1.0:1775772762.902960:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa4:0x0](ffff8de1c44b9148) 00000080:00200000:1.0:1775772762.902968:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa4:0x0](ffff8de1c44b9988) 00000080:00200000:1.0:1775772762.902977:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa5:0x0](ffff8de1c4490908) 00000080:00200000:1.0:1775772762.902986:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa5:0x0](ffff8de1c44c0908) 00000080:00200000:1.0:1775772762.902995:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa6:0x0](ffff8de1c44a80c8) 00000080:00200000:1.0:1775772762.903004:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa6:0x0](ffff8de1c44adb88) 00000080:00200000:1.0:1775772762.903013:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa7:0x0](ffff8de1c44baa08) 00000080:00200000:1.0:1775772762.903022:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa7:0x0](ffff8de1c44bcb08) 00000080:00200000:1.0:1775772762.903031:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa8:0x0](ffff8de1c44acb08) 00000080:00200000:1.0:1775772762.903039:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa8:0x0](ffff8de1c44a9148) 00000080:00200000:1.0:1775772762.903047:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xa9:0x0](ffff8de1c44aec08) 00000080:00200000:1.0:1775772762.903056:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xa9:0x0](ffff8de1c44ac2c8) 00000080:00200000:1.0:1775772762.903066:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xaa:0x0](ffff8de1c44be3c8) 00000080:00200000:1.0:1775772762.903074:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xaa:0x0](ffff8de1c44bf448) 00000080:00200000:1.0:1775772762.903085:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xab:0x0](ffff8de1c44bdb88) 00000080:00200000:1.0:1775772762.903092:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xab:0x0](ffff8de1c44a42c8) 00000080:00200000:1.0:1775772762.903101:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xac:0x0](ffff8de1c44c9988) 00000080:00200000:1.0:1775772762.903108:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xac:0x0](ffff8de1c44caa08) 00000080:00200000:1.0:1775772762.903117:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xad:0x0](ffff8de1c44c00c8) 00000080:00200000:1.0:1775772762.903125:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xad:0x0](ffff8de1c44c7448) 00000080:00200000:1.0:1775772762.903133:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xae:0x0](ffff8de1c44c63c8) 00000080:00200000:1.0:1775772762.903211:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xae:0x0](ffff8de1c44c5348) 00000080:00200000:1.0:1775772762.903223:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xaf:0x0](ffff8de1c44ccb08) 00000080:00200000:1.0:1775772762.903232:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xaf:0x0](ffff8de1c44cdb88) 00000080:00200000:1.0:1775772762.903241:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb0:0x0](ffff8de1c44c80c8) 00000080:00200000:1.0:1775772762.903251:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb0:0x0](ffff8de1c44cf448) 00000080:00200000:1.0:1775772762.903259:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb1:0x0](ffff8de1c44a8908) 00000080:00200000:1.0:1775772762.903269:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb1:0x0](ffff8de1c44ad348) 00000080:00200000:1.0:1775772762.903277:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb2:0x0](ffff8de1c44ab248) 00000080:00200000:1.0:1775772762.903287:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb2:0x0](ffff8de1c44d1988) 00000080:00200000:1.0:1775772762.903295:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb3:0x0](ffff8de1c44ce3c8) 00000080:00200000:1.0:1775772762.903303:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb3:0x0](ffff8de1c44cd348) 00000080:00200000:1.0:1775772762.903311:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb4:0x0](ffff8de1c449d348) 00000080:00200000:1.0:1775772762.903319:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb4:0x0](ffff8de1c449b248) 00000080:00200000:1.0:1775772762.903327:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb5:0x0](ffff8de1c44ca1c8) 00000080:00200000:1.0:1775772762.903337:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb5:0x0](ffff8de1c44cba88) 00000080:00200000:1.0:1775772762.903347:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb6:0x0](ffff8de1c44cc2c8) 00000080:00200000:1.0:1775772762.903355:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb6:0x0](ffff8de1c44cec08) 00000080:00200000:1.0:1775772762.903365:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb7:0x0](ffff8de1c44c42c8) 00000080:00200000:1.0:1775772762.903630:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb7:0x0](ffff8de1c44c21c8) 00000080:00200000:1.0:1775772762.903644:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb8:0x0](ffff8de1c44cb248) 00000080:00200000:1.0:1775772762.903653:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb8:0x0](ffff8de1c44c8908) 00000080:00200000:1.0:1775772762.903661:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xb9:0x0](ffff8de1c44d4b08) 00000080:00200000:1.0:1775772762.903679:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xb9:0x0](ffff8de1c44d5b88) 00000080:00200000:1.0:1775772762.903688:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xba:0x0](ffff8de1c44c9148) 00000080:00200000:1.0:1775772762.903695:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xba:0x0](ffff8de1c44db248) 00000080:00200000:1.0:1775772762.903704:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xbb:0x0](ffff8de1c44d0908) 00000080:00200000:1.0:1775772762.904067:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xbb:0x0](ffff8de1c44d00c8) 00000080:00200000:1.0:1775772762.904076:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xbc:0x0](ffff8de1c44c1148) 00000080:00200000:1.0:1775772762.904086:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xbc:0x0](ffff8de1c44c1988) 00000080:00200000:1.0:1775772762.904095:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xbd:0x0](ffff8de1c44d7448) 00000080:00200000:1.0:1775772762.904104:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xbd:0x0](ffff8de1c44d63c8) 00000080:00200000:1.0:1775772762.904112:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xbe:0x0](ffff8de1c44c2a08) 00000080:00200000:1.0:1775772762.904120:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xbe:0x0](ffff8de1c44c4b08) 00000080:00200000:1.0:1775772762.904222:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xbf:0x0](ffff8de1c449e3c8) 00000080:00200000:1.0:1775772762.904238:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xbf:0x0](ffff8de1c449f448) 00000080:00200000:1.0:1775772762.904249:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc0:0x0](ffff8de1c44d9148) 00000080:00200000:1.0:1775772762.904260:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc0:0x0](ffff8de1c44d9988) 00000080:00200000:1.0:1775772762.904268:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc1:0x0](ffff8de1c44dcb08) 00000080:00200000:1.0:1775772762.904278:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc1:0x0](ffff8de1c44ddb88) 00000080:00200000:1.0:1775772762.904288:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc2:0x0](ffff8de1c44c5b88) 00000080:00200000:1.0:1775772762.904307:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc2:0x0](ffff8de1c44c6c08) 00000080:00200000:1.0:1775772762.904325:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc3:0x0](ffff8de1c44d8908) 00000080:00200000:1.0:1775772762.904334:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc3:0x0](ffff8de1c44d80c8) 00000080:00200000:1.0:1775772762.904342:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc4:0x0](ffff8de1c44daa08) 00000080:00200000:1.0:1775772762.904351:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc4:0x0](ffff8de1c44df448) 00000080:00200000:1.0:1775772762.904361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc5:0x0](ffff8de1c44d42c8) 00000080:00200000:1.0:1775772762.904369:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc5:0x0](ffff8de1c44d21c8) 00000080:00200000:1.0:1775772762.905103:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc6:0x0](ffff8de1c44dd348) 00000080:00200000:1.0:1775772762.905125:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc6:0x0](ffff8de1c44dec08) 00000080:00200000:1.0:1775772762.905134:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc7:0x0](ffff8de1c44d3248) 00000080:00200000:1.0:1775772762.905211:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc7:0x0](ffff8de1c44d3a88) 00000080:00200000:1.0:1775772762.905223:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc8:0x0](ffff8de1c44de3c8) 00000080:00200000:1.0:1775772762.905232:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc8:0x0](ffff8de1c44dba88) 00000080:00200000:1.0:1775772762.905243:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xc9:0x0](ffff8de1c44da1c8) 00000080:00200000:1.0:1775772762.905252:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xc9:0x0](ffff8de1c44dc2c8) 00000080:00200000:1.0:1775772762.905261:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xca:0x0](ffff8de1c44d1148) 00000080:00200000:1.0:1775772762.905271:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xca:0x0](ffff8de1c44d6c08) 00000080:00200000:1.0:1775772762.905280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xcb:0x0](ffff8de1c44e5348) 00000080:00200000:1.0:1775772762.905290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xcb:0x0](ffff8de1c44e3248) 00000080:00200000:1.0:1775772762.905298:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xcc:0x0](ffff8de1c44d5348) 00000080:00200000:1.0:1775772762.905306:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xcc:0x0](ffff8de1c44d2a08) 00000080:00200000:1.0:1775772762.905315:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xcd:0x0](ffff8de1c44c3248) 00000080:00200000:1.0:1775772762.905324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xcd:0x0](ffff8de1c44c3a88) 00000080:00200000:1.0:1775772762.905332:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xce:0x0](ffff8de1c4499988) 00000080:00200000:1.0:1775772762.905341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xce:0x0](ffff8de1c449aa08) 00000080:00200000:1.0:1775772762.905350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xcf:0x0](ffff8de1c44e3a88) 00000080:00200000:1.0:1775772762.905359:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xcf:0x0](ffff8de1c44e6c08) 00000080:00200000:1.0:1775772762.905368:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd0:0x0](ffff8de1c44e21c8) 00000080:00200000:1.0:1775772762.905622:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd0:0x0](ffff8de1c44e1148) 00000080:00200000:1.0:1775772762.905640:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd1:0x0](ffff8de1c44ee3c8) 00000080:00200000:1.0:1775772762.905650:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd1:0x0](ffff8de1c44ed348) 00000080:00200000:1.0:1775772762.905660:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd2:0x0](ffff8de1c44e4b08) 00000080:00200000:1.0:1775772762.905680:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd2:0x0](ffff8de1c44e5b88) 00000080:00200000:1.0:1775772762.905691:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd3:0x0](ffff8de1c4495b88) 00000080:00200000:1.0:1775772762.905710:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd3:0x0](ffff8de1c44f00c8) 00000080:00200000:1.0:1775772762.905721:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd4:0x0](ffff8de1c44e00c8) 00000080:00200000:1.0:1775772762.908119:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd4:0x0](ffff8de1c44e2a08) 00000080:00200000:1.0:1775772762.908130:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd5:0x0](ffff8de1c44eb248) 00000080:00200000:1.0:1775772762.908228:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd5:0x0](ffff8de1c44ec2c8) 00000080:00200000:1.0:1775772762.908243:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd6:0x0](ffff8de1c44e42c8) 00000080:00200000:1.0:1775772762.908253:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd6:0x0](ffff8de1c44e63c8) 00000080:00200000:1.0:1775772762.908264:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd7:0x0](ffff8de1c44ea1c8) 00000080:00200000:1.0:1775772762.908274:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd7:0x0](ffff8de1c44eba88) 00000080:00200000:1.0:1775772762.908284:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd8:0x0](ffff8de1c44e7448) 00000080:00200000:1.0:1775772762.908296:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd8:0x0](ffff8de1c44e1988) 00000080:00200000:1.0:1775772762.908306:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xd9:0x0](ffff8de1c44eec08) 00000080:00200000:1.0:1775772762.908316:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xd9:0x0](ffff8de1c44e9148) 00000080:00200000:1.0:1775772762.908327:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xda:0x0](ffff8de1c44f63c8) 00000080:00200000:1.0:1775772762.908336:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xda:0x0](ffff8de1c44f5348) 00000080:00200000:1.0:1775772762.908345:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xdb:0x0](ffff8de1c44e9988) 00000080:00200000:1.0:1775772762.908355:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xdb:0x0](ffff8de1c44eaa08) 00000080:00200000:1.0:1775772762.908366:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xdc:0x0](ffff8de1c44e0908) 00000080:00200000:1.0:1775772762.908679:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xdc:0x0](ffff8de1c44fd348) 00000080:00200000:1.0:1775772762.908694:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xdd:0x0](ffff8de1c44fb248) 00000080:00200000:1.0:1775772762.908710:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xdd:0x0](ffff8de1c44fc2c8) 00000080:00200000:1.0:1775772762.908720:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xde:0x0](ffff8de1c44fa1c8) 00000080:00200000:1.0:1775772762.909062:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xde:0x0](ffff8de1c44fba88) 00000080:00200000:1.0:1775772762.909079:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xdf:0x0](ffff8de1c44fec08) 00000080:00200000:1.0:1775772762.909089:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xdf:0x0](ffff8de1c44f9148) 00000080:00200000:1.0:1775772762.909101:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe0:0x0](ffff8de1c44faa08) 00000080:00200000:1.0:1775772762.909109:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe0:0x0](ffff8de1c44fcb08) 00000080:00200000:1.0:1775772762.909120:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe1:0x0](ffff8de1c44f21c8) 00000080:00200000:1.0:1775772762.909129:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe1:0x0](ffff8de1c44f3a88) 00000080:00200000:1.0:1775772762.909220:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe2:0x0](ffff8de1c44f1148) 00000080:00200000:1.0:1775772762.909234:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe2:0x0](ffff8de1c44f1988) 00000080:00200000:1.0:1775772762.909245:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe3:0x0](ffff8de1c44f6c08) 00000080:00200000:1.0:1775772762.909256:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe3:0x0](ffff8de1c44f2a08) 00000080:00200000:1.0:1775772762.909266:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe4:0x0](ffff8de1c449c2c8) 00000080:00200000:1.0:1775772762.909277:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe4:0x0](ffff8de1c44563c8) 00000080:00200000:1.0:1775772762.909287:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe5:0x0](ffff8de1c44edb88) 00000080:00200000:1.0:1775772762.909299:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe5:0x0](ffff8de1c44ecb08) 00000080:00200000:1.0:1775772762.909311:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe6:0x0](ffff8de1c44f5b88) 00000080:00200000:1.0:1775772762.909320:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe6:0x0](ffff8de1c44f0908) 00000080:00200000:1.0:1775772762.909330:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe7:0x0](ffff8de1c44e80c8) 00000080:00200000:1.0:1775772762.909340:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe7:0x0](ffff8de1c44e8908) 00000080:00200000:1.0:1775772762.909351:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe8:0x0](ffff8de1c45000c8) 00000080:00200000:1.0:1775772762.909362:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe8:0x0](ffff8de1c4507448) 00000080:00200000:1.0:1775772762.909372:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xe9:0x0](ffff8de1c44f4b08) 00000080:00200000:1.0:1775772762.910029:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xe9:0x0](ffff8de1c44f42c8) 00000080:00200000:1.0:1775772762.910040:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xea:0x0](ffff8de1c44ef448) 00000080:00200000:1.0:1775772762.910052:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xea:0x0](ffff8de1c450d348) 00000080:00200000:1.0:1775772762.910061:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xeb:0x0](ffff8de1c450b248) 00000080:00200000:1.0:1775772762.910071:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xeb:0x0](ffff8de1c450c2c8) 00000080:00200000:1.0:1775772762.910081:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xec:0x0](ffff8de1c44fe3c8) 00000080:00200000:1.0:1775772762.910090:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xec:0x0](ffff8de1c44f80c8) 00000080:00200000:1.0:1775772762.910099:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xed:0x0](ffff8de1c45063c8) 00000080:00200000:1.0:1775772762.910109:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xed:0x0](ffff8de1c4505348) 00000080:00200000:1.0:1775772762.910118:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xee:0x0](ffff8de1c44fdb88) 00000080:00200000:1.0:1775772762.910129:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xee:0x0](ffff8de1c44f9988) 00000080:00200000:1.0:1775772762.910139:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xef:0x0](ffff8de1c44ff448) 00000080:00200000:1.0:1775772762.911357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xef:0x0](ffff8de1c4517448) 00000080:00200000:1.0:1775772762.911368:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf0:0x0](ffff8de1c4515348) 00000080:00200000:1.0:1775772762.911396:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf0:0x0](ffff8de1c4513248) 00000080:00200000:1.0:1775772762.911408:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf1:0x0](ffff8de1c450a1c8) 00000080:00200000:1.0:1775772762.911426:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf1:0x0](ffff8de1c450ba88) 00000080:00200000:1.0:1775772762.911437:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf2:0x0](ffff8de1c45142c8) 00000080:00200000:1.0:1775772762.911447:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf2:0x0](ffff8de1c45121c8) 00000080:00200000:1.0:1775772762.911467:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf3:0x0](ffff8de1c4503248) 00000080:00200000:1.0:1775772762.911480:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf3:0x0](ffff8de1c45042c8) 00000080:00200000:1.0:1775772762.911488:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf4:0x0](ffff8de1c4511148) 00000080:00200000:1.0:1775772762.911498:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf4:0x0](ffff8de1c4511988) 00000080:00200000:1.0:1775772762.911506:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf5:0x0](ffff8de1c4509148) 00000080:00200000:1.0:1775772762.911517:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf5:0x0](ffff8de1c4509988) 00000080:00200000:1.0:1775772762.912276:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf6:0x0](ffff8de1c450aa08) 00000080:00200000:1.0:1775772762.912301:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf6:0x0](ffff8de1c450cb08) 00000080:00200000:1.0:1775772762.912313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf7:0x0](ffff8de1c44f3248) 00000080:00200000:1.0:1775772762.912327:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf7:0x0](ffff8de1c44f7448) 00000080:00200000:1.0:1775772762.912337:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf8:0x0](ffff8de1c45021c8) 00000080:00200000:1.0:1775772762.912349:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf8:0x0](ffff8de1c4503a88) 00000080:00200000:1.0:1775772762.912360:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xf9:0x0](ffff8de1c4515b88) 00000080:00200000:1.0:1775772762.912369:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xf9:0x0](ffff8de1c4510908) 00000080:00200000:1.0:1775772762.912391:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xfa:0x0](ffff8de1c4506c08) 00000080:00200000:1.0:1775772762.912406:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xfa:0x0](ffff8de1c4501148) 00000080:00200000:1.0:1775772762.912417:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xfb:0x0](ffff8de1c4514b08) 00000080:00200000:1.0:1775772762.912427:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xfb:0x0](ffff8de1c4512a08) 00000080:00200000:1.0:1775772762.912437:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xfc:0x0](ffff8de1c451b248) 00000080:00200000:1.0:1775772762.912447:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xfc:0x0](ffff8de1c451c2c8) 00000080:00200000:1.0:1775772762.912474:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xfd:0x0](ffff8de1c4508908) 00000080:00200000:1.0:1775772762.912487:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xfd:0x0](ffff8de1c45080c8) 00000080:00200000:1.0:1775772762.912510:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xfe:0x0](ffff8de1c4502a08) 00000080:00200000:1.0:1775772762.912537:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xfe:0x0](ffff8de1c4504b08) 00000080:00200000:1.0:1775772762.912549:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0xff:0x0](ffff8de1c4516c08) 00000080:00200000:1.0:1775772762.912557:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0xff:0x0](ffff8de1c4513a88) 00000080:00200000:1.0:1775772762.912577:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x100:0x0](ffff8de1c450f448) 00000080:00200000:1.0:1775772762.912586:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x100:0x0](ffff8de1c450e3c8) 00000080:00200000:1.0:1775772762.912598:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x101:0x0](ffff8de1c451a1c8) 00000080:00200000:1.0:1775772762.912610:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x101:0x0](ffff8de1c451ba88) 00000080:00200000:1.0:1775772762.912621:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x102:0x0](ffff8de1c450ec08) 00000080:00200000:1.0:1775772762.912631:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x102:0x0](ffff8de1c450db88) 00000080:00200000:1.0:1775772762.912641:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x103:0x0](ffff8de1c45163c8) 00000080:00200000:1.0:1775772762.912651:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x103:0x0](ffff8de1c45100c8) 00000080:00200000:1.0:1775772762.912672:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x104:0x0](ffff8de1c4524b08) 00000080:00200000:1.0:1775772762.912683:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x104:0x0](ffff8de1c4525b88) 00000080:00200000:1.0:1775772762.912693:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x105:0x0](ffff8de1c4522a08) 00000080:00200000:1.0:1775772762.912713:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x105:0x0](ffff8de1c4520908) 00000080:00200000:1.0:1775772762.912747:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x106:0x0](ffff8de1c45200c8) 00000080:00200000:1.0:1775772762.914130:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x106:0x0](ffff8de1c4527448) 00000080:00200000:1.0:1775772762.914252:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x107:0x0](ffff8de1c44f8908) 00000080:00200000:1.0:1775772762.914265:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x107:0x0](ffff8de1c4529148) 00000080:00200000:1.0:1775772762.914276:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x108:0x0](ffff8de1c4523248) 00000080:00200000:1.0:1775772762.914286:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x108:0x0](ffff8de1c45242c8) 00000080:00200000:1.0:1775772762.914297:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x109:0x0](ffff8de1c4529988) 00000080:00200000:1.0:1775772762.914307:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x109:0x0](ffff8de1c452aa08) 00000080:00200000:1.0:1775772762.914317:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10a:0x0](ffff8de1c4501988) 00000080:00200000:1.0:1775772762.914328:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10a:0x0](ffff8de1c4505b88) 00000080:00200000:1.0:1775772762.914339:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10b:0x0](ffff8de1c4500908) 00000080:00200000:1.0:1775772762.914350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10b:0x0](ffff8de1c4531148) 00000080:00200000:1.0:1775772762.914361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10c:0x0](ffff8de1c4523a88) 00000080:00200000:1.0:1775772762.914371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10c:0x0](ffff8de1c4526c08) 00000080:00200000:1.0:1775772762.915082:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10d:0x0](ffff8de1c451ec08) 00000080:00200000:1.0:1775772762.915114:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10d:0x0](ffff8de1c4519148) 00000080:00200000:1.0:1775772762.915125:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10e:0x0](ffff8de1c452cb08) 00000080:00200000:1.0:1775772762.915137:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10e:0x0](ffff8de1c452db88) 00000080:00200000:1.0:1775772762.915227:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x10f:0x0](ffff8de1c4532a08) 00000080:00200000:1.0:1775772762.915238:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x10f:0x0](ffff8de1c4534b08) 00000080:00200000:1.0:1775772762.915249:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x110:0x0](ffff8de1c45280c8) 00000080:00200000:1.0:1775772762.915260:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x110:0x0](ffff8de1c452f448) 00000080:00200000:1.0:1775772762.915273:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x111:0x0](ffff8de1c452d348) 00000080:00200000:1.0:1775772762.915282:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x111:0x0](ffff8de1c452b248) 00000080:00200000:1.0:1775772762.915292:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x112:0x0](ffff8de1c45221c8) 00000080:00200000:1.0:1775772762.915304:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x112:0x0](ffff8de1c4521148) 00000080:00200000:1.0:1775772762.915314:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x113:0x0](ffff8de1c4521988) 00000080:00200000:1.0:1775772762.915324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x113:0x0](ffff8de1c4525348) 00000080:00200000:1.0:1775772762.915335:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x114:0x0](ffff8de1c452ba88) 00000080:00200000:1.0:1775772762.915344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x114:0x0](ffff8de1c452ec08) 00000080:00200000:1.0:1775772762.915355:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x115:0x0](ffff8de1c453f448) 00000080:00200000:1.0:1775772762.915366:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x115:0x0](ffff8de1c453e3c8) 00000080:00200000:1.0:1775772762.915386:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x116:0x0](ffff8de1c453d348) 00000080:00200000:1.0:1775772762.915409:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x116:0x0](ffff8de1c453b248) 00000080:00200000:1.0:1775772762.915420:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x117:0x0](ffff8de1c452a1c8) 00000080:00200000:1.0:1775772762.915429:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x117:0x0](ffff8de1c452c2c8) 00000080:00200000:1.0:1775772762.915440:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x118:0x0](ffff8de1c452e3c8) 00000080:00200000:1.0:1775772762.915449:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x118:0x0](ffff8de1c4528908) 00000080:00200000:1.0:1775772762.915469:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x119:0x0](ffff8de1c4547448) 00000080:00200000:1.0:1775772762.915481:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x119:0x0](ffff8de1c45463c8) 00000080:00200000:1.0:1775772762.915493:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11a:0x0](ffff8de1c453ba88) 00000080:00200000:1.0:1775772762.915503:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11a:0x0](ffff8de1c453ec08) 00000080:00200000:1.0:1775772762.915513:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11b:0x0](ffff8de1c451cb08) 00000080:00200000:1.0:1775772762.915531:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11b:0x0](ffff8de1c451db88) 00000080:00200000:1.0:1775772762.915543:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11c:0x0](ffff8de1c4539148) 00000080:00200000:1.0:1775772762.915554:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11c:0x0](ffff8de1c4539988) 00000080:00200000:1.0:1775772762.915576:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11d:0x0](ffff8de1c4543248) 00000080:00200000:1.0:1775772762.915587:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11d:0x0](ffff8de1c45442c8) 00000080:00200000:1.0:1775772762.915600:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11e:0x0](ffff8de1c45421c8) 00000080:00200000:1.0:1775772762.915610:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11e:0x0](ffff8de1c4543a88) 00000080:00200000:1.0:1775772762.915620:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x11f:0x0](ffff8de1c453aa08) 00000080:00200000:1.0:1775772762.915629:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x11f:0x0](ffff8de1c453cb08) 00000080:00200000:1.0:1775772762.915639:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x120:0x0](ffff8de1c453a1c8) 00000080:00200000:1.0:1775772762.915648:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x120:0x0](ffff8de1c453db88) 00000080:00200000:1.0:1775772762.915659:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x121:0x0](ffff8de1c4541148) 00000080:00200000:1.0:1775772762.915686:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x121:0x0](ffff8de1c4541988) 00000080:00200000:1.0:1775772762.915697:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x122:0x0](ffff8de1c4538908) 00000080:00200000:1.0:1775772762.915716:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x122:0x0](ffff8de1c453c2c8) 00000080:00200000:1.0:1775772762.917239:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x123:0x0](ffff8de1c45380c8) 00000080:00200000:1.0:1775772762.917268:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x123:0x0](ffff8de1c45263c8) 00000080:00200000:1.0:1775772762.917281:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x124:0x0](ffff8de1c4531988) 00000080:00200000:1.0:1775772762.917292:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x124:0x0](ffff8de1c4535b88) 00000080:00200000:1.0:1775772762.917303:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x125:0x0](ffff8de1c45480c8) 00000080:00200000:1.0:1775772762.917314:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x125:0x0](ffff8de1c454f448) 00000080:00200000:1.0:1775772762.917328:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x126:0x0](ffff8de1c4544b08) 00000080:00200000:1.0:1775772762.917341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x126:0x0](ffff8de1c4545b88) 00000080:00200000:1.0:1775772762.917354:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x127:0x0](ffff8de1c4537448) 00000080:00200000:1.0:1775772762.917365:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x127:0x0](ffff8de1c45363c8) 00000080:00200000:1.0:1775772762.917519:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x128:0x0](ffff8de1c454d348) 00000080:00200000:1.0:1775772762.917544:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x128:0x0](ffff8de1c454b248) 00000080:00200000:1.0:1775772762.917556:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x129:0x0](ffff8de1c4535348) 00000080:00200000:1.0:1775772762.917578:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x129:0x0](ffff8de1c4533248) 00000080:00200000:1.0:1775772762.917588:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12a:0x0](ffff8de1c454a1c8) 00000080:00200000:1.0:1775772762.917599:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12a:0x0](ffff8de1c454ba88) 00000080:00200000:1.0:1775772762.917609:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12b:0x0](ffff8de1c45400c8) 00000080:00200000:1.0:1775772762.917618:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12b:0x0](ffff8de1c4540908) 00000080:00200000:1.0:1775772762.917627:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12c:0x0](ffff8de1c4549148) 00000080:00200000:1.0:1775772762.917642:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12c:0x0](ffff8de1c4549988) 00000080:00200000:1.0:1775772762.917652:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12d:0x0](ffff8de1c454aa08) 00000080:00200000:1.0:1775772762.918344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12d:0x0](ffff8de1c454cb08) 00000080:00200000:1.0:1775772762.918392:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12e:0x0](ffff8de1c45342c8) 00000080:00200000:1.0:1775772762.918405:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12e:0x0](ffff8de1c45321c8) 00000080:00200000:1.0:1775772762.918417:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x12f:0x0](ffff8de1c454db88) 00000080:00200000:1.0:1775772762.918427:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x12f:0x0](ffff8de1c454ec08) 00000080:00200000:1.0:1775772762.918438:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x130:0x0](ffff8de1c4546c08) 00000080:00200000:1.0:1775772762.918459:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x130:0x0](ffff8de1c4545348) 00000080:00200000:1.0:1775772762.918471:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x131:0x0](ffff8de1c4542a08) 00000080:00200000:1.0:1775772762.918481:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x131:0x0](ffff8de1c4550908) 00000080:00200000:1.0:1775772762.918492:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x132:0x0](ffff8de1c454c2c8) 00000080:00200000:1.0:1775772762.918502:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x132:0x0](ffff8de1c454e3c8) 00000080:00200000:1.0:1775772762.918515:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x133:0x0](ffff8de1c4559148) 00000080:00200000:1.0:1775772762.918534:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x133:0x0](ffff8de1c4559988) 00000080:00200000:1.0:1775772762.918543:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x134:0x0](ffff8de1c455aa08) 00000080:00200000:1.0:1775772762.918553:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x134:0x0](ffff8de1c455cb08) 00000080:00200000:1.0:1775772762.918574:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x135:0x0](ffff8de1c4558908) 00000080:00200000:1.0:1775772762.918587:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x135:0x0](ffff8de1c45580c8) 00000080:00200000:1.0:1775772762.918596:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x136:0x0](ffff8de1c45500c8) 00000080:00200000:1.0:1775772762.918606:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x136:0x0](ffff8de1c4557448) 00000080:00200000:1.0:1775772762.918617:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x137:0x0](ffff8de1c455e3c8) 00000080:00200000:1.0:1775772762.918627:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x137:0x0](ffff8de1c455d348) 00000080:00200000:1.0:1775772762.918636:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x138:0x0](ffff8de1c45563c8) 00000080:00200000:1.0:1775772762.918645:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x138:0x0](ffff8de1c4555348) 00000080:00200000:1.0:1775772762.918654:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x139:0x0](ffff8de1c455b248) 00000080:00200000:1.0:1775772762.919401:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x139:0x0](ffff8de1c455c2c8) 00000080:00200000:1.0:1775772762.919426:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13a:0x0](ffff8de1c455ba88) 00000080:00200000:1.0:1775772762.919437:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13a:0x0](ffff8de1c455ec08) 00000080:00200000:1.0:1775772762.919449:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13b:0x0](ffff8de1c4553248) 00000080:00200000:1.0:1775772762.919470:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13b:0x0](ffff8de1c45542c8) 00000080:00200000:1.0:1775772762.919480:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13c:0x0](ffff8de1c4533a88) 00000080:00200000:1.0:1775772762.919490:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13c:0x0](ffff8de1c45300c8) 00000080:00200000:1.0:1775772762.919499:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13d:0x0](ffff8de1c455f448) 00000080:00200000:1.0:1775772762.919510:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13d:0x0](ffff8de1c455db88) 00000080:00200000:1.0:1775772762.919518:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13e:0x0](ffff8de1c4530908) 00000080:00200000:1.0:1775772762.920068:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13e:0x0](ffff8de1c4536c08) 00000080:00200000:1.0:1775772762.920080:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x13f:0x0](ffff8de1c45521c8) 00000080:00200000:1.0:1775772762.920093:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x13f:0x0](ffff8de1c4553a88) 00000080:00200000:1.0:1775772762.920103:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x140:0x0](ffff8de1c4560908) 00000080:00200000:1.0:1775772762.920114:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x140:0x0](ffff8de1c45600c8) 00000080:00200000:1.0:1775772762.920123:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x141:0x0](ffff8de1c4548908) 00000080:00200000:1.0:1775772762.920134:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x141:0x0](ffff8de1c456a1c8) 00000080:00200000:1.0:1775772762.920217:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x142:0x0](ffff8de1c4565348) 00000080:00200000:1.0:1775772762.920228:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x142:0x0](ffff8de1c4563248) 00000080:00200000:1.0:1775772762.920240:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x143:0x0](ffff8de1c456ba88) 00000080:00200000:1.0:1775772762.920250:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x143:0x0](ffff8de1c456ec08) 00000080:00200000:1.0:1775772762.920261:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x144:0x0](ffff8de1c4569148) 00000080:00200000:1.0:1775772762.920271:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x144:0x0](ffff8de1c4569988) 00000080:00200000:1.0:1775772762.920282:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x145:0x0](ffff8de1c45621c8) 00000080:00200000:1.0:1775772762.920292:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x145:0x0](ffff8de1c4563a88) 00000080:00200000:1.0:1775772762.920302:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x146:0x0](ffff8de1c4556c08) 00000080:00200000:1.0:1775772762.920315:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x146:0x0](ffff8de1c4551148) 00000080:00200000:1.0:1775772762.920326:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x147:0x0](ffff8de1c456aa08) 00000080:00200000:1.0:1775772762.920341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x147:0x0](ffff8de1c456cb08) 00000080:00200000:1.0:1775772762.920353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x148:0x0](ffff8de1c4561148) 00000080:00200000:1.0:1775772762.920362:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x148:0x0](ffff8de1c4561988) 00000080:00200000:1.0:1775772762.920371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x149:0x0](ffff8de1c4551988) 00000080:00200000:1.0:1775772762.920398:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x149:0x0](ffff8de1c4552a08) 00000080:00200000:1.0:1775772762.920409:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14a:0x0](ffff8de1c451d348) 00000080:00200000:1.0:1775772762.920421:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14a:0x0](ffff8de1c451f448) 00000080:00200000:1.0:1775772762.920433:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14b:0x0](ffff8de1c4565b88) 00000080:00200000:1.0:1775772762.920442:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14b:0x0](ffff8de1c4562a08) 00000080:00200000:1.0:1775772762.921031:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14c:0x0](ffff8de1c4568908) 00000080:00200000:1.0:1775772762.921048:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14c:0x0](ffff8de1c45680c8) 00000080:00200000:1.0:1775772762.921058:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14d:0x0](ffff8de1c4566c08) 00000080:00200000:1.0:1775772762.921070:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14d:0x0](ffff8de1c45642c8) 00000080:00200000:1.0:1775772762.921081:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14e:0x0](ffff8de1c4567448) 00000080:00200000:1.0:1775772762.921090:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14e:0x0](ffff8de1c4564b08) 00000080:00200000:1.0:1775772762.921100:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x14f:0x0](ffff8de1c4554b08) 00000080:00200000:1.0:1775772762.921111:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x14f:0x0](ffff8de1c4555b88) 00000080:00200000:1.0:1775772762.921122:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x150:0x0](ffff8de1c455a1c8) 00000080:00200000:1.0:1775772762.921131:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x150:0x0](ffff8de1c4573a88) 00000080:00200000:1.0:1775772762.921152:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x151:0x0](ffff8de1c4571148) 00000080:00200000:1.0:1775772762.921163:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x151:0x0](ffff8de1c4571988) 00000080:00200000:1.0:1775772762.921172:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x152:0x0](ffff8de1c4574b08) 00000080:00200000:1.0:1775772762.921182:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x152:0x0](ffff8de1c4575b88) 00000080:00200000:1.0:1775772762.921194:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x153:0x0](ffff8de1c4570908) 00000080:00200000:1.0:1775772762.921204:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x153:0x0](ffff8de1c45700c8) 00000080:00200000:1.0:1775772762.921214:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x154:0x0](ffff8de1c457db88) 00000080:00200000:1.0:1775772762.921225:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x154:0x0](ffff8de1c4578908) 00000080:00200000:1.0:1775772762.921235:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x155:0x0](ffff8de1c4572a08) 00000080:00200000:1.0:1775772762.921245:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x155:0x0](ffff8de1c4577448) 00000080:00200000:1.0:1775772762.921254:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x156:0x0](ffff8de1c45763c8) 00000080:00200000:1.0:1775772762.921265:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x156:0x0](ffff8de1c4575348) 00000080:00200000:1.0:1775772762.921274:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x157:0x0](ffff8de1c4573248) 00000080:00200000:1.0:1775772762.921284:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x157:0x0](ffff8de1c45742c8) 00000080:00200000:1.0:1775772762.921294:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x158:0x0](ffff8de1c4576c08) 00000080:00200000:1.0:1775772762.921303:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x158:0x0](ffff8de1c45663c8) 00000080:00200000:1.0:1775772762.921312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x159:0x0](ffff8de1c451aa08) 00000080:00200000:1.0:1775772762.921324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x159:0x0](ffff8de1c4519988) 00000080:00200000:1.0:1775772762.921334:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15a:0x0](ffff8de1c45721c8) 00000080:00200000:1.0:1775772762.921344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15a:0x0](ffff8de1c4586c08) 00000080:00200000:1.0:1775772762.921353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15b:0x0](ffff8de1c457e3c8) 00000080:00200000:1.0:1775772762.921367:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15b:0x0](ffff8de1c457d348) 00000080:00200000:1.0:1775772762.921394:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15c:0x0](ffff8de1c457f448) 00000080:00200000:1.0:1775772762.921405:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15c:0x0](ffff8de1c457b248) 00000080:00200000:1.0:1775772762.921415:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15d:0x0](ffff8de1c4582a08) 00000080:00200000:1.0:1775772762.921425:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15d:0x0](ffff8de1c4584b08) 00000080:00200000:1.0:1775772762.921437:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15e:0x0](ffff8de1c4585b88) 00000080:00200000:1.0:1775772762.921446:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15e:0x0](ffff8de1c4580908) 00000080:00200000:1.0:1775772762.921465:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x15f:0x0](ffff8de1c4518908) 00000080:00200000:1.0:1775772762.921475:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x15f:0x0](ffff8de1c45180c8) 00000080:00200000:1.0:1775772762.921483:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x160:0x0](ffff8de1c4587448) 00000080:00200000:1.0:1775772762.921492:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x160:0x0](ffff8de1c45863c8) 00000080:00200000:1.0:1775772762.921502:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x161:0x0](ffff8de1c457a1c8) 00000080:00200000:1.0:1775772762.921511:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x161:0x0](ffff8de1c457ba88) 00000080:00200000:1.0:1775772762.921521:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x162:0x0](ffff8de1c451e3c8) 00000080:00200000:1.0:1775772762.921532:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x162:0x0](ffff8de1c458db88) 00000080:00200000:1.0:1775772762.921543:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x163:0x0](ffff8de1c457ec08) 00000080:00200000:1.0:1775772762.921553:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x163:0x0](ffff8de1c4579148) 00000080:00200000:1.0:1775772762.921574:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x164:0x0](ffff8de1c45821c8) 00000080:00200000:1.0:1775772762.921585:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x164:0x0](ffff8de1c4583a88) 00000080:00200000:1.0:1775772762.921602:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x165:0x0](ffff8de1c45842c8) 00000080:00200000:1.0:1775772762.921612:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x165:0x0](ffff8de1c4583248) 00000080:00200000:1.0:1775772762.921622:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x166:0x0](ffff8de1c4579988) 00000080:00200000:1.0:1775772762.921632:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x166:0x0](ffff8de1c457aa08) 00000080:00200000:1.0:1775772762.921641:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x167:0x0](ffff8de1c4581988) 00000080:00200000:1.0:1775772762.921651:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x167:0x0](ffff8de1c4581148) 00000080:00200000:1.0:1775772762.921660:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x168:0x0](ffff8de1c4588908) 00000080:00200000:1.0:1775772762.921678:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x168:0x0](ffff8de1c45880c8) 00000080:00200000:1.0:1775772762.921688:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x169:0x0](ffff8de1c4585348) 00000080:00200000:1.0:1775772762.921697:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x169:0x0](ffff8de1c4592a08) 00000080:00200000:1.0:1775772762.921706:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16a:0x0](ffff8de1c458e3c8) 00000080:00200000:1.0:1775772762.921768:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16a:0x0](ffff8de1c458d348) 00000080:00200000:1.0:1775772762.921781:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16b:0x0](ffff8de1c457cb08) 00000080:00200000:1.0:1775772762.921791:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16b:0x0](ffff8de1c457c2c8) 00000080:00200000:1.0:1775772762.921800:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16c:0x0](ffff8de1c45780c8) 00000080:00200000:1.0:1775772762.921810:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16c:0x0](ffff8de1c459ba88) 00000080:00200000:1.0:1775772762.921819:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16d:0x0](ffff8de1c456c2c8) 00000080:00200000:1.0:1775772762.921831:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16d:0x0](ffff8de1c456b248) 00000080:00200000:1.0:1775772762.921841:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16e:0x0](ffff8de1c459ec08) 00000080:00200000:1.0:1775772762.921850:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16e:0x0](ffff8de1c4599148) 00000080:00200000:1.0:1775772762.921860:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x16f:0x0](ffff8de1c458b248) 00000080:00200000:1.0:1775772762.921870:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x16f:0x0](ffff8de1c458c2c8) 00000080:00200000:1.0:1775772762.921880:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x170:0x0](ffff8de1c4599988) 00000080:00200000:1.0:1775772762.921887:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x170:0x0](ffff8de1c459aa08) 00000080:00200000:1.0:1775772762.923282:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x171:0x0](ffff8de1c456e3c8) 00000080:00200000:1.0:1775772762.923329:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x171:0x0](ffff8de1c456f448) 00000080:00200000:1.0:1775772762.923340:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x172:0x0](ffff8de1c459cb08) 00000080:00200000:1.0:1775772762.923353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x172:0x0](ffff8de1c459db88) 00000080:00200000:1.0:1775772762.923363:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x173:0x0](ffff8de1c458a1c8) 00000080:00200000:1.0:1775772762.924033:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x173:0x0](ffff8de1c458ba88) 00000080:00200000:1.0:1775772762.924062:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x174:0x0](ffff8de1c4598908) 00000080:00200000:1.0:1775772762.924074:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x174:0x0](ffff8de1c45980c8) 00000080:00200000:1.0:1775772762.924084:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x175:0x0](ffff8de1c4593a88) 00000080:00200000:1.0:1775772762.924095:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x175:0x0](ffff8de1c4596c08) 00000080:00200000:1.0:1775772762.924105:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x176:0x0](ffff8de1c45921c8) 00000080:00200000:1.0:1775772762.924115:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x176:0x0](ffff8de1c4591148) 00000080:00200000:1.0:1775772762.924126:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x177:0x0](ffff8de1c45942c8) 00000080:00200000:1.0:1775772762.924138:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x177:0x0](ffff8de1c4593248) 00000080:00200000:1.0:1775772762.924237:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x178:0x0](ffff8de1c458ec08) 00000080:00200000:1.0:1775772762.924248:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x178:0x0](ffff8de1c4589148) 00000080:00200000:1.0:1775772762.924259:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x179:0x0](ffff8de1c4589988) 00000080:00200000:1.0:1775772762.924273:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x179:0x0](ffff8de1c458aa08) 00000080:00200000:1.0:1775772762.924282:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17a:0x0](ffff8de1c458cb08) 00000080:00200000:1.0:1775772762.924294:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17a:0x0](ffff8de1c458f448) 00000080:00200000:1.0:1775772762.924304:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17b:0x0](ffff8de1c459e3c8) 00000080:00200000:1.0:1775772762.924315:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17b:0x0](ffff8de1c459d348) 00000080:00200000:1.0:1775772762.924324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17c:0x0](ffff8de1c459b248) 00000080:00200000:1.0:1775772762.924335:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17c:0x0](ffff8de1c459c2c8) 00000080:00200000:1.0:1775772762.924344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17d:0x0](ffff8de1c4595b88) 00000080:00200000:1.0:1775772762.924353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17d:0x0](ffff8de1c4594b08) 00000080:00200000:1.0:1775772762.924363:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17e:0x0](ffff8de1c4590908) 00000080:00200000:1.0:1775772762.924373:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17e:0x0](ffff8de1c45900c8) 00000080:00200000:1.0:1775772762.924477:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x17f:0x0](ffff8de1c456d348) 00000080:00200000:1.0:1775772762.924490:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x17f:0x0](ffff8de1c45a3248) 00000080:00200000:1.0:1775772762.924501:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x180:0x0](ffff8de1c45a42c8) 00000080:00200000:1.0:1775772762.924511:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x180:0x0](ffff8de1c45a21c8) 00000080:00200000:1.0:1775772762.925045:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x181:0x0](ffff8de1c4595348) 00000080:00200000:1.0:1775772762.925066:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x181:0x0](ffff8de1c4591988) 00000080:00200000:1.0:1775772762.925076:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x182:0x0](ffff8de1c45963c8) 00000080:00200000:1.0:1775772762.925085:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x182:0x0](ffff8de1c4597448) 00000080:00200000:1.0:1775772762.925097:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x183:0x0](ffff8de1c45a6c08) 00000080:00200000:1.0:1775772762.925108:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x183:0x0](ffff8de1c45a1148) 00000080:00200000:1.0:1775772762.925119:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x184:0x0](ffff8de1c459a1c8) 00000080:00200000:1.0:1775772762.925130:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x184:0x0](ffff8de1c459f448) 00000080:00200000:1.0:1775772762.925268:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x185:0x0](ffff8de1c456db88) 00000080:00200000:1.0:1775772762.925287:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x185:0x0](ffff8de1c45b1148) 00000080:00200000:1.0:1775772762.925299:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x186:0x0](ffff8de1c45af448) 00000080:00200000:1.0:1775772762.925310:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x186:0x0](ffff8de1c45ae3c8) 00000080:00200000:1.0:1775772762.925319:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x187:0x0](ffff8de1c45a80c8) 00000080:00200000:1.0:1775772762.925329:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x187:0x0](ffff8de1c45ad348) 00000080:00200000:1.0:1775772762.925341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x188:0x0](ffff8de1c45ac2c8) 00000080:00200000:1.0:1775772762.925350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x188:0x0](ffff8de1c45aa1c8) 00000080:00200000:1.0:1775772762.925360:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x189:0x0](ffff8de1c45b1988) 00000080:00200000:1.0:1775772762.925369:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x189:0x0](ffff8de1c45b2a08) 00000080:00200000:1.0:1775772762.925394:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18a:0x0](ffff8de1c45800c8) 00000080:00200000:1.0:1775772762.925405:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18a:0x0](ffff8de1c45bec08) 00000080:00200000:1.0:1775772762.925415:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18b:0x0](ffff8de1c45aec08) 00000080:00200000:1.0:1775772762.925424:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18b:0x0](ffff8de1c45a9148) 00000080:00200000:1.0:1775772762.925434:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18c:0x0](ffff8de1c45b9988) 00000080:00200000:1.0:1775772762.925443:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18c:0x0](ffff8de1c45baa08) 00000080:00200000:1.0:1775772762.926074:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18d:0x0](ffff8de1c45bcb08) 00000080:00200000:1.0:1775772762.926091:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18d:0x0](ffff8de1c45bdb88) 00000080:00200000:1.0:1775772762.926101:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18e:0x0](ffff8de1c45a9988) 00000080:00200000:1.0:1775772762.926112:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18e:0x0](ffff8de1c45aaa08) 00000080:00200000:1.0:1775772762.926123:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x18f:0x0](ffff8de1c45b0908) 00000080:00200000:1.0:1775772762.926134:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x18f:0x0](ffff8de1c45b00c8) 00000080:00200000:1.0:1775772762.926218:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x190:0x0](ffff8de1c45b5b88) 00000080:00200000:1.0:1775772762.926231:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x190:0x0](ffff8de1c45b7448) 00000080:00200000:1.0:1775772762.926242:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x191:0x0](ffff8de1c45acb08) 00000080:00200000:1.0:1775772762.926252:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x191:0x0](ffff8de1c45aba88) 00000080:00200000:1.0:1775772762.926263:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x192:0x0](ffff8de1c45ab248) 00000080:00200000:1.0:1775772762.926275:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x192:0x0](ffff8de1c45a8908) 00000080:00200000:1.0:1775772762.926288:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x193:0x0](ffff8de1c45b63c8) 00000080:00200000:1.0:1775772762.926298:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x193:0x0](ffff8de1c45b5348) 00000080:00200000:1.0:1775772762.926309:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x194:0x0](ffff8de1c45adb88) 00000080:00200000:1.0:1775772762.926319:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x194:0x0](ffff8de1c45c4b08) 00000080:00200000:1.0:1775772762.926329:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x195:0x0](ffff8de1c45c5b88) 00000080:00200000:1.0:1775772762.926338:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x195:0x0](ffff8de1c45c0908) 00000080:00200000:1.0:1775772762.926349:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x196:0x0](ffff8de1c45a5b88) 00000080:00200000:1.0:1775772762.926361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x196:0x0](ffff8de1c45a0908) 00000080:00200000:1.0:1775772762.926371:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x197:0x0](ffff8de1c45b80c8) 00000080:00200000:1.0:1775772762.926396:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x197:0x0](ffff8de1c45bf448) 00000080:00200000:1.0:1775772762.926406:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x198:0x0](ffff8de1c45a00c8) 00000080:00200000:1.0:1775772762.926414:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x198:0x0](ffff8de1c45a7448) 00000080:00200000:1.0:1775772762.926423:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x199:0x0](ffff8de1c45c7448) 00000080:00200000:1.0:1775772762.926432:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x199:0x0](ffff8de1c45c63c8) 00000080:00200000:1.0:1775772762.926446:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19a:0x0](ffff8de1c45b21c8) 00000080:00200000:1.0:1775772762.927093:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19a:0x0](ffff8de1c45b3a88) 00000080:00200000:1.0:1775772762.927111:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19b:0x0](ffff8de1c45be3c8) 00000080:00200000:1.0:1775772762.927119:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19b:0x0](ffff8de1c45bd348) 00000080:00200000:1.0:1775772762.927129:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19c:0x0](ffff8de1c45c5348) 00000080:00200000:1.0:1775772762.927628:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19c:0x0](ffff8de1c45c3248) 00000080:00200000:1.0:1775772762.927649:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19d:0x0](ffff8de1c45a4b08) 00000080:00200000:1.0:1775772762.927673:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19d:0x0](ffff8de1c45a2a08) 00000080:00200000:1.0:1775772762.927684:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19e:0x0](ffff8de1c45a63c8) 00000080:00200000:1.0:1775772762.927693:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19e:0x0](ffff8de1c45a1988) 00000080:00200000:1.0:1775772762.927711:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x19f:0x0](ffff8de1c45b6c08) 00000080:00200000:1.0:1775772762.928106:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x19f:0x0](ffff8de1c45b42c8) 00000080:00200000:1.0:1775772762.928128:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a0:0x0](ffff8de1c45b4b08) 00000080:00200000:1.0:1775772762.928138:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a0:0x0](ffff8de1c45cba88) 00000080:00200000:1.0:1775772762.928230:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a1:0x0](ffff8de1c45c21c8) 00000080:00200000:1.0:1775772762.928243:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a1:0x0](ffff8de1c45c3a88) 00000080:00200000:1.0:1775772762.928254:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a2:0x0](ffff8de1c45c6c08) 00000080:00200000:1.0:1775772762.928265:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a2:0x0](ffff8de1c45c1148) 00000080:00200000:1.0:1775772762.928277:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a3:0x0](ffff8de1c45c1988) 00000080:00200000:1.0:1775772762.928287:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a3:0x0](ffff8de1c45c2a08) 00000080:00200000:1.0:1775772762.928296:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a4:0x0](ffff8de1c45c9148) 00000080:00200000:1.0:1775772762.928312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a4:0x0](ffff8de1c45c9988) 00000080:00200000:1.0:1775772762.928323:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a5:0x0](ffff8de1c45caa08) 00000080:00200000:1.0:1775772762.928332:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a5:0x0](ffff8de1c45ccb08) 00000080:00200000:1.0:1775772762.928343:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a6:0x0](ffff8de1c45cdb88) 00000080:00200000:1.0:1775772762.928354:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a6:0x0](ffff8de1c45c8908) 00000080:00200000:1.0:1775772762.928366:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a7:0x0](ffff8de1c45c80c8) 00000080:00200000:1.0:1775772762.928384:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a7:0x0](ffff8de1c45cf448) 00000080:00200000:1.0:1775772762.928400:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a8:0x0](ffff8de1c45c42c8) 00000080:00200000:1.0:1775772762.928408:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a8:0x0](ffff8de1c45c00c8) 00000080:00200000:1.0:1775772762.928417:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1a9:0x0](ffff8de1c45ce3c8) 00000080:00200000:1.0:1775772762.928425:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1a9:0x0](ffff8de1c45cd348) 00000080:00200000:1.0:1775772762.928437:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1aa:0x0](ffff8de1c45cb248) 00000080:00200000:1.0:1775772762.928446:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1aa:0x0](ffff8de1c45cc2c8) 00000080:00200000:1.0:1775772762.928463:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ab:0x0](ffff8de1c45d7448) 00000080:00200000:1.0:1775772762.928472:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ab:0x0](ffff8de1c45d63c8) 00000080:00200000:1.0:1775772762.928482:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ac:0x0](ffff8de1c45d00c8) 00000080:00200000:1.0:1775772762.928490:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ac:0x0](ffff8de1c45d5348) 00000080:00200000:1.0:1775772762.928500:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ad:0x0](ffff8de1c45bba88) 00000080:00200000:1.0:1775772762.928510:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ad:0x0](ffff8de1c45ba1c8) 00000080:00200000:1.0:1775772762.928518:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ae:0x0](ffff8de1c45ca1c8) 00000080:00200000:1.0:1775772762.928533:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ae:0x0](ffff8de1c45cec08) 00000080:00200000:1.0:1775772762.928542:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1af:0x0](ffff8de1c45d3248) 00000080:00200000:1.0:1775772762.928550:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1af:0x0](ffff8de1c45d42c8) 00000080:00200000:1.0:1775772762.928568:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b0:0x0](ffff8de1c45d3a88) 00000080:00200000:1.0:1775772762.928576:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b0:0x0](ffff8de1c45d6c08) 00000080:00200000:1.0:1775772762.928586:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b1:0x0](ffff8de1c45d21c8) 00000080:00200000:1.0:1775772762.928596:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b1:0x0](ffff8de1c45d1148) 00000080:00200000:1.0:1775772762.928605:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b2:0x0](ffff8de1c45d1988) 00000080:00200000:1.0:1775772762.928615:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b2:0x0](ffff8de1c45d2a08) 00000080:00200000:1.0:1775772762.928626:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b3:0x0](ffff8de1c45b9148) 00000080:00200000:1.0:1775772762.928636:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b3:0x0](ffff8de1c45bb248) 00000080:00200000:1.0:1775772762.928648:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b4:0x0](ffff8de1c45b3248) 00000080:00200000:1.0:1775772762.928658:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b4:0x0](ffff8de1c45ddb88) 00000080:00200000:1.0:1775772762.928678:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b5:0x0](ffff8de1c45d4b08) 00000080:00200000:1.0:1775772762.928689:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b5:0x0](ffff8de1c45d5b88) 00000080:00200000:1.0:1775772762.928698:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b6:0x0](ffff8de1c45a3a88) 00000080:00200000:1.0:1775772762.928752:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b6:0x0](ffff8de1c45e4b08) 00000080:00200000:1.0:1775772762.928773:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b7:0x0](ffff8de1c45a5348) 00000080:00200000:1.0:1775772762.928784:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b7:0x0](ffff8de1c45eec08) 00000080:00200000:1.0:1775772762.928795:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b8:0x0](ffff8de1c45e9988) 00000080:00200000:1.0:1775772762.928804:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b8:0x0](ffff8de1c45eaa08) 00000080:00200000:1.0:1775772762.928814:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1b9:0x0](ffff8de1c45d80c8) 00000080:00200000:1.0:1775772762.928823:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1b9:0x0](ffff8de1c45df448) 00000080:00200000:1.0:1775772762.928832:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ba:0x0](ffff8de1c45de3c8) 00000080:00200000:1.0:1775772762.928840:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ba:0x0](ffff8de1c45dd348) 00000080:00200000:1.0:1775772762.928848:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1bb:0x0](ffff8de1c45e8908) 00000080:00200000:1.0:1775772762.928857:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1bb:0x0](ffff8de1c45e80c8) 00000080:00200000:1.0:1775772762.928866:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1bc:0x0](ffff8de1c45db248) 00000080:00200000:1.0:1775772762.928875:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1bc:0x0](ffff8de1c45dc2c8) 00000080:00200000:1.0:1775772762.928884:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1bd:0x0](ffff8de1c45edb88) 00000080:00200000:1.0:1775772762.928892:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1bd:0x0](ffff8de1c45ef448) 00000080:00200000:1.0:1775772762.928912:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1be:0x0](ffff8de1c45bc2c8) 00000080:00200000:1.0:1775772762.928922:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1be:0x0](ffff8de1c45b8908) 00000080:00200000:1.0:1775772762.928932:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1bf:0x0](ffff8de1c45f6c08) 00000080:00200000:1.0:1775772762.928943:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1bf:0x0](ffff8de1c45f1148) 00000080:00200000:1.0:1775772762.928953:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c0:0x0](ffff8de1c45eb248) 00000080:00200000:1.0:1775772762.928962:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c0:0x0](ffff8de1c45ec2c8) 00000080:00200000:1.0:1775772762.928972:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c1:0x0](ffff8de1c45ed348) 00000080:00200000:1.0:1775772762.928981:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c1:0x0](ffff8de1c45ea1c8) 00000080:00200000:1.0:1775772762.928990:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c2:0x0](ffff8de1c45e00c8) 00000080:00200000:1.0:1775772762.928999:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c2:0x0](ffff8de1c45e7448) 00000080:00200000:1.0:1775772762.929008:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c3:0x0](ffff8de1c45ee3c8) 00000080:00200000:1.0:1775772762.929016:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c3:0x0](ffff8de1c45ecb08) 00000080:00200000:1.0:1775772762.929024:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c4:0x0](ffff8de1c45dba88) 00000080:00200000:1.0:1775772762.929032:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c4:0x0](ffff8de1c45dec08) 00000080:00200000:1.0:1775772762.929040:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c5:0x0](ffff8de1c45eba88) 00000080:00200000:1.0:1775772762.929049:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c5:0x0](ffff8de1c45d0908) 00000080:00200000:1.0:1775772762.929057:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c6:0x0](ffff8de1c45fdb88) 00000080:00200000:1.0:1775772762.929066:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c6:0x0](ffff8de1c45f8908) 00000080:00200000:1.0:1775772762.929077:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c7:0x0](ffff8de1c45f1988) 00000080:00200000:1.0:1775772762.929086:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c7:0x0](ffff8de1c45f2a08) 00000080:00200000:1.0:1775772762.929094:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c8:0x0](ffff8de1c45f80c8) 00000080:00200000:1.0:1775772762.929103:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c8:0x0](ffff8de1c45ff448) 00000080:00200000:1.0:1775772762.929112:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1c9:0x0](ffff8de1c45d9988) 00000080:00200000:1.0:1775772762.929121:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1c9:0x0](ffff8de1c45daa08) 00000080:00200000:1.0:1775772762.929129:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ca:0x0](ffff8de1c45fd348) 00000080:00200000:1.0:1775772762.929138:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ca:0x0](ffff8de1c45fb248) 00000080:00200000:1.0:1775772762.929158:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1cb:0x0](ffff8de1c45dcb08) 00000080:00200000:1.0:1775772762.929165:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1cb:0x0](ffff8de1c45d9148) 00000080:00200000:1.0:1775772762.929173:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1cc:0x0](ffff8de1c45fc2c8) 00000080:00200000:1.0:1775772762.929182:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1cc:0x0](ffff8de1c45fa1c8) 00000080:00200000:1.0:1775772762.929190:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1cd:0x0](ffff8de1c45f4b08) 00000080:00200000:1.0:1775772762.929199:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1cd:0x0](ffff8de1c45f5b88) 00000080:00200000:1.0:1775772762.929207:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ce:0x0](ffff8de1c45fec08) 00000080:00200000:1.0:1775772762.929217:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ce:0x0](ffff8de1c45f9148) 00000080:00200000:1.0:1775772762.929226:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1cf:0x0](ffff8de1c45d8908) 00000080:00200000:1.0:1775772762.929235:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1cf:0x0](ffff8de1c45da1c8) 00000080:00200000:1.0:1775772762.929244:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d0:0x0](ffff8de1c45f00c8) 00000080:00200000:1.0:1775772762.929254:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d0:0x0](ffff8de1c45f7448) 00000080:00200000:1.0:1775772762.929264:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d1:0x0](ffff8de1c45f5348) 00000080:00200000:1.0:1775772762.929272:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d1:0x0](ffff8de1c45f3248) 00000080:00200000:1.0:1775772762.929281:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d2:0x0](ffff8de1c45f42c8) 00000080:00200000:1.0:1775772762.929290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d2:0x0](ffff8de1c45f21c8) 00000080:00200000:1.0:1775772762.929299:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d3:0x0](ffff8de1c45e9148) 00000080:00200000:1.0:1775772762.929309:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d3:0x0](ffff8de1c4603248) 00000080:00200000:1.0:1775772762.929317:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d4:0x0](ffff8de1c45f9988) 00000080:00200000:1.0:1775772762.929327:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d4:0x0](ffff8de1c45faa08) 00000080:00200000:1.0:1775772762.929336:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d5:0x0](ffff8de1c4603a88) 00000080:00200000:1.0:1775772762.929347:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d5:0x0](ffff8de1c4606c08) 00000080:00200000:1.0:1775772762.929356:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d6:0x0](ffff8de1c45fba88) 00000080:00200000:1.0:1775772762.929366:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d6:0x0](ffff8de1c45fe3c8) 00000080:00200000:1.0:1775772762.929375:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d7:0x0](ffff8de1c460e3c8) 00000080:00200000:1.0:1775772762.929383:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d7:0x0](ffff8de1c460d348) 00000080:00200000:1.0:1775772762.929391:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d8:0x0](ffff8de1c460b248) 00000080:00200000:1.0:1775772762.929401:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d8:0x0](ffff8de1c460c2c8) 00000080:00200000:1.0:1775772762.929409:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1d9:0x0](ffff8de1c45e63c8) 00000080:00200000:1.0:1775772762.929420:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1d9:0x0](ffff8de1c45e5348) 00000080:00200000:1.0:1775772762.929429:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1da:0x0](ffff8de1c45e3248) 00000080:00200000:1.0:1775772762.929440:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1da:0x0](ffff8de1c45e42c8) 00000080:00200000:1.0:1775772762.929449:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1db:0x0](ffff8de1c460ec08) 00000080:00200000:1.0:1775772762.929458:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1db:0x0](ffff8de1c4609148) 00000080:00200000:1.0:1775772762.929467:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1dc:0x0](ffff8de1c460ba88) 00000080:00200000:1.0:1775772762.929475:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1dc:0x0](ffff8de1c4609988) 00000080:00200000:1.0:1775772762.929484:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1dd:0x0](ffff8de1c4605b88) 00000080:00200000:1.0:1775772762.929494:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1dd:0x0](ffff8de1c4600908) 00000080:00200000:1.0:1775772762.929502:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1de:0x0](ffff8de1c45e21c8) 00000080:00200000:1.0:1775772762.929511:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1de:0x0](ffff8de1c45e3a88) 00000080:00200000:1.0:1775772762.929520:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1df:0x0](ffff8de1c46000c8) 00000080:00200000:1.0:1775772762.929529:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1df:0x0](ffff8de1c4607448) 00000080:00200000:1.0:1775772762.929539:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e0:0x0](ffff8de1c45e1148) 00000080:00200000:1.0:1775772762.929552:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e0:0x0](ffff8de1c45e1988) 00000080:00200000:1.0:1775772762.931280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e1:0x0](ffff8de1c45e2a08) 00000080:00200000:1.0:1775772762.931328:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e1:0x0](ffff8de1c45e0908) 00000080:00200000:1.0:1775772762.931340:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e2:0x0](ffff8de1c460cb08) 00000080:00200000:1.0:1775772762.931352:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e2:0x0](ffff8de1c460db88) 00000080:00200000:1.0:1775772762.931368:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e3:0x0](ffff8de1c45f63c8) 00000080:00200000:1.0:1775772762.932006:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e3:0x0](ffff8de1c45f0908) 00000080:00200000:1.0:1775772762.932028:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e4:0x0](ffff8de1c4604b08) 00000080:00200000:1.0:1775772762.932043:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e4:0x0](ffff8de1c46063c8) 00000080:00200000:1.0:1775772762.932053:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e5:0x0](ffff8de1c45e6c08) 00000080:00200000:1.0:1775772762.932073:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e5:0x0](ffff8de1c45e5b88) 00000080:00200000:1.0:1775772762.932085:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e6:0x0](ffff8de1c46100c8) 00000080:00200000:1.0:1775772762.932096:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e6:0x0](ffff8de1c4617448) 00000080:00200000:1.0:1775772762.932106:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e7:0x0](ffff8de1c4610908) 00000080:00200000:1.0:1775772762.932115:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e7:0x0](ffff8de1c46163c8) 00000080:00200000:1.0:1775772762.932129:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e8:0x0](ffff8de1c460f448) 00000080:00200000:1.0:1775772762.932264:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e8:0x0](ffff8de1c46080c8) 00000080:00200000:1.0:1775772762.932280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1e9:0x0](ffff8de1c45f3a88) 00000080:00200000:1.0:1775772762.932293:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1e9:0x0](ffff8de1c461e3c8) 00000080:00200000:1.0:1775772762.932304:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ea:0x0](ffff8de1c4605348) 00000080:00200000:1.0:1775772762.932316:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ea:0x0](ffff8de1c4602a08) 00000080:00200000:1.0:1775772762.932328:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1eb:0x0](ffff8de1c46142c8) 00000080:00200000:1.0:1775772762.932341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1eb:0x0](ffff8de1c46121c8) 00000080:00200000:1.0:1775772762.934104:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ec:0x0](ffff8de1c4608908) 00000080:00200000:1.0:1775772762.934120:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ec:0x0](ffff8de1c460aa08) 00000080:00200000:1.0:1775772762.934131:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ed:0x0](ffff8de1c4601148) 00000080:00200000:1.0:1775772762.935345:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ed:0x0](ffff8de1c46021c8) 00000080:00200000:1.0:1775772762.935370:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ee:0x0](ffff8de1c461b248) 00000080:00200000:1.0:1775772762.935396:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ee:0x0](ffff8de1c461c2c8) 00000080:00200000:1.0:1775772762.935406:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ef:0x0](ffff8de1c4625348) 00000080:00200000:1.0:1775772762.935417:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ef:0x0](ffff8de1c4623248) 00000080:00200000:1.0:1775772762.935427:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f0:0x0](ffff8de1c46242c8) 00000080:00200000:1.0:1775772762.935436:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f0:0x0](ffff8de1c46221c8) 00000080:00200000:1.0:1775772762.935445:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f1:0x0](ffff8de1c461a1c8) 00000080:00200000:1.0:1775772762.935463:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f1:0x0](ffff8de1c461ba88) 00000080:00200000:1.0:1775772762.935472:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f2:0x0](ffff8de1c461ec08) 00000080:00200000:1.0:1775772762.935481:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f2:0x0](ffff8de1c4619148) 00000080:00200000:1.0:1775772762.935491:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f3:0x0](ffff8de1c4621148) 00000080:00200000:1.0:1775772762.935499:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f3:0x0](ffff8de1c4621988) 00000080:00200000:1.0:1775772762.935508:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f4:0x0](ffff8de1c46042c8) 00000080:00200000:1.0:1775772762.935517:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f4:0x0](ffff8de1c4601988) 00000080:00200000:1.0:1775772762.935533:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f5:0x0](ffff8de1c4624b08) 00000080:00200000:1.0:1775772762.935542:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f5:0x0](ffff8de1c4625b88) 00000080:00200000:1.0:1775772762.935551:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f6:0x0](ffff8de1c4616c08) 00000080:00200000:1.0:1775772762.935572:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f6:0x0](ffff8de1c4611148) 00000080:00200000:1.0:1775772762.935582:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f7:0x0](ffff8de1c45fcb08) 00000080:00200000:1.0:1775772762.935591:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f7:0x0](ffff8de1c462aa08) 00000080:00200000:1.0:1775772762.935602:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f8:0x0](ffff8de1c461aa08) 00000080:00200000:1.0:1775772762.935611:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f8:0x0](ffff8de1c461cb08) 00000080:00200000:1.0:1775772762.935621:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1f9:0x0](ffff8de1c46263c8) 00000080:00200000:1.0:1775772762.935629:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1f9:0x0](ffff8de1c46200c8) 00000080:00200000:1.0:1775772762.935639:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1fa:0x0](ffff8de1c4611988) 00000080:00200000:1.0:1775772762.935649:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1fa:0x0](ffff8de1c4612a08) 00000080:00200000:1.0:1775772762.935658:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1fb:0x0](ffff8de1c4620908) 00000080:00200000:1.0:1775772762.935674:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1fb:0x0](ffff8de1c4622a08) 00000080:00200000:1.0:1775772762.935683:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1fc:0x0](ffff8de1c4628908) 00000080:00200000:1.0:1775772762.935697:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1fc:0x0](ffff8de1c46280c8) 00000080:00200000:1.0:1775772762.935712:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1fd:0x0](ffff8de1c4623a88) 00000080:00200000:1.0:1775772762.935719:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1fd:0x0](ffff8de1c4627448) 00000080:00200000:1.0:1775772762.935764:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1fe:0x0](ffff8de1c4614b08) 00000080:00200000:1.0:1775772762.935776:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1fe:0x0](ffff8de1c4615b88) 00000080:00200000:1.0:1775772762.935787:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x1ff:0x0](ffff8de1c4626c08) 00000080:00200000:1.0:1775772762.935797:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x1ff:0x0](ffff8de1c46321c8) 00000080:00200000:1.0:1775772762.935806:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x200:0x0](ffff8de1c462f448) 00000080:00200000:1.0:1775772762.935817:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x200:0x0](ffff8de1c462e3c8) 00000080:00200000:1.0:1775772762.935828:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x201:0x0](ffff8de1c4636c08) 00000080:00200000:1.0:1775772762.935838:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x201:0x0](ffff8de1c4631148) 00000080:00200000:1.0:1775772762.935849:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x202:0x0](ffff8de1c461db88) 00000080:00200000:1.0:1775772762.935860:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x202:0x0](ffff8de1c4618908) 00000080:00200000:1.0:1775772762.935869:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x203:0x0](ffff8de1c4631988) 00000080:00200000:1.0:1775772762.935879:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x203:0x0](ffff8de1c4632a08) 00000080:00200000:1.0:1775772762.935889:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x204:0x0](ffff8de1c462db88) 00000080:00200000:1.0:1775772762.937339:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x204:0x0](ffff8de1c462d348) 00000080:00200000:1.0:1775772762.937369:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x205:0x0](ffff8de1c4634b08) 00000080:00200000:1.0:1775772762.937645:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x205:0x0](ffff8de1c4635b88) 00000080:00200000:1.0:1775772762.937657:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x206:0x0](ffff8de1c461f448) 00000080:00200000:1.0:1775772762.938022:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x206:0x0](ffff8de1c46180c8) 00000080:00200000:1.0:1775772762.938035:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x207:0x0](ffff8de1c462b248) 00000080:00200000:1.0:1775772762.938048:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x207:0x0](ffff8de1c462c2c8) 00000080:00200000:1.0:1775772762.938065:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x208:0x0](ffff8de1c4637448) 00000080:00200000:1.0:1775772762.938077:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x208:0x0](ffff8de1c46363c8) 00000080:00200000:1.0:1775772762.938087:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x209:0x0](ffff8de1c4613248) 00000080:00200000:1.0:1775772762.938100:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x209:0x0](ffff8de1c4613a88) 00000080:00200000:1.0:1775772762.938110:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20a:0x0](ffff8de1c4635348) 00000080:00200000:1.0:1775772762.938121:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20a:0x0](ffff8de1c4633248) 00000080:00200000:1.0:1775772762.938132:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20b:0x0](ffff8de1c460a1c8) 00000080:00200000:1.0:1775772762.938222:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20b:0x0](ffff8de1c46380c8) 00000080:00200000:1.0:1775772762.938237:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20c:0x0](ffff8de1c462a1c8) 00000080:00200000:1.0:1775772762.938249:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20c:0x0](ffff8de1c462ba88) 00000080:00200000:1.0:1775772762.938260:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20d:0x0](ffff8de1c46342c8) 00000080:00200000:1.0:1775772762.938271:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20d:0x0](ffff8de1c46300c8) 00000080:00200000:1.0:1775772762.938282:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20e:0x0](ffff8de1c463f448) 00000080:00200000:1.0:1775772762.938291:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20e:0x0](ffff8de1c463e3c8) 00000080:00200000:1.0:1775772762.938302:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x20f:0x0](ffff8de1c4633a88) 00000080:00200000:1.0:1775772762.938312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x20f:0x0](ffff8de1c46442c8) 00000080:00200000:1.0:1775772762.938323:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x210:0x0](ffff8de1c4629148) 00000080:00200000:1.0:1775772762.938332:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x210:0x0](ffff8de1c4629988) 00000080:00200000:1.0:1775772762.938341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x211:0x0](ffff8de1c461d348) 00000080:00200000:1.0:1775772762.938350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x211:0x0](ffff8de1c4619988) 00000080:00200000:1.0:1775772762.938360:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x212:0x0](ffff8de1c464aa08) 00000080:00200000:1.0:1775772762.938385:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x212:0x0](ffff8de1c464cb08) 00000080:00200000:1.0:1775772762.938408:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x213:0x0](ffff8de1c4646c08) 00000080:00200000:1.0:1775772762.938419:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x213:0x0](ffff8de1c4641148) 00000080:00200000:1.0:1775772762.938430:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x214:0x0](ffff8de1c462cb08) 00000080:00200000:1.0:1775772762.938440:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x214:0x0](ffff8de1c4657448) 00000080:00200000:1.0:1775772762.938450:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x215:0x0](ffff8de1c46563c8) 00000080:00200000:1.0:1775772762.938469:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x215:0x0](ffff8de1c4655348) 00000080:00200000:1.0:1775772762.938479:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x216:0x0](ffff8de1c4653248) 00000080:00200000:1.0:1775772762.938488:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x216:0x0](ffff8de1c46542c8) 00000080:00200000:1.0:1775772762.938499:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x217:0x0](ffff8de1c463d348) 00000080:00200000:1.0:1775772762.938508:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x217:0x0](ffff8de1c463b248) 00000080:00200000:1.0:1775772762.938519:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x218:0x0](ffff8de1c463c2c8) 00000080:00200000:1.0:1775772762.938538:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x218:0x0](ffff8de1c463a1c8) 00000080:00200000:1.0:1775772762.938549:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x219:0x0](ffff8de1c4644b08) 00000080:00200000:1.0:1775772762.938569:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x219:0x0](ffff8de1c4645b88) 00000080:00200000:1.0:1775772762.938581:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21a:0x0](ffff8de1c46400c8) 00000080:00200000:1.0:1775772762.938591:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21a:0x0](ffff8de1c4647448) 00000080:00200000:1.0:1775772762.938600:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21b:0x0](ffff8de1c46521c8) 00000080:00200000:1.0:1775772762.938609:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21b:0x0](ffff8de1c4653a88) 00000080:00200000:1.0:1775772762.938618:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21c:0x0](ffff8de1c46480c8) 00000080:00200000:1.0:1775772762.938626:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21c:0x0](ffff8de1c464f448) 00000080:00200000:1.0:1775772762.938636:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21d:0x0](ffff8de1c4656c08) 00000080:00200000:1.0:1775772762.938644:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21d:0x0](ffff8de1c4651148) 00000080:00200000:1.0:1775772762.938654:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21e:0x0](ffff8de1c4643248) 00000080:00200000:1.0:1775772762.939501:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21e:0x0](ffff8de1c46463c8) 00000080:00200000:1.0:1775772762.939548:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x21f:0x0](ffff8de1c4651988) 00000080:00200000:1.0:1775772762.939570:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x21f:0x0](ffff8de1c4652a08) 00000080:00200000:1.0:1775772762.939580:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x220:0x0](ffff8de1c463ba88) 00000080:00200000:1.0:1775772762.939594:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x220:0x0](ffff8de1c463ec08) 00000080:00200000:1.0:1775772762.939636:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x221:0x0](ffff8de1c4643a88) 00000080:00200000:1.0:1775772762.939650:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x221:0x0](ffff8de1c46421c8) 00000080:00200000:1.0:1775772762.939659:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x222:0x0](ffff8de1c4655b88) 00000080:00200000:1.0:1775772762.939680:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x222:0x0](ffff8de1c4650908) 00000080:00200000:1.0:1775772762.939691:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x223:0x0](ffff8de1c4641988) 00000080:00200000:1.0:1775772762.939701:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x223:0x0](ffff8de1c4642a08) 00000080:00200000:1.0:1775772762.939719:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x224:0x0](ffff8de1c4640908) 00000080:00200000:1.0:1775772762.939763:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x224:0x0](ffff8de1c4645348) 00000080:00200000:1.0:1775772762.939774:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x225:0x0](ffff8de1c464b248) 00000080:00200000:1.0:1775772762.939786:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x225:0x0](ffff8de1c464c2c8) 00000080:00200000:1.0:1775772762.939799:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x226:0x0](ffff8de1c46500c8) 00000080:00200000:1.0:1775772762.939809:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x226:0x0](ffff8de1c4654b08) 00000080:00200000:1.0:1775772762.939820:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x227:0x0](ffff8de1c462ec08) 00000080:00200000:1.0:1775772762.939830:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x227:0x0](ffff8de1c4630908) 00000080:00200000:1.0:1775772762.939839:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x228:0x0](ffff8de1c465d348) 00000080:00200000:1.0:1775772762.939848:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x228:0x0](ffff8de1c465b248) 00000080:00200000:1.0:1775772762.939859:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x229:0x0](ffff8de1c464d348) 00000080:00200000:1.0:1775772762.939868:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x229:0x0](ffff8de1c464a1c8) 00000080:00200000:1.0:1775772762.939878:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22a:0x0](ffff8de1c463aa08) 00000080:00200000:1.0:1775772762.939889:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22a:0x0](ffff8de1c463cb08) 00000080:00200000:1.0:1775772762.939910:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22b:0x0](ffff8de1c463db88) 00000080:00200000:1.0:1775772762.939921:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22b:0x0](ffff8de1c4638908) 00000080:00200000:1.0:1775772762.939931:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22c:0x0](ffff8de1c46621c8) 00000080:00200000:1.0:1775772762.939941:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22c:0x0](ffff8de1c4663a88) 00000080:00200000:1.0:1775772762.939951:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22d:0x0](ffff8de1c464ba88) 00000080:00200000:1.0:1775772762.939961:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22d:0x0](ffff8de1c464ec08) 00000080:00200000:1.0:1775772762.939971:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22e:0x0](ffff8de1c4659988) 00000080:00200000:1.0:1775772762.939980:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22e:0x0](ffff8de1c465aa08) 00000080:00200000:1.0:1775772762.939991:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x22f:0x0](ffff8de1c4659148) 00000080:00200000:1.0:1775772762.940001:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x22f:0x0](ffff8de1c465cb08) 00000080:00200000:1.0:1775772762.940011:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x230:0x0](ffff8de1c4658908) 00000080:00200000:1.0:1775772762.940020:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x230:0x0](ffff8de1c46580c8) 00000080:00200000:1.0:1775772762.940029:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x231:0x0](ffff8de1c465db88) 00000080:00200000:1.0:1775772762.940039:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x231:0x0](ffff8de1c465ec08) 00000080:00200000:1.0:1775772762.940048:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x232:0x0](ffff8de1c4649148) 00000080:00200000:1.0:1775772762.940057:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x232:0x0](ffff8de1c4649988) 00000080:00200000:1.0:1775772762.940066:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x233:0x0](ffff8de1c465a1c8) 00000080:00200000:1.0:1775772762.940074:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x233:0x0](ffff8de1c465c2c8) 00000080:00200000:1.0:1775772762.940085:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x234:0x0](ffff8de1c465ba88) 00000080:00200000:1.0:1775772762.940095:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x234:0x0](ffff8de1c465e3c8) 00000080:00200000:1.0:1775772762.940106:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x235:0x0](ffff8de1c4662a08) 00000080:00200000:1.0:1775772762.940116:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x235:0x0](ffff8de1c4664b08) 00000080:00200000:1.0:1775772762.940128:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x236:0x0](ffff8de1c466d348) 00000080:00200000:1.0:1775772762.942017:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x236:0x0](ffff8de1c466b248) 00000080:00200000:1.0:1775772762.942072:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x237:0x0](ffff8de1c466c2c8) 00000080:00200000:1.0:1775772762.942084:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x237:0x0](ffff8de1c466a1c8) 00000080:00200000:1.0:1775772762.942094:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x238:0x0](ffff8de1c466ba88) 00000080:00200000:1.0:1775772762.942108:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x238:0x0](ffff8de1c466ec08) 00000080:00200000:1.0:1775772762.942117:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x239:0x0](ffff8de1c464db88) 00000080:00200000:1.0:1775772762.942133:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x239:0x0](ffff8de1c464e3c8) 00000080:00200000:1.0:1775772762.942224:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23a:0x0](ffff8de1c4669988) 00000080:00200000:1.0:1775772762.942274:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23a:0x0](ffff8de1c466aa08) 00000080:00200000:1.0:1775772762.942286:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23b:0x0](ffff8de1c466cb08) 00000080:00200000:1.0:1775772762.942297:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23b:0x0](ffff8de1c466db88) 00000080:00200000:1.0:1775772762.942308:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23c:0x0](ffff8de1c4660908) 00000080:00200000:1.0:1775772762.942320:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23c:0x0](ffff8de1c46600c8) 00000080:00200000:1.0:1775772762.942331:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23d:0x0](ffff8de1c46680c8) 00000080:00200000:1.0:1775772762.942342:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23d:0x0](ffff8de1c466f448) 00000080:00200000:1.0:1775772762.942355:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23e:0x0](ffff8de1c4668908) 00000080:00200000:1.0:1775772762.942365:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23e:0x0](ffff8de1c4669148) 00000080:00200000:1.0:1775772762.943214:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x23f:0x0](ffff8de1c4648908) 00000080:00200000:1.0:1775772762.943241:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x23f:0x0](ffff8de1c46721c8) 00000080:00200000:1.0:1775772762.943252:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x240:0x0](ffff8de1c466e3c8) 00000080:00200000:1.0:1775772762.943264:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x240:0x0](ffff8de1c465f448) 00000080:00200000:1.0:1775772762.943274:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x241:0x0](ffff8de1c467aa08) 00000080:00200000:1.0:1775772762.943285:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x241:0x0](ffff8de1c467cb08) 00000080:00200000:1.0:1775772762.943297:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x242:0x0](ffff8de1c4639988) 00000080:00200000:1.0:1775772762.943312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x242:0x0](ffff8de1c4615348) 00000080:00200000:1.0:1775772762.943324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x243:0x0](ffff8de1c467db88) 00000080:00200000:1.0:1775772762.943335:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x243:0x0](ffff8de1c4678908) 00000080:00200000:1.0:1775772762.943346:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x244:0x0](ffff8de1c467f448) 00000080:00200000:1.0:1775772762.943357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x244:0x0](ffff8de1c467e3c8) 00000080:00200000:1.0:1775772762.943368:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x245:0x0](ffff8de1c467d348) 00000080:00200000:1.0:1775772762.943536:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x245:0x0](ffff8de1c467b248) 00000080:00200000:1.0:1775772762.943552:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x246:0x0](ffff8de1c467a1c8) 00000080:00200000:1.0:1775772762.943572:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x246:0x0](ffff8de1c467ba88) 00000080:00200000:1.0:1775772762.943583:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x247:0x0](ffff8de1c467c2c8) 00000080:00200000:1.0:1775772762.943595:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x247:0x0](ffff8de1c467ec08) 00000080:00200000:1.0:1775772762.943605:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x248:0x0](ffff8de1c4679148) 00000080:00200000:1.0:1775772762.943616:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x248:0x0](ffff8de1c4679988) 00000080:00200000:1.0:1775772762.943626:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x249:0x0](ffff8de1c4680908) 00000080:00200000:1.0:1775772762.943637:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x249:0x0](ffff8de1c46800c8) 00000080:00200000:1.0:1775772762.943647:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24a:0x0](ffff8de1c4639148) 00000080:00200000:1.0:1775772762.943657:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24a:0x0](ffff8de1c468f448) 00000080:00200000:1.0:1775772762.943679:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24b:0x0](ffff8de1c4671148) 00000080:00200000:1.0:1775772762.943691:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24b:0x0](ffff8de1c4671988) 00000080:00200000:1.0:1775772762.943709:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24c:0x0](ffff8de1c4672a08) 00000080:00200000:1.0:1775772762.943755:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24c:0x0](ffff8de1c4674b08) 00000080:00200000:1.0:1775772762.943778:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24d:0x0](ffff8de1c468d348) 00000080:00200000:1.0:1775772762.943790:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24d:0x0](ffff8de1c468b248) 00000080:00200000:1.0:1775772762.943800:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24e:0x0](ffff8de1c46642c8) 00000080:00200000:1.0:1775772762.943811:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24e:0x0](ffff8de1c4663248) 00000080:00200000:1.0:1775772762.943822:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x24f:0x0](ffff8de1c46700c8) 00000080:00200000:1.0:1775772762.943832:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x24f:0x0](ffff8de1c4677448) 00000080:00200000:1.0:1775772762.943844:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x250:0x0](ffff8de1c468a1c8) 00000080:00200000:1.0:1775772762.943853:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x250:0x0](ffff8de1c468ba88) 00000080:00200000:1.0:1775772762.943864:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x251:0x0](ffff8de1c46763c8) 00000080:00200000:1.0:1775772762.943876:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x251:0x0](ffff8de1c4675348) 00000080:00200000:1.0:1775772762.943887:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x252:0x0](ffff8de1c4689148) 00000080:00200000:1.0:1775772762.943907:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x252:0x0](ffff8de1c4689988) 00000080:00200000:1.0:1775772762.943919:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x253:0x0](ffff8de1c468ec08) 00000080:00200000:1.0:1775772762.943930:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x253:0x0](ffff8de1c468aa08) 00000080:00200000:1.0:1775772762.943967:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x254:0x0](ffff8de1c46863c8) 00000080:00200000:1.0:1775772762.943982:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x254:0x0](ffff8de1c4685348) 00000080:00200000:1.0:1775772762.943992:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x255:0x0](ffff8de1c4673248) 00000080:00200000:1.0:1775772762.944003:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x255:0x0](ffff8de1c46742c8) 00000080:00200000:1.0:1775772762.944012:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x256:0x0](ffff8de1c4670908) 00000080:00200000:1.0:1775772762.944021:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x256:0x0](ffff8de1c4675b88) 00000080:00200000:1.0:1775772762.944031:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x257:0x0](ffff8de1c468cb08) 00000080:00200000:1.0:1775772762.944041:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x257:0x0](ffff8de1c468db88) 00000080:00200000:1.0:1775772762.944050:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x258:0x0](ffff8de1c46880c8) 00000080:00200000:1.0:1775772762.944059:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x258:0x0](ffff8de1c468c2c8) 00000080:00200000:1.0:1775772762.944068:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x259:0x0](ffff8de1c4683248) 00000080:00200000:1.0:1775772762.944078:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x259:0x0](ffff8de1c46842c8) 00000080:00200000:1.0:1775772762.944088:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25a:0x0](ffff8de1c4688908) 00000080:00200000:1.0:1775772762.944098:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25a:0x0](ffff8de1c4696c08) 00000080:00200000:1.0:1775772762.944107:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25b:0x0](ffff8de1c46821c8) 00000080:00200000:1.0:1775772762.944116:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25b:0x0](ffff8de1c4683a88) 00000080:00200000:1.0:1775772762.944127:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25c:0x0](ffff8de1c4691988) 00000080:00200000:1.0:1775772762.944136:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25c:0x0](ffff8de1c4692a08) 00000080:00200000:1.0:1775772762.946056:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25d:0x0](ffff8de1c4673a88) 00000080:00200000:1.0:1775772762.946084:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25d:0x0](ffff8de1c4676c08) 00000080:00200000:1.0:1775772762.946097:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25e:0x0](ffff8de1c4661148) 00000080:00200000:1.0:1775772762.946112:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25e:0x0](ffff8de1c4666c08) 00000080:00200000:1.0:1775772762.946124:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x25f:0x0](ffff8de1c4695b88) 00000080:00200000:1.0:1775772762.946134:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x25f:0x0](ffff8de1c4690908) 00000080:00200000:1.0:1775772762.946226:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x260:0x0](ffff8de1c469f448) 00000080:00200000:1.0:1775772762.946242:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x260:0x0](ffff8de1c469e3c8) 00000080:00200000:1.0:1775772762.946253:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x261:0x0](ffff8de1c46963c8) 00000080:00200000:1.0:1775772762.946265:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x261:0x0](ffff8de1c4695348) 00000080:00200000:1.0:1775772762.946276:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x262:0x0](ffff8de1c4697448) 00000080:00200000:1.0:1775772762.946286:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x262:0x0](ffff8de1c4693248) 00000080:00200000:1.0:1775772762.946299:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x263:0x0](ffff8de1c469d348) 00000080:00200000:1.0:1775772762.946312:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x263:0x0](ffff8de1c469b248) 00000080:00200000:1.0:1775772762.946331:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x264:0x0](ffff8de1c46942c8) 00000080:00200000:1.0:1775772762.946342:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x264:0x0](ffff8de1c46921c8) 00000080:00200000:1.0:1775772762.946353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x265:0x0](ffff8de1c4667448) 00000080:00200000:1.0:1775772762.946362:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x265:0x0](ffff8de1c46663c8) 00000080:00200000:1.0:1775772762.946372:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x266:0x0](ffff8de1c4693a88) 00000080:00200000:1.0:1775772762.947128:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x266:0x0](ffff8de1c46900c8) 00000080:00200000:1.0:1775772762.947218:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x267:0x0](ffff8de1c4681148) 00000080:00200000:1.0:1775772762.947238:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x267:0x0](ffff8de1c4681988) 00000080:00200000:1.0:1775772762.947248:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x268:0x0](ffff8de1c4665348) 00000080:00200000:1.0:1775772762.947259:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x268:0x0](ffff8de1c4665b88) 00000080:00200000:1.0:1775772762.947269:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x269:0x0](ffff8de1c4694b08) 00000080:00200000:1.0:1775772762.947278:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x269:0x0](ffff8de1c468e3c8) 00000080:00200000:1.0:1775772762.947288:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26a:0x0](ffff8de1c4682a08) 00000080:00200000:1.0:1775772762.947298:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26a:0x0](ffff8de1c4686c08) 00000080:00200000:1.0:1775772762.947308:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26b:0x0](ffff8de1c4661988) 00000080:00200000:1.0:1775772762.947319:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26b:0x0](ffff8de1c46780c8) 00000080:00200000:1.0:1775772762.947331:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26c:0x0](ffff8de1c4699148) 00000080:00200000:1.0:1775772762.947341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26c:0x0](ffff8de1c4699988) 00000080:00200000:1.0:1775772762.947352:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26d:0x0](ffff8de1c46a4b08) 00000080:00200000:1.0:1775772762.947492:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26d:0x0](ffff8de1c46a5b88) 00000080:00200000:1.0:1775772762.947507:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26e:0x0](ffff8de1c46ab248) 00000080:00200000:1.0:1775772762.947520:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26e:0x0](ffff8de1c46ac2c8) 00000080:00200000:1.0:1775772762.947544:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x26f:0x0](ffff8de1c46a0908) 00000080:00200000:1.0:1775772762.947553:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x26f:0x0](ffff8de1c46a00c8) 00000080:00200000:1.0:1775772762.947573:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x270:0x0](ffff8de1c46aa1c8) 00000080:00200000:1.0:1775772762.947585:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x270:0x0](ffff8de1c46aba88) 00000080:00200000:1.0:1775772762.947596:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x271:0x0](ffff8de1c46aec08) 00000080:00200000:1.0:1775772762.947609:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x271:0x0](ffff8de1c46a9148) 00000080:00200000:1.0:1775772762.947620:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x272:0x0](ffff8de1c46a9988) 00000080:00200000:1.0:1775772762.947629:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x272:0x0](ffff8de1c46aaa08) 00000080:00200000:1.0:1775772762.947639:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x273:0x0](ffff8de1c46adb88) 00000080:00200000:1.0:1775772762.947650:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x273:0x0](ffff8de1c46a8908) 00000080:00200000:1.0:1775772762.947662:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x274:0x0](ffff8de1c46a80c8) 00000080:00200000:1.0:1775772762.947681:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x274:0x0](ffff8de1c46af448) 00000080:00200000:1.0:1775772762.947692:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x275:0x0](ffff8de1c46a5348) 00000080:00200000:1.0:1775772762.947711:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x275:0x0](ffff8de1c46a3248) 00000080:00200000:1.0:1775772762.947765:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x276:0x0](ffff8de1c46a42c8) 00000080:00200000:1.0:1775772762.947778:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x276:0x0](ffff8de1c46a21c8) 00000080:00200000:1.0:1775772762.947788:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x277:0x0](ffff8de1c46a3a88) 00000080:00200000:1.0:1775772762.947797:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x277:0x0](ffff8de1c46a6c08) 00000080:00200000:1.0:1775772762.947807:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x278:0x0](ffff8de1c46a1148) 00000080:00200000:1.0:1775772762.947816:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x278:0x0](ffff8de1c46a1988) 00000080:00200000:1.0:1775772762.947826:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x279:0x0](ffff8de1c46a2a08) 00000080:00200000:1.0:1775772762.947835:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x279:0x0](ffff8de1c46a63c8) 00000080:00200000:1.0:1775772762.947845:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27a:0x0](ffff8de1c46ae3c8) 00000080:00200000:1.0:1775772762.947854:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x27a:0x0](ffff8de1c46acb08) 00000080:00200000:1.0:1775772762.947865:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27b:0x0](ffff8de1c46ad348) 00000080:00200000:1.0:1775772762.947874:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x27c:0x0](ffff8de1c46b3a88) 00000080:00200000:1.0:1775772762.947884:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27c:0x0](ffff8de1c4687448) 00000080:00200000:1.0:1775772762.947905:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x27d:0x0](ffff8de1c4685b88) 00000080:00200000:1.0:1775772762.947918:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27d:0x0](ffff8de1c46b1148) 00000080:00200000:1.0:1775772762.947929:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x27e:0x0](ffff8de1c46b1988) 00000080:00200000:1.0:1775772762.947938:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27e:0x0](ffff8de1c46b6c08) 00000080:00200000:1.0:1775772762.947948:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x27f:0x0](ffff8de1c46b2a08) 00000080:00200000:1.0:1775772762.947959:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x27f:0x0](ffff8de1c46a7448) 00000080:00200000:1.0:1775772762.947968:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x280:0x0](ffff8de1c4691148) 00000080:00200000:1.0:1775772762.947978:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x280:0x0](ffff8de1c46bcb08) 00000080:00200000:1.0:1775772762.947988:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x281:0x0](ffff8de1c46bdb88) 00000080:00200000:1.0:1775772762.947997:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x281:0x0](ffff8de1c46b80c8) 00000080:00200000:1.0:1775772762.948007:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x282:0x0](ffff8de1c46bf448) 00000080:00200000:1.0:1775772762.948016:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x282:0x0](ffff8de1c46b5b88) 00000080:00200000:1.0:1775772762.948026:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x283:0x0](ffff8de1c46b0908) 00000080:00200000:1.0:1775772762.948036:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x283:0x0](ffff8de1c46b00c8) 00000080:00200000:1.0:1775772762.948044:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x284:0x0](ffff8de1c46b7448) 00000080:00200000:1.0:1775772762.948053:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x284:0x0](ffff8de1c46b63c8) 00000080:00200000:1.0:1775772762.948064:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x285:0x0](ffff8de1c46b5348) 00000080:00200000:1.0:1775772762.948073:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x285:0x0](ffff8de1c46b3248) 00000080:00200000:1.0:1775772762.948082:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x286:0x0](ffff8de1c46b42c8) 00000080:00200000:1.0:1775772762.948091:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x286:0x0](ffff8de1c46b21c8) 00000080:00200000:1.0:1775772762.948100:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x287:0x0](ffff8de1c46b4b08) 00000080:00200000:1.0:1775772762.948126:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x287:0x0](ffff8de1c46bc2c8) 00000080:00200000:1.0:1775772762.948136:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x288:0x0](ffff8de1c46ba1c8) 00000080:00200000:1.0:1775772762.948159:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x288:0x0](ffff8de1c469db88) 00000080:00200000:1.0:1775772762.948169:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x289:0x0](ffff8de1c4698908) 00000080:00200000:1.0:1775772762.948179:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x289:0x0](ffff8de1c46b9148) 00000080:00200000:1.0:1775772762.948188:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28a:0x0](ffff8de1c46b9988) 00000080:00200000:1.0:1775772762.948198:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28a:0x0](ffff8de1c46c1148) 00000080:00200000:1.0:1775772762.948209:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28b:0x0](ffff8de1c46c1988) 00000080:00200000:1.0:1775772762.948218:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28b:0x0](ffff8de1c46bec08) 00000080:00200000:1.0:1775772762.948229:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28c:0x0](ffff8de1c46baa08) 00000080:00200000:1.0:1775772762.948239:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28c:0x0](ffff8de1c46c5b88) 00000080:00200000:1.0:1775772762.948250:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28d:0x0](ffff8de1c46c0908) 00000080:00200000:1.0:1775772762.948260:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28d:0x0](ffff8de1c46bb248) 00000080:00200000:1.0:1775772762.948271:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28e:0x0](ffff8de1c46bd348) 00000080:00200000:1.0:1775772762.948280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28e:0x0](ffff8de1c4684b08) 00000080:00200000:1.0:1775772762.948290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x28f:0x0](ffff8de1c46ca1c8) 00000080:00200000:1.0:1775772762.948302:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x28f:0x0](ffff8de1c46b8908) 00000080:00200000:1.0:1775772762.948311:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x290:0x0](ffff8de1c46be3c8) 00000080:00200000:1.0:1775772762.948320:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x290:0x0](ffff8de1c46bba88) 00000080:00200000:1.0:1775772762.948329:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x291:0x0](ffff8de1c46d63c8) 00000080:00200000:1.0:1775772762.948338:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x291:0x0](ffff8de1c46d3248) 00000080:00200000:1.0:1775772762.948347:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x292:0x0](ffff8de1c46d42c8) 00000080:00200000:1.0:1775772762.948357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x292:0x0](ffff8de1c46d21c8) 00000080:00200000:1.0:1775772762.948367:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x293:0x0](ffff8de1c46d3a88) 00000080:00200000:1.0:1775772762.948377:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x293:0x0](ffff8de1c46980c8) 00000080:00200000:1.0:1775772762.948386:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x294:0x0](ffff8de1c469cb08) 00000080:00200000:1.0:1775772762.948409:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x294:0x0](ffff8de1c46d1148) 00000080:00200000:1.0:1775772762.948419:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x295:0x0](ffff8de1c46d1988) 00000080:00200000:1.0:1775772762.948429:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x295:0x0](ffff8de1c46d2a08) 00000080:00200000:1.0:1775772762.948438:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x296:0x0](ffff8de1c46d4b08) 00000080:00200000:1.0:1775772762.948448:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x296:0x0](ffff8de1c46c9148) 00000080:00200000:1.0:1775772762.948468:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x297:0x0](ffff8de1c46c9988) 00000080:00200000:1.0:1775772762.948487:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x297:0x0](ffff8de1c46d0908) 00000080:00200000:1.0:1775772762.948496:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x298:0x0](ffff8de1c46d00c8) 00000080:00200000:1.0:1775772762.948506:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x298:0x0](ffff8de1c469ec08) 00000080:00200000:1.0:1775772762.948515:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x299:0x0](ffff8de1c469ba88) 00000080:00200000:1.0:1775772762.948523:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x299:0x0](ffff8de1c46c7448) 00000080:00200000:1.0:1775772762.948532:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29a:0x0](ffff8de1c46c63c8) 00000080:00200000:1.0:1775772762.948541:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29a:0x0](ffff8de1c469a1c8) 00000080:00200000:1.0:1775772762.948550:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29b:0x0](ffff8de1c469c2c8) 00000080:00200000:1.0:1775772762.948571:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29b:0x0](ffff8de1c46c3248) 00000080:00200000:1.0:1775772762.948583:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29c:0x0](ffff8de1c46c42c8) 00000080:00200000:1.0:1775772762.948592:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29c:0x0](ffff8de1c46d7448) 00000080:00200000:1.0:1775772762.948601:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29d:0x0](ffff8de1c46d5b88) 00000080:00200000:1.0:1775772762.948612:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29d:0x0](ffff8de1c46ccb08) 00000080:00200000:1.0:1775772762.948622:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29e:0x0](ffff8de1c46cdb88) 00000080:00200000:1.0:1775772762.948634:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29e:0x0](ffff8de1c46c21c8) 00000080:00200000:1.0:1775772762.948643:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x29f:0x0](ffff8de1c46c5348) 00000080:00200000:1.0:1775772762.948652:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x29f:0x0](ffff8de1c46c00c8) 00000080:00200000:1.0:1775772762.948662:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a0:0x0](ffff8de1c46c4b08) 00000080:00200000:1.0:1775772762.948671:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a0:0x0](ffff8de1c46d5348) 00000080:00200000:1.0:1775772762.948713:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a1:0x0](ffff8de1c46d6c08) 00000080:00200000:1.0:1775772762.948773:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a1:0x0](ffff8de1c46d9988) 00000080:00200000:1.0:1775772762.948784:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a2:0x0](ffff8de1c46daa08) 00000080:00200000:1.0:1775772762.948794:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a2:0x0](ffff8de1c46cf448) 00000080:00200000:1.0:1775772762.948804:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a3:0x0](ffff8de1c46ce3c8) 00000080:00200000:1.0:1775772762.948813:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a3:0x0](ffff8de1c46c6c08) 00000080:00200000:1.0:1775772762.948822:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a4:0x0](ffff8de1c46c3a88) 00000080:00200000:1.0:1775772762.948832:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a4:0x0](ffff8de1c469aa08) 00000080:00200000:1.0:1775772762.948841:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a5:0x0](ffff8de1c46e63c8) 00000080:00200000:1.0:1775772762.948850:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a5:0x0](ffff8de1c46ef448) 00000080:00200000:1.0:1775772762.948859:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a6:0x0](ffff8de1c46ee3c8) 00000080:00200000:1.0:1775772762.948869:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a6:0x0](ffff8de1c46ddb88) 00000080:00200000:1.0:1775772762.948878:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a7:0x0](ffff8de1c46d8908) 00000080:00200000:1.0:1775772762.948888:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a7:0x0](ffff8de1c46e3248) 00000080:00200000:1.0:1775772762.948897:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a8:0x0](ffff8de1c46e42c8) 00000080:00200000:1.0:1775772762.948906:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a8:0x0](ffff8de1c46eb248) 00000080:00200000:1.0:1775772762.948916:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2a9:0x0](ffff8de1c46ec2c8) 00000080:00200000:1.0:1775772762.948925:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2a9:0x0](ffff8de1c46cd348) 00000080:00200000:1.0:1775772762.948934:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2aa:0x0](ffff8de1c46cb248) 00000080:00200000:1.0:1775772762.948944:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2aa:0x0](ffff8de1c46eba88) 00000080:00200000:1.0:1775772762.948954:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ab:0x0](ffff8de1c46eec08) 00000080:00200000:1.0:1775772762.948963:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ab:0x0](ffff8de1c46cc2c8) 00000080:00200000:1.0:1775772762.948973:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ac:0x0](ffff8de1c46c80c8) 00000080:00200000:1.0:1775772762.948981:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ac:0x0](ffff8de1c46c8908) 00000080:00200000:1.0:1775772762.948990:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ad:0x0](ffff8de1c46caa08) 00000080:00200000:1.0:1775772762.948998:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ad:0x0](ffff8de1c46dd348) 00000080:00200000:1.0:1775772762.949007:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ae:0x0](ffff8de1c46db248) 00000080:00200000:1.0:1775772762.949016:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ae:0x0](ffff8de1c46de3c8) 00000080:00200000:1.0:1775772762.949027:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2af:0x0](ffff8de1c46dc2c8) 00000080:00200000:1.0:1775772762.949036:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2af:0x0](ffff8de1c46eaa08) 00000080:00200000:1.0:1775772762.949044:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b0:0x0](ffff8de1c46ecb08) 00000080:00200000:1.0:1775772762.949053:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b0:0x0](ffff8de1c46dec08) 00000080:00200000:1.0:1775772762.949062:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b1:0x0](ffff8de1c46d9148) 00000080:00200000:1.0:1775772762.949072:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b1:0x0](ffff8de1c46cec08) 00000080:00200000:1.0:1775772762.949080:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b2:0x0](ffff8de1c46cba88) 00000080:00200000:1.0:1775772762.949089:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b2:0x0](ffff8de1c46f6c08) 00000080:00200000:1.0:1775772762.949098:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b3:0x0](ffff8de1c46f1148) 00000080:00200000:1.0:1775772762.949107:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b3:0x0](ffff8de1c46edb88) 00000080:00200000:1.0:1775772762.949117:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b4:0x0](ffff8de1c46e8908) 00000080:00200000:1.0:1775772762.949126:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b4:0x0](ffff8de1c46e5348) 00000080:00200000:1.0:1775772762.949135:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b5:0x0](ffff8de1c46e21c8) 00000080:00200000:1.0:1775772762.949145:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b5:0x0](ffff8de1c46dba88) 00000080:00200000:1.0:1775772762.949153:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b6:0x0](ffff8de1c46da1c8) 00000080:00200000:1.0:1775772762.949162:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b6:0x0](ffff8de1c46df448) 00000080:00200000:1.0:1775772762.949172:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b7:0x0](ffff8de1c46d80c8) 00000080:00200000:1.0:1775772762.949180:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b7:0x0](ffff8de1c46fb248) 00000080:00200000:1.0:1775772762.949189:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b8:0x0](ffff8de1c46fc2c8) 00000080:00200000:1.0:1775772762.949198:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b8:0x0](ffff8de1c46fa1c8) 00000080:00200000:1.0:1775772762.949206:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2b9:0x0](ffff8de1c46fba88) 00000080:00200000:1.0:1775772762.949217:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2b9:0x0](ffff8de1c46fec08) 00000080:00200000:1.0:1775772762.949226:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ba:0x0](ffff8de1c46f9148) 00000080:00200000:1.0:1775772762.949251:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ba:0x0](ffff8de1c46f5b88) 00000080:00200000:1.0:1775772762.949263:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2bb:0x0](ffff8de1c46f0908) 00000080:00200000:1.0:1775772762.949271:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2bc:0x0](ffff8de1c46f00c8) 00000080:00200000:1.0:1775772762.949279:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2bc:0x0](ffff8de1c46f7448) 00000080:00200000:1.0:1775772762.949288:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2bd:0x0](ffff8de1c46faa08) 00000080:00200000:1.0:1775772762.949297:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2bd:0x0](ffff8de1c46fcb08) 00000080:00200000:1.0:1775772762.949305:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2be:0x0](ffff8de1c46f9988) 00000080:00200000:1.0:1775772762.949313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2be:0x0](ffff8de1c46fdb88) 00000080:00200000:1.0:1775772762.949323:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2bf:0x0](ffff8de1c46f8908) 00000080:00200000:1.0:1775772762.949344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2bf:0x0](ffff8de1c46f80c8) 00000080:00200000:1.0:1775772762.949353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c0:0x0](ffff8de1c46e80c8) 00000080:00200000:1.0:1775772762.949362:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c0:0x0](ffff8de1c46e9988) 00000080:00200000:1.0:1775772762.949372:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c1:0x0](ffff8de1c46fe3c8) 00000080:00200000:1.0:1775772762.949382:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c1:0x0](ffff8de1c46fd348) 00000080:00200000:1.0:1775772762.949390:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c2:0x0](ffff8de1c46e9148) 00000080:00200000:1.0:1775772762.949401:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c2:0x0](ffff8de1c46ea1c8) 00000080:00200000:1.0:1775772762.949410:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c3:0x0](ffff8de1c47042c8) 00000080:00200000:1.0:1775772762.949419:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c3:0x0](ffff8de1c47021c8) 00000080:00200000:1.0:1775772762.949428:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c4:0x0](ffff8de1c4703a88) 00000080:00200000:1.0:1775772762.949438:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c4:0x0](ffff8de1c4706c08) 00000080:00200000:1.0:1775772762.949447:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c5:0x0](ffff8de1c46e2a08) 00000080:00200000:1.0:1775772762.949457:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c5:0x0](ffff8de1c46e4b08) 00000080:00200000:1.0:1775772762.949466:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c6:0x0](ffff8de1c46ed348) 00000080:00200000:1.0:1775772762.949476:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c6:0x0](ffff8de1c46dcb08) 00000080:00200000:1.0:1775772762.949485:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c7:0x0](ffff8de1c46f21c8) 00000080:00200000:1.0:1775772762.949496:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c7:0x0](ffff8de1c46f3a88) 00000080:00200000:1.0:1775772762.949506:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c8:0x0](ffff8de1c4709988) 00000080:00200000:1.0:1775772762.949516:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c8:0x0](ffff8de1c470aa08) 00000080:00200000:1.0:1775772762.949525:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2c9:0x0](ffff8de1c470cb08) 00000080:00200000:1.0:1775772762.949534:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2c9:0x0](ffff8de1c470db88) 00000080:00200000:1.0:1775772762.949543:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ca:0x0](ffff8de1c47080c8) 00000080:00200000:1.0:1775772762.949551:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ca:0x0](ffff8de1c470f448) 00000080:00200000:1.0:1775772762.949571:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2cb:0x0](ffff8de1c4701988) 00000080:00200000:1.0:1775772762.949581:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2cb:0x0](ffff8de1c4702a08) 00000080:00200000:1.0:1775772762.949589:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2cc:0x0](ffff8de1c470e3c8) 00000080:00200000:1.0:1775772762.949598:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2cc:0x0](ffff8de1c470d348) 00000080:00200000:1.0:1775772762.949607:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2cd:0x0](ffff8de1c470b248) 00000080:00200000:1.0:1775772762.949616:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2cd:0x0](ffff8de1c470c2c8) 00000080:00200000:1.0:1775772762.949625:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ce:0x0](ffff8de1c4704b08) 00000080:00200000:1.0:1775772762.949634:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ce:0x0](ffff8de1c4705b88) 00000080:00200000:1.0:1775772762.949643:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2cf:0x0](ffff8de1c46e5b88) 00000080:00200000:1.0:1775772762.949653:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2cf:0x0](ffff8de1c46e0908) 00000080:00200000:1.0:1775772762.949661:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d0:0x0](ffff8de1c46e00c8) 00000080:00200000:1.0:1775772762.949670:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d0:0x0](ffff8de1c46e7448) 00000080:00200000:1.0:1775772762.949678:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d1:0x0](ffff8de1c4700908) 00000080:00200000:1.0:1775772762.949691:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d1:0x0](ffff8de1c47000c8) 00000080:00200000:1.0:1775772762.949702:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d2:0x0](ffff8de1c470ec08) 00000080:00200000:1.0:1775772762.949711:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d2:0x0](ffff8de1c4709148) 00000080:00200000:1.0:1775772762.949721:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d3:0x0](ffff8de1c470ba88) 00000080:00200000:1.0:1775772762.949769:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d3:0x0](ffff8de1c470a1c8) 00000080:00200000:1.0:1775772762.949777:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d4:0x0](ffff8de1c4708908) 00000080:00200000:1.0:1775772762.949805:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d4:0x0](ffff8de1c4716c08) 00000080:00200000:1.0:1775772762.949816:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d5:0x0](ffff8de1c4711988) 00000080:00200000:1.0:1775772762.949824:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d5:0x0](ffff8de1c4712a08) 00000080:00200000:1.0:1775772762.949833:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d6:0x0](ffff8de1c4711148) 00000080:00200000:1.0:1775772762.949841:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d6:0x0](ffff8de1c4714b08) 00000080:00200000:1.0:1775772762.949851:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d7:0x0](ffff8de1c46f63c8) 00000080:00200000:1.0:1775772762.949860:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d7:0x0](ffff8de1c46f4b08) 00000080:00200000:1.0:1775772762.949869:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d8:0x0](ffff8de1c46e1988) 00000080:00200000:1.0:1775772762.949878:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d8:0x0](ffff8de1c46e1148) 00000080:00200000:1.0:1775772762.949887:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2d9:0x0](ffff8de1c4715b88) 00000080:00200000:1.0:1775772762.949897:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2d9:0x0](ffff8de1c4710908) 00000080:00200000:1.0:1775772762.949906:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2da:0x0](ffff8de1c47100c8) 00000080:00200000:1.0:1775772762.949915:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2da:0x0](ffff8de1c4717448) 00000080:00200000:1.0:1775772762.949924:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2db:0x0](ffff8de1c4703248) 00000080:00200000:1.0:1775772762.949936:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2db:0x0](ffff8de1c4705348) 00000080:00200000:1.0:1775772762.949944:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2dc:0x0](ffff8de1c46e3a88) 00000080:00200000:1.0:1775772762.949954:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2dc:0x0](ffff8de1c46c2a08) 00000080:00200000:1.0:1775772762.949963:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2dd:0x0](ffff8de1c47063c8) 00000080:00200000:1.0:1775772762.949972:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2dd:0x0](ffff8de1c4707448) 00000080:00200000:1.0:1775772762.949981:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2de:0x0](ffff8de1c4715348) 00000080:00200000:1.0:1775772762.949990:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2de:0x0](ffff8de1c4713248) 00000080:00200000:1.0:1775772762.949998:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2df:0x0](ffff8de1c46e6c08) 00000080:00200000:1.0:1775772762.950007:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2df:0x0](ffff8de1c4718908) 00000080:00200000:1.0:1775772762.950015:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e0:0x0](ffff8de1c46f1988) 00000080:00200000:1.0:1775772762.950024:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e0:0x0](ffff8de1c46f2a08) 00000080:00200000:1.0:1775772762.950032:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e1:0x0](ffff8de1c46ff448) 00000080:00200000:1.0:1775772762.950040:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e1:0x0](ffff8de1c47200c8) 00000080:00200000:1.0:1775772762.950049:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e2:0x0](ffff8de1c4727448) 00000080:00200000:1.0:1775772762.950057:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e2:0x0](ffff8de1c47263c8) 00000080:00200000:1.0:1775772762.950067:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e3:0x0](ffff8de1c46f3248) 00000080:00200000:1.0:1775772762.950076:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e3:0x0](ffff8de1c46f42c8) 00000080:00200000:1.0:1775772762.950084:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e4:0x0](ffff8de1c4725348) 00000080:00200000:1.0:1775772762.950093:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e4:0x0](ffff8de1c4723248) 00000080:00200000:1.0:1775772762.950102:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e5:0x0](ffff8de1c47121c8) 00000080:00200000:1.0:1775772762.950111:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e5:0x0](ffff8de1c4713a88) 00000080:00200000:1.0:1775772762.950118:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e6:0x0](ffff8de1c47142c8) 00000080:00200000:1.0:1775772762.950127:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e6:0x0](ffff8de1c47163c8) 00000080:00200000:1.0:1775772762.950137:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e7:0x0](ffff8de1c47280c8) 00000080:00200000:1.0:1775772762.950146:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e7:0x0](ffff8de1c472f448) 00000080:00200000:1.0:1775772762.950155:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e8:0x0](ffff8de1c47180c8) 00000080:00200000:1.0:1775772762.950164:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e8:0x0](ffff8de1c471f448) 00000080:00200000:1.0:1775772762.950173:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2e9:0x0](ffff8de1c471e3c8) 00000080:00200000:1.0:1775772762.950183:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2e9:0x0](ffff8de1c471d348) 00000080:00200000:1.0:1775772762.950191:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ea:0x0](ffff8de1c472c2c8) 00000080:00200000:1.0:1775772762.950201:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ea:0x0](ffff8de1c472a1c8) 00000080:00200000:1.0:1775772762.950210:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2eb:0x0](ffff8de1c47221c8) 00000080:00200000:1.0:1775772762.950219:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2eb:0x0](ffff8de1c4723a88) 00000080:00200000:1.0:1775772762.950228:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ec:0x0](ffff8de1c4732a08) 00000080:00200000:1.0:1775772762.950238:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ec:0x0](ffff8de1c4734b08) 00000080:00200000:1.0:1775772762.950246:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ed:0x0](ffff8de1c4726c08) 00000080:00200000:1.0:1775772762.950255:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ed:0x0](ffff8de1c4721148) 00000080:00200000:1.0:1775772762.950283:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ee:0x0](ffff8de1c472ec08) 00000080:00200000:1.0:1775772762.950297:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ee:0x0](ffff8de1c4729148) 00000080:00200000:1.0:1775772762.950306:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ef:0x0](ffff8de1c472aa08) 00000080:00200000:1.0:1775772762.950315:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ef:0x0](ffff8de1c472cb08) 00000080:00200000:1.0:1775772762.950324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f0:0x0](ffff8de1c4729988) 00000080:00200000:1.0:1775772762.950333:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f0:0x0](ffff8de1c472db88) 00000080:00200000:1.0:1775772762.950341:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f1:0x0](ffff8de1c471c2c8) 00000080:00200000:1.0:1775772762.950350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f1:0x0](ffff8de1c471a1c8) 00000080:00200000:1.0:1775772762.950360:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f2:0x0](ffff8de1c471b248) 00000080:00200000:1.0:1775772762.950369:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f2:0x0](ffff8de1c471ba88) 00000080:00200000:1.0:1775772762.950377:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f3:0x0](ffff8de1c4722a08) 00000080:00200000:1.0:1775772762.950385:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f3:0x0](ffff8de1c4724b08) 00000080:00200000:1.0:1775772762.950394:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f4:0x0](ffff8de1c4730908) 00000080:00200000:1.0:1775772762.950412:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f4:0x0](ffff8de1c47300c8) 00000080:00200000:1.0:1775772762.950421:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f5:0x0](ffff8de1c4725b88) 00000080:00200000:1.0:1775772762.950431:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f5:0x0](ffff8de1c4720908) 00000080:00200000:1.0:1775772762.950439:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f6:0x0](ffff8de1c472ba88) 00000080:00200000:1.0:1775772762.950449:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f6:0x0](ffff8de1c472b248) 00000080:00200000:1.0:1775772762.950458:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f7:0x0](ffff8de1c4719148) 00000080:00200000:1.0:1775772762.950467:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f7:0x0](ffff8de1c4719988) 00000080:00200000:1.0:1775772762.950477:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f8:0x0](ffff8de1c471cb08) 00000080:00200000:1.0:1775772762.950486:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f8:0x0](ffff8de1c471db88) 00000080:00200000:1.0:1775772762.950495:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2f9:0x0](ffff8de1c4728908) 00000080:00200000:1.0:1775772762.950504:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2f9:0x0](ffff8de1c472d348) 00000080:00200000:1.0:1775772762.950513:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2fa:0x0](ffff8de1c472e3c8) 00000080:00200000:1.0:1775772762.950522:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2fa:0x0](ffff8de1c473f448) 00000080:00200000:1.0:1775772762.950532:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2fb:0x0](ffff8de1c473e3c8) 00000080:00200000:1.0:1775772762.950540:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2fb:0x0](ffff8de1c473d348) 00000080:00200000:1.0:1775772762.950549:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2fc:0x0](ffff8de1c47363c8) 00000080:00200000:1.0:1775772762.953262:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2fc:0x0](ffff8de1c4735348) 00000080:00200000:1.0:1775772762.953318:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2fd:0x0](ffff8de1c473a1c8) 00000080:00200000:1.0:1775772762.953330:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2fd:0x0](ffff8de1c473ba88) 00000080:00200000:1.0:1775772762.953340:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2fe:0x0](ffff8de1c473c2c8) 00000080:00200000:1.0:1775772762.953351:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2fe:0x0](ffff8de1c473ec08) 00000080:00200000:1.0:1775772762.953361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x2ff:0x0](ffff8de1c471aa08) 00000080:00200000:1.0:1775772762.953886:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x2ff:0x0](ffff8de1c471ec08) 00000080:00200000:1.0:1775772762.953990:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x300:0x0](ffff8de1c47242c8) 00000080:00200000:1.0:1775772762.954004:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x300:0x0](ffff8de1c46f5348) 00000080:00200000:1.0:1775772762.954014:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x301:0x0](ffff8de1c4721988) 00000080:00200000:1.0:1775772762.954023:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x301:0x0](ffff8de1c4701148) 00000080:00200000:1.0:1775772762.954033:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x302:0x0](ffff8de1c4739988) 00000080:00200000:1.0:1775772762.954042:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x302:0x0](ffff8de1c473aa08) 00000080:00200000:1.0:1775772762.954051:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x303:0x0](ffff8de1c473db88) 00000080:00200000:1.0:1775772762.954059:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x303:0x0](ffff8de1c4738908) 00000080:00200000:1.0:1775772762.954067:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x304:0x0](ffff8de1c473cb08) 00000080:00200000:1.0:1775772762.954075:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x304:0x0](ffff8de1c47380c8) 00000080:00200000:1.0:1775772762.954084:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x305:0x0](ffff8de1c474ba88) 00000080:00200000:1.0:1775772762.954095:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x305:0x0](ffff8de1c474ec08) 00000080:00200000:1.0:1775772762.954105:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x306:0x0](ffff8de1c47400c8) 00000080:00200000:1.0:1775772762.954114:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x306:0x0](ffff8de1c4747448) 00000080:00200000:1.0:1775772762.954125:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x307:0x0](ffff8de1c4739148) 00000080:00200000:1.0:1775772762.954249:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x307:0x0](ffff8de1c4754b08) 00000080:00200000:1.0:1775772762.954264:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x308:0x0](ffff8de1c4755b88) 00000080:00200000:1.0:1775772762.954275:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x308:0x0](ffff8de1c4750908) 00000080:00200000:1.0:1775772762.954285:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x309:0x0](ffff8de1c4757448) 00000080:00200000:1.0:1775772762.954294:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x309:0x0](ffff8de1c47563c8) 00000080:00200000:1.0:1775772762.954304:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30a:0x0](ffff8de1c4755348) 00000080:00200000:1.0:1775772762.954313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30a:0x0](ffff8de1c4753248) 00000080:00200000:1.0:1775772762.954323:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30b:0x0](ffff8de1c4745348) 00000080:00200000:1.0:1775772762.954334:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30b:0x0](ffff8de1c4743248) 00000080:00200000:1.0:1775772762.954344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30c:0x0](ffff8de1c4749148) 00000080:00200000:1.0:1775772762.954355:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30c:0x0](ffff8de1c4749988) 00000080:00200000:1.0:1775772762.954365:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30d:0x0](ffff8de1c47542c8) 00000080:00200000:1.0:1775772762.955057:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30d:0x0](ffff8de1c47521c8) 00000080:00200000:1.0:1775772762.955081:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30e:0x0](ffff8de1c4756c08) 00000080:00200000:1.0:1775772762.955090:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30e:0x0](ffff8de1c4751148) 00000080:00200000:1.0:1775772762.955099:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x30f:0x0](ffff8de1c4751988) 00000080:00200000:1.0:1775772762.955108:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x30f:0x0](ffff8de1c4752a08) 00000080:00200000:1.0:1775772762.955117:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x310:0x0](ffff8de1c47500c8) 00000080:00200000:1.0:1775772762.955125:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x310:0x0](ffff8de1c4758908) 00000080:00200000:1.0:1775772762.955135:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x311:0x0](ffff8de1c474cb08) 00000080:00200000:1.0:1775772762.955225:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x311:0x0](ffff8de1c474db88) 00000080:00200000:1.0:1775772762.955236:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x312:0x0](ffff8de1c4748908) 00000080:00200000:1.0:1775772762.955246:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x312:0x0](ffff8de1c47480c8) 00000080:00200000:1.0:1775772762.955257:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x313:0x0](ffff8de1c47442c8) 00000080:00200000:1.0:1775772762.955267:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x313:0x0](ffff8de1c47421c8) 00000080:00200000:1.0:1775772762.955277:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x314:0x0](ffff8de1c474f448) 00000080:00200000:1.0:1775772762.955294:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x314:0x0](ffff8de1c474e3c8) 00000080:00200000:1.0:1775772762.955306:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x315:0x0](ffff8de1c475c2c8) 00000080:00200000:1.0:1775772762.955315:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x315:0x0](ffff8de1c475a1c8) 00000080:00200000:1.0:1775772762.955324:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x316:0x0](ffff8de1c474b248) 00000080:00200000:1.0:1775772762.955342:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x316:0x0](ffff8de1c474c2c8) 00000080:00200000:1.0:1775772762.955353:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x317:0x0](ffff8de1c4743a88) 00000080:00200000:1.0:1775772762.955361:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x317:0x0](ffff8de1c4746c08) 00000080:00200000:1.0:1775772762.955370:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x318:0x0](ffff8de1c4736c08) 00000080:00200000:1.0:1775772762.956274:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x318:0x0](ffff8de1c4731148) 00000080:00200000:1.0:1775772762.956296:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x319:0x0](ffff8de1c4733a88) 00000080:00200000:1.0:1775772762.956305:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x319:0x0](ffff8de1c47321c8) 00000080:00200000:1.0:1775772762.956316:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31a:0x0](ffff8de1c475ec08) 00000080:00200000:1.0:1775772762.956327:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31a:0x0](ffff8de1c4759148) 00000080:00200000:1.0:1775772762.956337:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31b:0x0](ffff8de1c4741148) 00000080:00200000:1.0:1775772762.956347:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31b:0x0](ffff8de1c4741988) 00000080:00200000:1.0:1775772762.956357:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31c:0x0](ffff8de1c474a1c8) 00000080:00200000:1.0:1775772762.956367:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31c:0x0](ffff8de1c474aa08) 00000080:00200000:0.0:1775772762.958287:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31d:0x0](ffff8de1c4742a08) 00000080:00200000:0.0:1775772762.958331:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31d:0x0](ffff8de1c4744b08) 00000080:00200000:0.0:1775772762.958344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31e:0x0](ffff8de1c474d348) 00000080:00200000:0.0:1775772762.958356:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31e:0x0](ffff8de1c47600c8) 00000080:00200000:0.0:1775772762.958367:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x31f:0x0](ffff8de1c4740908) 00000080:00200000:0.0:1775772762.961228:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x31f:0x0](ffff8de1c4745b88) 00000080:00200000:0.0:1775772762.961267:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x320:0x0](ffff8de1c4767448) 00000080:00200000:0.0:1775772762.961280:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x320:0x0](ffff8de1c47663c8) 00000080:00200000:0.0:1775772762.961290:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x321:0x0](ffff8de1c473b248) 00000080:00200000:0.0:1775772762.961302:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x321:0x0](ffff8de1c476b248) 00000080:00200000:0.0:1775772762.961313:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x322:0x0](ffff8de1c4765348) 00000080:00200000:0.0:1775772762.961323:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x322:0x0](ffff8de1c4763248) 00000080:00200000:0.0:1775772762.961333:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x323:0x0](ffff8de1c476a1c8) 00000080:00200000:0.0:1775772762.961344:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x323:0x0](ffff8de1c476ba88) 00000080:00200000:0.0:1775772762.961354:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x324:0x0](ffff8de1c475aa08) 00000080:00200000:0.0:1775772762.961368:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x324:0x0](ffff8de1c475cb08) 00000080:00200000:0.0:1775772762.962275:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x325:0x0](ffff8de1c475db88) 00000080:00200000:0.0:1775772762.962299:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x325:0x0](ffff8de1c4759988) 00000080:00200000:0.0:1775772762.962310:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x326:0x0](ffff8de1c475b248) 00000080:00200000:0.0:1775772762.962320:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x326:0x0](ffff8de1c475d348) 00000080:00200000:0.0:1775772762.962330:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x327:0x0](ffff8de1c475e3c8) 00000080:00200000:0.0:1775772762.962340:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x327:0x0](ffff8de1c475f448) 00000080:00200000:0.0:1775772762.962350:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x328:0x0](ffff8de1c4735b88) 00000080:00200000:0.0:1775772762.962365:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x328:0x0](ffff8de1c4733248) 00000080:00200000:0.0:1775772762.962647:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x329:0x0](ffff8de1c475ba88) 00000080:00200000:0.0:1775772762.963061:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x329:0x0](ffff8de1c4753a88) 00000080:00200000:0.0:1775772762.963078:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x32a:0x0](ffff8de1c4763a88) 00000080:00200000:0.0:1775772762.963090:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x32a:0x0](ffff8de1c4766c08) 00000080:00200000:0.0:1775772762.963100:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200025d90:0x32b:0x0](ffff8de1c4771148) 00000080:00200000:0.0:1775772762.963109:0:160097:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240001f59:0x32b:0x0](ffff8de1c4771988) 00000080:00200000:0.0:1775772762.963122:0:160097:0:(llite_lib.c:1541:ll_put_super()) VFS Op: cfg_instance lustre-client-ffff8de1c7943800 (sb ffff8de1c7943800) 00010000:00010000:0.0:1775772762.963263:0:160097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c512fc00/0x8a9f4e958445e62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da7cde expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963278:0:160097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c512fc00/0x8a9f4e958445e62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da7cde expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963291:0:160097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c512fc00/0x8a9f4e958445e62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3797d62297da7cde expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963298:0:160097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.137@tcp lock: ffff8de1c512fc00/0x8a9f4e958445e62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3797d62297da7cde expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963415:0:160097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1775772762.963424:0:160097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da7cd7 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963431:0:160097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da7cd7 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963436:0:160097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3797d62297da7cd7 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.963442:0:160097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3797d62297da7cd7 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772762.973219:0:160097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1775772762.973239:0:160097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3797d62297da7cd7 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1775772762.973271:0:160097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-cliir 00000020:00000080:0.0:1775772763.032327:0:123972:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8de1d1f84000 for lustre-OST0001-osc-ffff8de1c7943800 00000020:00000080:0.0:1775772763.032338:0:123972:0:(genops.c:904:class_export_put()) final put ffff8de1d1f87800/ca02a1e2-6d34-42cd-ba91-ef9776e58226 00000020:00000080:0.0:1775772763.032341:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1d1f87800/ca02a1e2-6d34-42cd-ba91-ef9776e58226 for lustre-OST0001-osc-ffff8de1c7943800 00000020:01000000:0.0:1775772763.032351:0:123972:0:(genops.c:440:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-ffff8de1c7943800 (ca02a1e2-6d34-42cd-ba91-ef9776e58226) 00000100:00100000:1.0:1775772763.033094:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2401:1862023612186496:192.168.201.137@tcp:9:umount.0 00000100:00080000:1.0:1775772763.040367:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1d1f82000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1775772763.040571:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2401:1862023612186496:192.168.201.137@tcp:9:umount.0 00000020:00000080:0.0:1775772763.041343:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1e0143800/LOV_OSC_UUID for lustre-OST0000-osc-ffff8de1c7943800 00000020:00000080:0.0:1775772763.042320:0:123972:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8de1d1f82000 for lustre-OST0000-osc-ffff8de1c7943800 00000020:00000080:0.0:1775772763.043777:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1e0140000/ca02a1e2-6d34-42cd-ba91-ef9776e58226 for lustre-clilov-ffff8de1c7943800 00000100:00100000:1.0:1775772763.049361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2401:1862023612187008:192.168.201.137@tcp:39:umount.0 00000100:00080000:1.0:1775772763.068485:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c944c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1775772763.069154:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2401:1862023612187008:192.168.201.137@tcp:39:umount.0 00000020:00000080:0.0:1775772763.077099:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1d215d800/ca02a1e2-6d34-42cd-ba91-ef9776e58226 for lustre-MDT0000-mdc-ffff8de1c7943800 00000100:00100000:1.0:1775772763.081116:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2401:1862023612187136:192.168.201.137@tcp:39:umount.0 00000100:00080000:1.0:1775772763.087913:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c61d9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1775772763.087953:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca02a1e2-6d34-42cd-ba91-ef9776e58226:2401:1862023612187136:192.168.201.137@tcp:39:umount.0 00000020:00000080:0.0:1775772763.090320:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1d215f800/ca02a1e2-6d34-42cd-ba91-ef9776e58226 for lustre-MDT0001-mdc-ffff8de1c7943800 00000020:00000080:0.0:1775772763.090334:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1d215e800/ca02a1e2-6d34-42cd-ba91-ef9776e58226 for lustre-clilmv-ffff8de1c7943800 00000020:00000080:1.0:1775772763.104901:0:160097:0:(obd_config.c:1468:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1775772763.104927:0:160097:0:(obd_config.c:881:class_detach()) detach on obd lustre-MDT0000-mdc-ffff8de1c7943800 (uuid ca02a1e2-6d34-42cd-ba91-ef9776e58226) 00000020:01000000:1.0:1775772763.104934:0:160097:0:(obd_config.c:2473:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdc-ffff8de1c7943800 (flags='') 00000020:00000080:1.0:1775772763.104941:0:160097:0:(obd_config.c:1468:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1775772763.104946:0:160097:0:(obd_config.c:953:class_cleanup()) lustre-MDT0001-mdc-ffff8de1c7943800: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1775772763.104953:0:160097:0:(genops.c:1577:class_disconnect_exports()) OBD device 4 (ffff8de1c55b3380) has no exports 00000008:01000000:1.0:1775772763.107212:0:160097:0:(obd_class.h:672:obd_cleanup_client_import()) lustre-MDT0001-mdc-ffff8de1c7943800: client import never connected 00000100:00080000:1.0:1775772763.107221:0:160097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1775772763.107227:0:160097:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1c7943800: committing for last_committed 17179869596 gen 3 00000100:00100000:1.0:1775772763.107238:0:160097:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1775772763.135976:0:160097:0:(obd_config.c:1468:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1775772763.135993:0:160097:0:(obd_config.c:881:class_detach()) detach on obd lustre-MDT0001-mdc-ffff8de1c7943800 (uuid ca02a1e2-6d34-42cd-ba91-ef9776e58226) 00000080:02000400:1.0:1775772763.135999:0:160097:0:(llite_lib.c:1586:ll_put_super()) Unmounted lustre-client 00000020:01000000:1.0:1775772763.143338:0:160097:0:(obd_config.c:1195:class_del_profile()) Del profile lustre-client 00000020:01000004:1.0:1775772763.143863:0:160097:0:(obd_mount.c:887:lustre_common_put_super()) dropping sb ffff8de1c7943800 00000100:00080000:1.0:1775772763.143875:0:160097:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import fb81e7b4-eadc-47ba-96a6-77277e1be7e5->MGS 00010000:00010000:1.0:1775772763.143897:0:160097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3797d62297da7cf3 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775772763.143912:0:160097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3797d62297da7cf3 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775772763.143920:0:160097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1775772763.143924:0:160097:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1775772763.143928:0:160097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1775772763.143982:0:160097:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3797d62297da7cf3 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772763.143989:0:160097:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1775772763.144013:0:160097:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0ee79c0 going to sleep for 0 seconds 00000100:00100000:1.0:1775772763.144026:0:160097:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job umount:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:160097:1862023612187264:192.168.201.137@tcp:103:umount.0 00010000:00010000:1.0:1775772763.144037:0:160097:0:(ldlm_request.c:1617:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:1.0:1775772763.144047:0:160097:0:(ldlm_request.c:2479:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:1.0:1775772763.144050:0:160097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9a00/0x8a9f4e958445e638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3797d62297da7cf3 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775772763.144317:0:160097:0:(import.c:65:import_set_state_nolock()) ffff8de1c3c62800 MGS: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1775772763.144351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2401:1862023612187392:192.168.201.137@tcp:251:umount.0 00000100:00080000:0.0:1775772763.172781:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3c62800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1775772763.172796:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1775772763.172800:0:2401:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1775772763.172802:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1775772763.172816:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb81e7b4-eadc-47ba-96a6-77277e1be7e5:2401:1862023612187392:192.168.201.137@tcp:251:umount.0 00000100:00080000:1.0:1775772763.175270:0:160097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1775772763.175280:0:160097:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1775772763.175287:0:160097:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1775772763.175291:0:160097:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1775772763.175310:0:160097:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x8a9f4e95843fd415 00000020:00000080:1.0:1775772763.175323:0:160097:0:(genops.c:904:class_export_put()) final put ffff8de1d334a000/fb81e7b4-eadc-47ba-96a6-77277e1be7e5 00000020:01000000:1.0:1775772763.175346:0:160097:0:(obd_config.c:2473:class_manual_cleanup()) Manual cleanup of MGC192.168.201.137@tcp (flags='') 00000020:00000080:1.0:1775772763.175356:0:160097:0:(obd_config.c:1468:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1775772763.175364:0:160097:0:(obd_config.c:953:class_cleanup()) MGC192.168.201.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1775772763.175369:0:160097:0:(genops.c:1577:class_disconnect_exports()) OBD device 0 (ffff8de1d33c0000) has no exports 10000000:01000000:1.0:1775772763.175811:0:15147:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1775772763.176028:0:160097:0:(obd_class.h:672:obd_cleanup_client_import()) MGC192.168.201.137@tcp: client import never connected 00000100:00080000:1.0:1775772763.176032:0:160097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1775772763.176034:0:160097:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1775772763.176037:0:160097:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1775772763.176040:0:160097:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1775772763.176117:0:160097:0:(obd_config.c:1468:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1775772763.176124:0:160097:0:(obd_config.c:881:class_detach()) detach on obd MGC192.168.201.137@tcp (uuid fb81e7b4-eadc-47ba-96a6-77277e1be7e5) 00000020:01000004:1.0:1775772763.176144:0:160097:0:(obd_mount.c:700:lustre_put_lsi()) put ffff8de1c7943800 1 00000020:01000004:1.0:1775772763.176148:0:160097:0:(obd_mount.c:658:lustre_free_lsi()) Freeing lsi ffff8de1c7941000 00000020:00000080:0.0:1775772763.197067:0:123972:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8de1c3c62800 for MGC192.168.201.137@tcp 00000020:00000080:0.0:1775772763.197081:0:123972:0:(genops.c:904:class_export_put()) final put ffff8de1c7944000/fb81e7b4-eadc-47ba-96a6-77277e1be7e5 00000020:00000080:0.0:1775772763.197085:0:123972:0:(genops.c:863:class_export_destroy()) destroying export ffff8de1c7944000/fb81e7b4-eadc-47ba-96a6-77277e1be7e5 for MGC192.168.201.137@tcp 00000020:01000000:0.0:1775772763.197092:0:123972:0:(genops.c:440:class_free_dev()) finishing cleanup of obd MGC192.168.201.137@tcp (fb81e7b4-eadc-47ba-96a6-77277e1be7e5) 00010000:00010000:0.0:1775772763.198461:0:115739:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1775772763.198739:0:135298:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1775772763.198900:0:15144:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1775772763.199051:0:33194:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:0.0:1775772763.201057:0:15145:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00010000:00010000:0.0:1775772763.201373:0:135299:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-6 blwis in pool) 00000100:00100000:0.0:1775772763.201626:0:33197:0:(service.c:3162:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8de1c30f2600:33197] 2 exiting: rc = 0 00000100:00100000:0.0:1775772763.201701:0:15135:0:(service.c:3162:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8de1c7fb8000:15135] 1 exiting: rc = 0 00000100:00100000:0.0:1775772763.201784:0:15134:0:(service.c:3162:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8de1c7fcec00:15134] 0 exiting: rc = 1 00000100:00100000:0.0:1775772763.273383:0:15138:0:(service.c:3162:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8de1c7fb8e00:15138] 0 exiting: rc = 1 00000100:00100000:0.0:1775772763.273457:0:15139:0:(service.c:3162:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8de1c7fb9a00:15139] 1 exiting: rc = 0 00000100:00100000:1.0:1775772763.274201:0:15140:0:(service.c:3162:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8de1c7fb9200:15140] 2 exiting: rc = 0 00000100:00100000:1.0:1775772763.280952:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.280963:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.280970:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.280978:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.280985:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.280992:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.280999:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281006:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281013:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281021:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281029:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281036:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281046:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281054:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281062:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281068:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281075:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281082:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281090:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281096:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281103:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281109:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281116:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281123:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281130:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281136:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281142:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281148:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281154:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281159:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281164:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281169:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281174:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281180:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281185:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281191:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281198:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281204:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281210:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281216:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281225:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281231:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281238:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281244:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281250:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281256:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281262:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281268:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281274:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281279:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281284:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281289:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281294:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281299:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281304:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281309:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281314:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281320:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281326:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281331:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281337:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281343:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281348:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281353:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281361:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281367:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281373:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281378:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281385:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281391:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281396:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281402:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281407:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281413:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281418:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281424:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281429:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281436:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281441:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281447:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281452:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281457:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281464:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281469:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281475:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281481:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281487:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281494:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281500:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281506:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.281511:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282838:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282859:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282864:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282869:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282874:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282880:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282886:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282895:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282901:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282906:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282914:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282920:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282926:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282932:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282938:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282944:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282949:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282954:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282960:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282965:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282970:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282977:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282983:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282988:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282993:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.282999:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283004:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283010:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283017:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283024:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283029:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283035:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283041:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283047:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283053:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283059:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1775772763.283065:0:123972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000004:1.0:1775772797.678494:0:160414:0:(obd_mount.c:913:lmd_print()) mount data: 00000020:01000004:1.0:1775772797.678498:0:160414:0:(obd_mount.c:915:lmd_print()) profile: lustre-client 00000020:01000004:1.0:1775772797.678499:0:160414:0:(obd_mount.c:916:lmd_print()) device: 192.168.201.137@tcp:/lustre 00000020:01000004:1.0:1775772797.678500:0:160414:0:(obd_mount.c:919:lmd_print()) options: user_xattr,flock 00000080:01200004:1.0:1775772797.678605:0:160414:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8de1e006a000 00000080:01000004:1.0:1775772797.678615:0:160414:0:(super25.c:167:lustre_fill_super()) Mounting client lustre-client 00000020:01000004:1.0:1775772797.678632:0:160414:0:(obd_mount.c:401:lustre_start_mgc()) Start MGC 'MGC192.168.201.137@tcp' 00000020:01000004:1.0:1775772797.678659:0:160414:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.137@tcp (typ=mgc) 00000020:00000080:1.0:1775772797.678670:0:160414:0:(genops.c:412:class_newdev()) Allocate new device MGC192.168.201.137@tcp (ffff8de1e005cd40) 00000020:00000080:1.0:1775772797.678682:0:160414:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type mgc with refcount 2 00000100:00100000:1.0:1775772797.678981:0:160414:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1775772797.679004:0:160414:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1775772797.679120:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 34 00000100:00100000:1.0:1775772797.679127:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1775772797.679559:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 34 00000100:00100000:1.0:1775772797.679565:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1775772797.680307:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_cbd[1] started 0 min 2 max 34 00000100:00100000:1.0:1775772797.680315:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cb01_000' 00000100:00100000:1.0:1775772797.680632:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_cbd[1] started 1 min 2 max 34 00000100:00100000:1.0:1775772797.680638:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cb01_001' 00000100:00100000:1.0:1775772797.681550:0:160414:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1775772797.682071:0:160414:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1775772797.682237:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 34 00000100:00100000:1.0:1775772797.682243:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1775772797.683033:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 34 00000100:00100000:1.0:1775772797.683041:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1775772797.686436:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_canceld[1] started 1 min 3 max 34 00000100:00100000:1.0:1775772797.686446:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cn01_001' 00000100:00100000:1.0:1775772797.687970:0:160414:0:(service.c:3441:ptlrpc_start_thread()) ldlm_canceld[1] started 2 min 3 max 34 00000100:00100000:1.0:1775772797.687981:0:160414:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cn01_002' 00010000:00080000:1.0:1775772797.689453:0:160414:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8de1e0069800@MGC192.168.201.137@tcp: add connection 192.168.201.137@tcp at head 00010000:00010000:1.0:1775772797.689600:0:160414:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.137@tcp-0 is initialized 00000040:01000000:1.0:1775772797.689609:0:160414:0:(llog_obd.c:195:llog_setup()) obd MGC192.168.201.137@tcp ctxt 1 is initialized 10000000:01000000:1.0:1775772797.690085:0:160428:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00100000:1.0:1775772797.690522:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612187520:192.168.201.137@tcp:250:mount.lustre.0 00000100:00100000:0.0:1775772797.714373:0:2401:0:(client.c:3082:ptlrpc_free_committed()) MGC192.168.201.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1775772797.714392:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.137@tcp: connect to target with instance 0 00000100:00080000:0.0:1775772797.714401:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.201.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1775772797.714407:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1775772797.714413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1775772797.714417:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1775772797.714469:0:2401:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00080000:0.0:1775772797.714483:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000325be44c): req@ffff8de1c7af5f80 x1862023612187648/t0(0) o101->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775772797.714501:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612187520:192.168.201.137@tcp:250:mount.lustre.0 00000100:00100000:0.0:1775772797.746213:0:160433:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160433:1862023612188288:192.168.201.137@tcp:502:llog_process_th.0 00000100:00100000:0.0:1775772797.746307:0:160433:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772797.844231:0:160414:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160414:1862023612189056:192.168.201.137@tcp:501:mount.lustre.0 00000100:00100000:1.0:1775772797.844315:0:160414:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c4dcf600 going to sleep for 11 seconds 00000100:00100000:0.0:1775772797.853522:0:160414:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160414:1862023612189056:192.168.201.137@tcp:501:mount.lustre.0 00000100:00100000:0.0:1775772797.853593:0:160414:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160414:1862023612189184:192.168.201.137@tcp:503:mount.lustre.0 00000100:00100000:0.0:1775772797.853676:0:160414:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b5000 going to sleep for 11 seconds 00000100:00100000:0.0:1775772797.859434:0:160414:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160414:1862023612189184:192.168.201.137@tcp:503:mount.lustre.0 00000020:01000000:1.0:1775772797.876986:0:160414:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1775772797.877016:0:160414:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1775772797.877040:0:160414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385c00/0x8a9f4e958445e6a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da8241 expref: -99 pid: 160414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772797.877053:0:160414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3385c00/0x8a9f4e958445e6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da8241 expref: -99 pid: 160414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:01000000:1.0:1775772797.877077:0:160414:0:(llite_lib.c:1468:ll_fill_super()) Found profile lustre-client: mdc=lustre-clilmv osc=lustre-clilov 00000020:00000080:1.0:1775772797.877101:0:160414:0:(genops.c:1404:class_connect()) connect: client 73a027f8-bfcb-4fff-aef1-8eea1b45c79e, cookie 0x8a9f4e958445e6af 00800000:01000000:1.0:1775772797.877120:0:160414:0:(lmv_obd.c:497:lmv_check_connect()) Time to connect 73a027f8-bfcb-4fff-aef1-8eea1b45c79e to lustre-clilmv-ffff8de1e006a000 00800000:01000000:1.0:1775772797.877126:0:160414:0:(lmv_obd.c:337:lmv_connect_mdc()) connect to lustre-MDT0000-mdc-ffff8de1e006a000(73a027f8-bfcb-4fff-aef1-8eea1b45c79e) - lustre-MDT0000_UUID, 73a027f8-bfcb-4fff-aef1-8eea1b45c79e 00000020:00000080:1.0:1775772797.877134:0:160414:0:(genops.c:1404:class_connect()) connect: client 73a027f8-bfcb-4fff-aef1-8eea1b45c79e, cookie 0x8a9f4e958445e6b6 00000100:00080000:1.0:1775772797.877146:0:160414:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:1.0:1775772797.877158:0:160414:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772797.877172:0:160414:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1775772797.877205:0:160414:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612189568/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775772797.877228:0:160414:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID 00800000:01000000:1.0:1775772797.877302:0:160414:0:(lmv_obd.c:394:lmv_connect_mdc()) Connected to lustre-MDT0000-mdc-ffff8de1e006a000(73a027f8-bfcb-4fff-aef1-8eea1b45c79e) successfully (5) 00800000:00000004:1.0:1775772797.877307:0:160414:0:(obd_class.h:1058:obd_statfs_async()) lustre-MDT0000-mdc-ffff8de1e006a000: age 7774, max_age 0 00800000:01000000:1.0:1775772797.877335:0:160414:0:(lmv_obd.c:337:lmv_connect_mdc()) connect to lustre-MDT0001-mdc-ffff8de1e006a000(73a027f8-bfcb-4fff-aef1-8eea1b45c79e) - lustre-MDT0001_UUID, 73a027f8-bfcb-4fff-aef1-8eea1b45c79e 00000020:00000080:1.0:1775772797.877341:0:160414:0:(genops.c:1404:class_connect()) connect: client 73a027f8-bfcb-4fff-aef1-8eea1b45c79e, cookie 0x8a9f4e958445e6bd 00000100:00080000:1.0:1775772797.877347:0:160414:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:1.0:1775772797.877352:0:160414:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772797.877357:0:160414:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1775772797.877368:0:160414:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14000 x1862023612189824/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775772797.877378:0:160414:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID 00800000:01000000:1.0:1775772797.877419:0:160414:0:(lmv_obd.c:394:lmv_connect_mdc()) Connected to lustre-MDT0001-mdc-ffff8de1e006a000(73a027f8-bfcb-4fff-aef1-8eea1b45c79e) successfully (5) 00800000:00000004:1.0:1775772797.877422:0:160414:0:(obd_class.h:1058:obd_statfs_async()) lustre-MDT0001-mdc-ffff8de1e006a000: age 7774, max_age 0 00000080:00000004:1.0:1775772797.877437:0:160414:0:(obd_class.h:1092:obd_statfs()) lustre-clilmv-ffff8de1e006a000: age 7774, max_age 8773 00800000:00000004:1.0:1775772797.877442:0:160414:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 7774, max_age 8773 00000100:00080000:1.0:1775772797.877459:0:160414:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c2e14a80 x1862023612190080/t0(0) o41->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772797.877470:0:160414:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c8379000 going to sleep for 0 seconds 00000100:00080000:1.0:1775772797.877503:0:2403:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c2e16a00 x1862023612189696/t0(0) o41->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772797.877517:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1775772797.877522:0:2403:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c2e17800 x1862023612189952/t0(0) o41->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772797.879013:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612189568:192.168.201.137@tcp:38:mount.lustre.0 00000100:00100000:1.0:1775772797.879128:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612189824:192.168.201.137@tcp:38:mount.lustre.0 00010000:00080000:1.0:1775772797.892323:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8de1c2e14380 x1862023612189568/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775772807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772797.892338:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 0 gen 1 00000100:00080000:1.0:1775772797.892349:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to target with instance 81 00000100:00080000:1.0:1775772797.892360:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-mdc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xae7a5e7be344d3b8 00000100:00080000:1.0:1775772797.892372:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1775772797.892376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1775772797.892664:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 0000000020ac792f): req@ffff8de1c2e14a80 x1862023612190080/t0(0) o41->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775772797.892681:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000fc65862e): req@ffff8de1c2e16a00 x1862023612189696/t0(0) o41->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772797.892695:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612189568:192.168.201.137@tcp:38:mount.lustre.0 00000100:00100000:1.0:1775772797.892712:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 0 gen 1 00000100:00080000:1.0:1775772797.892717:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to target with instance 5 00000100:00080000:1.0:1775772797.892746:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-mdc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xae7a5e7be344d3b8 00000100:00080000:1.0:1775772797.892751:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1775772797.892755:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1775772797.895588:0:160414:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c8379000 going to sleep for 11 seconds 00000100:00100000:1.0:1775772797.896170:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612189824:192.168.201.137@tcp:38:mount.lustre.0 00000100:00100000:1.0:1775772797.898073:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:0:1862023612189952:192.168.201.137@tcp:41:mount.lustre.0 00010000:00080000:1.0:1775772797.898093:0:2403:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8de1c2e16a00 x1862023612189696/t0(0) o41->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 1775772813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772797.898105:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:0:1862023612189696:192.168.201.137@tcp:41:mount.lustre.0 00000100:00100000:1.0:1775772797.901954:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612190336:192.168.201.137@tcp:8:mount.lustre.0 00000100:00100000:1.0:1775772797.902012:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612190464:192.168.201.137@tcp:8:mount.lustre.0 00000100:00080000:1.0:1775772797.906060:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775772797.906074:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:1.0:1775772797.906079:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612190336:192.168.201.137@tcp:8:mount.lustre.0 00000100:00100000:1.0:1775772797.906094:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1e006a000: committing for last_committed 0 gen 1 00000100:00080000:1.0:1775772797.906103:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8de1e006a000: connect to target with instance 1 00000100:00080000:1.0:1775772797.906112:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:1.0:1775772797.906124:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0465af2e3640038 -> 0xa0425af2e3440038 00000080:00080000:1.0:1775772797.906130:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:1.0:1775772797.906138:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1775772797.906140:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00020000:01000000:1.0:1775772797.906145:0:2401:0:(lov_obd.c:392:lov_set_osc_active()) Marking OSC lustre-OST0001_UUID active 00000080:00000004:1.0:1775772797.906146:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:1.0:1775772797.906149:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00100000:1.0:1775772797.906155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612190464:192.168.201.137@tcp:8:mount.lustre.0 00000100:00080000:1.0:1775772803.392370:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1775772803.392376:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775772803.392381:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772803.392393:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8774 00000100:00080000:1.0:1775772803.392407:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775772803.392415:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772803.392426:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1775772803.392445:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612191232/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772803.392516:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612190976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772803.392611:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612191360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772803.392642:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1775772803.392647:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612190848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772803.392690:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612191104:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772803.404652:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612191360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772803.404690:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612190848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772803.404708:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612191104:192.168.201.137@tcp:400:kworker.0 00010000:00080000:0.0:1775772803.405416:0:2402:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8de1c2e17800 x1862023612190976/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775772803.405433:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612190976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772804.511448:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:0.0:1775772804.513340:0:160415:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625018368 00000100:00100000:0.0:1775772804.513356:0:160415:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625018368 00000100:00100000:0.0:1775772804.513435:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 0 00000100:00100000:0.0:1775772804.513446:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:187722:x1862023625018368:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775772804.513466:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.137@tcp lock: ffff8de1d3385400/0x8a9f4e958445e6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297da823a expref: -99 pid: 160414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772804.513593:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775772804.513600:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:187722:x1862023625018368:12345-192.168.201.137@tcp:104: Request processed in 157us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1775772804.513608:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 0 10000000:01000000:0.0:1775772805.631934:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:0.0:1775772805.631944:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 336 10000000:01000000:0.0:1775772805.631952:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:0.0:1775772805.632013:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772805.632026:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772805.632038:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772805.632073:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612191616:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775772805.632349:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772805.643652:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612191616:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775772805.643687:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da82e2 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772805.643702:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da82e2 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772805.643830:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612191744:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1775772805.646633:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0ee7240 going to sleep for 11 seconds 00000100:00100000:1.0:1775772805.663547:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612191744:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:1.0:1775772805.663613:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:1.0:1775772805.663792:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:1.0:1775772805.663816:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da82e2 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772805.663828:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35600/0x8a9f4e958445e6d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da82e2 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772805.713170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612191872:192.168.201.137@tcp:8:lctl.0 00000100:02020000:0.0:1775772805.803029:0:2401:0:(client.c:1490:ptlrpc_check_status()) lustre-OST0000-osc-ffff8de1e006a000: operation ost_connect to node 192.168.201.137@tcp failed: rc = -16 00000100:00100000:0.0:1775772805.822947:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 0 gen 1 00000100:00080000:0.0:1775772805.822962:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775772805.822973:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-16) 00000100:00100000:0.0:1775772805.822979:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612191872:192.168.201.137@tcp:8:lctl.0 00000100:00080000:1.0:1775772808.511972:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1775772808.511979:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775772808.511984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772808.512001:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772808.512013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1775772808.512033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612192384/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772808.512100:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772808.512210:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772808.512243:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1775772808.512249:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612192000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772808.512278:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192256:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772808.518602:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612192000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772808.518705:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192256:192.168.201.137@tcp:400:kworker.0 00010000:00080000:1.0:1775772808.519128:0:2402:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c2e17480 x1862023612192128/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772808.519144:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772808.519164:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772813.632995:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772813.633128:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612192640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772813.633244:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612192896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772813.633277:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612193152:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772813.633537:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612193024:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772813.638226:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612193152:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772813.641207:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612192640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772813.644921:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612193024:192.168.201.137@tcp:400:kworker.0 00010000:00080000:0.0:1775772813.648853:0:2402:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c67d4000 x1862023612192768/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775772813.648875:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612192768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772813.648926:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612192896:192.168.201.137@tcp:400:kworker.0 00000080:00200000:1.0:1775772815.319292:0:160632:0:(file.c:1742:ll_merge_attr_nolock()) [0x200027cd1:0x1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1775772815.319299:0:160632:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8de1d1da2fe8 (ffff8de1c2cab248/0) at cl_lock_release():245 00000020:00010000:1.0:1775772815.319303:0:160632:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8de1d1da2fe8 (ffff8de1c2cab248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1775772815.319310:0:160632:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8de1ca3f4d30 (ffff8de1c2cab758/1) at cl_lock_cancel():142 00000020:00010000:1.0:1775772815.319315:0:160632:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8de1d1da2fe8 (ffff8de1c2cab248/0) at cl_lock_fini():72 00000020:00010000:1.0:1775772815.319318:0:160632:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8de1ca3f4d30 (ffff8de1c2cab248/1) at cl_lock_fini():72 00000080:00200000:1.0:1775772815.319362:0:160632:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0x1:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772815.319452:0:160632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772815.319965:0:160632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772815.319987:0:160632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772815.320006:0:160632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772815.320014:0:160632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772815.320022:0:160632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772815.320026:0:160632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e6f5 00000080:00010000:1.0:1775772815.320032:0:160632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e6f5 from it ffff9ba1c2853c10 00010000:00010000:1.0:1775772815.320036:0:160632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772815.320042:0:160632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772815.320056:0:160632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772815.320071:0:160632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f74.replay-single, flags=0 00000080:00200000:1.0:1775772815.320078:0:160632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772815.320085:0:160632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772815.320090:0:160632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772815.320098:0:160632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772815.320104:0:160632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772815.320109:0:160632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772815.320112:0:160632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e6f5 00000080:00010000:1.0:1775772815.320116:0:160632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e6f5 from it ffff9ba1c2853d68 00010000:00010000:1.0:1775772815.320119:0:160632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772815.320126:0:160632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 1 00000080:00200000:1.0:1775772815.320135:0:160632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775772815.320140:0:160632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f74.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:1.0:1775772815.320219:0:160632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1775772815.320404:0:160632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445e6fc lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da844e expref: -99 pid: 160632 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772815.320426:0:160632:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0x1:0x0]: losing layout lock 00010000:00010000:1.0:1775772815.320446:0:160632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445e6ee lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8424 expref: -99 pid: 160631 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772815.320699:0:160632:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0x1:0x0]: losing layout lock 00010000:00010000:1.0:1775772815.320972:0:160632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445e6fc lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da844e expref: -99 pid: 160632 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772815.320982:0:160632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445e6ee lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8424 expref: -99 pid: 160631 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772815.320990:0:160632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1775772815.320997:0:160632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1775772815.321001:0:160632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445e6fc lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da844e expref: -99 pid: 160632 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772815.321019:0:160632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445e6ee lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8424 expref: -99 pid: 160631 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772815.321037:0:160632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e6f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da8432 expref: -99 pid: 160632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 1 00000020:00100000:1.0:1775772815.321061:0:160632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772815.321075:0:160632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14e00 x1862023612195200/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772815.321106:0:160632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160632:1862023612195200:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772815.321325:0:160632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c8379600 going to sleep for 11 seconds 00000080:00200008:0.0:1775772817.146065:0:160660:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775772817.146078:0:160660:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772817.146102:0:160660:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772817.146166:0:160660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 160660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.146177:0:160660:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 160660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.146192:0:160660:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 160660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772817.146218:0:160660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195328:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772817.146333:0:160660:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772817.148919:0:160660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195328:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772817.148945:0:160660:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.148958:0:160660:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.148972:0:160660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.148986:0:160660:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.148998:0:160660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.149007:0:160660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.149015:0:160660:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772817.149038:0:160660:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d5c00 x1862023612195328/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772833 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772817.149052:0:160660:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.149066:0:160660:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1775772817.149072:0:160660:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772817.149098:0:160660:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:0.0:1775772817.149105:0:160660:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e70a 00000080:00010000:0.0:1775772817.149110:0:160660:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772817.149113:0:160660:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e70a from it ffff9ba1c27abcb8 00010000:00010000:0.0:1775772817.149116:0:160660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772817.149126:0:160660:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1775772817.150658:0:160660:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772817.150668:0:160660:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772817.150687:0:160660:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772817.154588:0:160660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772817.154613:0:160660:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772817.154624:0:160660:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772817.154636:0:160660:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772817.154639:0:160660:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e70a 00000080:00010000:0.0:1775772817.154646:0:160660:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e70a from it ffff9ba1c27abcb8 00010000:00010000:0.0:1775772817.154649:0:160660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772817.154656:0:160660:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772817.154839:0:160660:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772817.154852:0:160660:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772817.154858:0:160660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772817.154864:0:160660:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772817.154868:0:160660:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772817.154870:0:160660:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772817.154872:0:160660:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e70a 00000080:00010000:0.0:1775772817.154874:0:160660:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e70a from it ffff9ba1c27abbb0 00010000:00010000:0.0:1775772817.154876:0:160660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772817.154881:0:160660:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772817.154887:0:160660:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775772817.154893:0:160660:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775772817.154976:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.154989:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00800000:00000004:0.0:1775772817.154994:0:160660:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8774, max_age 8793 00000100:00100000:0.0:1775772817.155034:0:160660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195456:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772817.155106:0:160660:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772817.158464:0:160660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195456:192.168.201.137@tcp:41:lfs.0 00800000:00000004:0.0:1775772817.158495:0:160660:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317260/353529 objects 1023645/1024000 00000080:00200080:0.0:1775772817.158566:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.158582:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00800000:00000004:0.0:1775772817.158590:0:160660:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 7774, max_age 8793 00000100:00100000:0.0:1775772817.158644:0:160660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195584:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772817.158747:0:160660:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772817.161898:0:160660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195584:192.168.201.137@tcp:41:lfs.0 00800000:00000004:0.0:1775772817.161922:0:160660:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317350/353529 objects 1023722/1024000 00000080:00200080:0.0:1775772817.161973:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.161985:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.161991:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.161994:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.161998:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162000:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162002:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162004:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162007:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162009:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162011:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162013:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162015:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162017:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162020:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162022:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162025:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162026:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162028:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162030:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162033:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162035:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162037:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162039:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162041:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162043:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162045:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162047:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162048:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162050:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162053:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162055:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162057:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162059:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162061:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162062:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162064:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162066:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162067:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162069:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162071:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162073:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162076:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162078:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162080:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162081:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162083:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162085:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162086:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162088:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162090:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162092:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162093:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162097:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162101:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162105:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162110:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162114:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162118:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162123:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162126:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162130:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162134:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162138:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162141:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162144:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162148:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162151:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162154:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162157:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162162:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162165:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162171:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162176:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162181:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162185:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162190:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162195:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162200:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162204:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162209:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162215:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162219:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162223:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162228:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162248:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162254:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162258:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162261:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162347:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162353:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162357:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162362:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162366:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162370:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162373:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162377:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162380:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162384:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162387:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162391:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162395:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162400:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162404:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162408:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162412:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162416:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162420:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162423:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162425:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162427:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162429:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162431:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162433:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162435:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162436:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162438:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162440:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162442:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162443:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162445:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162448:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162451:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162454:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162458:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00800000:00000080:0.0:1775772817.162462:0:160660:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.162465:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.162471:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00020000:00000004:0.0:1775772817.162478:0:160660:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 7774, max_age 8793 00000100:00100000:0.0:1775772817.162520:0:160660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195712:192.168.201.137@tcp:13:lfs.0 00000100:00100000:0.0:1775772817.162584:0:160660:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772817.165077:0:160660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195712:192.168.201.137@tcp:13:lfs.0 00020000:00000004:0.0:1775772817.165117:0:160660:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:0.0:1775772817.165184:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.165202:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00020000:00000004:0.0:1775772817.165210:0:160660:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 7774, max_age 8793 00000100:00100000:0.0:1775772817.165257:0:160660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195840:192.168.201.137@tcp:13:lfs.0 00000100:00100000:0.0:1775772817.165529:0:160660:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772817.168481:0:160660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:160660:1862023612195840:192.168.201.137@tcp:13:lfs.0 00020000:00000004:0.0:1775772817.168518:0:160660:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:0.0:1775772817.168612:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168634:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168643:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168648:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168653:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168658:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168662:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168667:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168672:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168675:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168679:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168682:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168686:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168690:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168694:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168698:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168701:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168705:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168708:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168711:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:0.0:1775772817.168715:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:0.0:1775772817.168718:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bad800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169033:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169044:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169052:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169057:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169063:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169067:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169072:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169075:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169079:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169083:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169087:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169092:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169098:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169102:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169106:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169111:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169116:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169119:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169124:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169128:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169133:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169137:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169142:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169145:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169149:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169153:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169156:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169159:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169163:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169167:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169171:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169174:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169178:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169182:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169187:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169191:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169195:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169201:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169205:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169209:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169213:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169216:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169220:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169223:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169227:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169230:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169233:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169236:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169240:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169243:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169247:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169336:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169344:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169349:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169353:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169357:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169361:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169365:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169369:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169373:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169376:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169380:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169385:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169388:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169393:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169396:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169400:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169404:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169408:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169411:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169415:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169535:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169542:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169545:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169549:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169553:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169557:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169560:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169565:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169568:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169572:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169576:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169580:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169584:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169588:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169591:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169595:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169600:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169613:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169618:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169623:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169626:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169630:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169633:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169637:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169641:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169645:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169648:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169652:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169656:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169660:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169664:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200080:1.0:1775772817.169668:0:160660:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff9ac887c0 00020000:00000080:1.0:1775772817.169671:0:160660:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553a800 uarg=0000000000000000 00000080:00200008:1.0:1775772817.169690:0:160660:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000100:00100000:0.0:1775772818.753388:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772818.753474:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196352:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772818.753504:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775772818.753510:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612195968:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772818.753536:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772818.753555:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196480:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772818.755306:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196352:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772818.773880:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612195968:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772818.773915:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772818.780742:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772818.780764:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196480:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772820.874219:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772820.874286:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625027584 00000100:00100000:1.0:1775772820.874298:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625027584 00000100:00100000:1.0:1775772820.874361:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 1 00000100:00100000:1.0:1775772820.874372:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:173679:x1862023625027584:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772820.874393:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8de1e006a000 lock: 000000006d81b7eb/0x8a9f4e958445e703 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x3797d62297da8455 expref: -99 pid: 160632 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772820.874484:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772820.874491:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:173679:x1862023625027584:12345-192.168.201.137@tcp:104: Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772820.874499:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 1 00010000:00010000:0.0:1775772822.271948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772823.872989:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612196736:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.873082:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196992:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.873106:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612197248:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.873133:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1775772823.873138:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196864:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.873156:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612197120:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.876086:0:2403:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 347892350980 gen 1 00000100:00100000:0.0:1775772823.876125:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196864:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.876136:0:2403:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 38654705666 gen 1 00000100:00100000:0.0:1775772823.876145:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612197120:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.876155:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612196992:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772823.876164:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612197248:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772823.882749:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612196736:192.168.201.137@tcp:400:kworker.0 00000001:02000400:1.0:1775772823.959599:0:161250:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80a: DNE: create remote dir, drop update rep from MDT0, fail MDT0 ========================================================== 18:13:42 (1775772822) 00010000:00010000:0.0:1775772824.321457:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1775772824.365229:0:161263:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772824.365262:0:161263:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772824.365284:0:161263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772824.365301:0:161263:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772824.365310:0:161263:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772824.365318:0:161263:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772824.365321:0:161263:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e70a 00000080:00010000:0.0:1775772824.365328:0:161263:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e70a from it ffff9ba1c1d33b58 00010000:00010000:0.0:1775772824.365332:0:161263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772824.365341:0:161263:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e70a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da847f expref: -99 pid: 160660 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000080:00200000:0.0:1775772824.365363:0:161263:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772824.365377:0:161263:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80a.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=13 00000080:00200000:0.0:1775772824.365381:0:161263:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80a.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:0.0:1775772824.365395:0:161263:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80a.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772824.365451:0:161263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34400/0x8a9f4e958445e711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772824.365459:0:161263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34400/0x8a9f4e958445e711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772824.365468:0:161263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34400/0x8a9f4e958445e711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161263 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772824.365507:0:161263:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161263:1862023612197376:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772824.365744:0:161263:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0baecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772824.374306:0:161263:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6631600 going to sleep for 11 seconds 00000100:00100000:0.0:1775772825.464309:0:161272:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612197888:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772825.464353:0:161272:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464378:0:161272:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464387:0:161272:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464401:0:161272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464413:0:161272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464426:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464434:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464441:0:161272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772825.464454:0:161272:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8de1c7af4a80 x1862023612197888/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775772841 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772825.464479:0:161272:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464491:0:161272:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/2 (0 0) 00000080:00200000:0.0:1775772825.464498:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775772825.464534:0:161272:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x2:0x0], updating i_size 4096 00000080:00200000:0.0:1775772825.464538:0:161272:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0x2:0x0](ffff8de1c4081988): rc = 0 00000080:00010000:0.0:1775772825.464543:0:161272:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x2:0x0](ffff8de1c4081988) for lock 0x8a9f4e958445e71f 00000080:00010000:0.0:1775772825.464562:0:161272:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x2:0x0](ffff8de1c4081988) 00000080:00010000:0.0:1775772825.464566:0:161272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e71f from it ffff9ba1c16f3a28 00010000:00010000:0.0:1775772825.464569:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.464584:0:161272:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772825.464634:0:161272:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988), inode mode 41ed mask 1 00000080:00200000:0.0:1775772825.464664:0:161272:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x2:0x0](ffff8de1c4081988), flags=13 00000080:00200000:0.0:1775772825.464669:0:161272:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x2:0x0](ffff8de1c4081988), intent=getattr 00000002:00010000:0.0:1775772825.464695:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772825.465145:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.465154:0:161272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.465163:0:161272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772825.465193:0:161272:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198016:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772825.465289:0:161272:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0baecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772825.484764:0:161272:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198016:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772825.484793:0:161272:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484808:0:161272:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484817:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484830:0:161272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484839:0:161272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484846:0:161272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e34e00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775772825.484851:0:161272:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484859:0:161272:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484866:0:161272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484874:0:161272:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1775772825.484880:0:161272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.484886:0:161272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e726 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772825.484905:0:161272:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1c67d6a00 x1862023612198016/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775772841 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775772825.485123:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x2:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1775772825.485160:0:161272:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/2 (0 0) 00000080:00200000:0.0:1775772825.485260:0:161272:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772825.485280:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772825.485291:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.485304:0:161272:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772825.485312:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772825.485533:0:161272:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772825.485538:0:161272:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:0.0:1775772825.485549:0:161272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c16f3be8 00010000:00010000:0.0:1775772825.485554:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.485564:0:161272:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772825.496087:0:161272:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772825.496108:0:161272:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=16408 00000080:00200000:1.0:1775772825.496445:0:161272:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988), inode mode 41ed mask 1 00000080:00200000:1.0:1775772825.496479:0:161272:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x2:0x0](ffff8de1c4081988), flags=16392 00000080:00200000:1.0:1775772825.496486:0:161272:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x2:0x0](ffff8de1c4081988), intent=getattr 00000002:00010000:1.0:1775772825.496521:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772825.496589:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772825.496611:0:161272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772825.496622:0:161272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772825.497023:0:161272:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198144:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772825.499981:0:161272:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a000 going to sleep for 11 seconds 00000100:00100000:0.0:1775772825.508965:0:161272:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198144:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772825.508994:0:161272:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509009:0:161272:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509016:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509024:0:161272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509035:0:161272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509041:0:161272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b9400 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775772825.509046:0:161272:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509053:0:161272:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509060:0:161272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509068:0:161272:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1775772825.509075:0:161272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509081:0:161272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e72d lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772825.509097:0:161272:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1c2e15180 x1862023612198144/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775772841 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775772825.509115:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x2:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1775772825.509147:0:161272:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/2 (0 0) 00000080:00200000:0.0:1775772825.509236:0:161272:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772825.509255:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772825.509266:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772825.509284:0:161272:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772825.509291:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772825.509297:0:161272:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772825.509300:0:161272:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:0.0:1775772825.509306:0:161272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c16f3b58 00010000:00010000:0.0:1775772825.509310:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772825.509318:0:161272:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772825.509332:0:161272:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772825.509341:0:161272:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=13 00000080:00200008:0.0:1775772825.509352:0:161272:0:(file.c:6226:ll_getattr_dentry()) START file d80a.replay-single:[0x200027cd1:0x2:0x0](ffff8de1c4081988), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772825.509356:0:161272:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988),name=d80a.replay-single 00000002:00010000:0.0:1775772825.509370:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x2:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772825.509375:0:161272:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/2 (0 0) 00010000:00010000:0.0:1775772825.509414:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509421:0:161272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.509431:0:161272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772825.509473:0:161272:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198272:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772825.509981:0:161272:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0baecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772825.524036:0:161272:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198272:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772825.524062:0:161272:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524082:0:161272:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524091:0:161272:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524103:0:161272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524115:0:161272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524127:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524137:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524145:0:161272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772825.524163:0:161272:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d6a00 x1862023612198272/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772841 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772825.524177:0:161272:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524186:0:161272:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/2 (0 0) 00000080:00200000:0.0:1775772825.524192:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772825.524222:0:161272:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x2:0x0], updating i_size 4096 00000080:00010000:0.0:1775772825.524229:0:161272:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x2:0x0](ffff8de1c4081988) for lock 0x8a9f4e958445e734 00000080:00010000:0.0:1775772825.524238:0:161272:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x2:0x0](ffff8de1c4081988) 00000080:00010000:0.0:1775772825.524242:0:161272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e734 from it ffff9ba1c16f3cb8 00010000:00010000:0.0:1775772825.524245:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.524255:0:161272:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1775772825.526263:0:161272:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772825.526273:0:161272:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772825.526298:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772825.526315:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772825.530351:0:161272:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772825.530374:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772825.530385:0:161272:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772825.530390:0:161272:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:0.0:1775772825.530401:0:161272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c16f3cb8 00010000:00010000:0.0:1775772825.530405:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772825.530416:0:161272:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775772825.531441:0:161272:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772825.531513:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772825.531534:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772825.531548:0:161272:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775772825.531557:0:161272:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772825.531563:0:161272:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772825.531566:0:161272:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:0.0:1775772825.531572:0:161272:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c16f3bf8 00010000:00010000:0.0:1775772825.531576:0:161272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772825.531585:0:161272:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1775772825.531608:0:161272:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772825.531619:0:161272:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=267 00000080:00200000:0.0:1775772825.531628:0:161272:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988), inode mode 41ed mask 44 00000080:00200008:0.0:1775772825.531638:0:161272:0:(file.c:1057:ll_file_open()) START file d80a.replay-single:[0x200027cd1:0x2:0x0](ffff8de1c4081988), flags 300000 00000002:00010000:0.0:1775772825.533122:0:161272:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x2:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0240300001 00010000:00010000:0.0:1775772825.533197:0:161272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e73b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772825.533209:0:161272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e73b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775772825.533224:0:161272:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775772825.533239:0:161272:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6a00 x1862023612198528/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775772825.533251:0:161272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e73b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772825.533276:0:161272:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161272:1862023612198528:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772825.536205:0:161272:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0baecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772825.566574:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772825.566644:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625030400 00000100:00100000:1.0:1775772825.566667:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625030400 00000100:00100000:0.0:1775772825.566788:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 2 00000100:00100000:0.0:1775772825.566806:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625030400:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775772825.566834:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.566926:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775772825.566935:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625030400:12345-192.168.201.137@tcp:104: Request processed in 135us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1775772825.566945:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 2 00010000:00010000:0.0:1775772825.566979:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775772825.566987:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.566995:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e35200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775772825.567001:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.567011:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.567019:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.567049:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445e71f lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84da expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772825.567097:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.567105:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775772825.567140:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.567149:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35200/0x8a9f4e958445e734 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da8512 expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772825.567167:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772825.567170:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772825.567171:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772825.567186:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612199040:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1775772825.582833:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612199040:192.168.201.137@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1775772826.650616:0:161288:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772826.650655:0:161288:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772826.650675:0:161288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1775772826.650694:0:161288:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:1.0:1775772826.650703:0:161288:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772826.650715:0:161288:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772826.650719:0:161288:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:1.0:1775772826.650966:0:161288:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c1bcbbd0 00010000:00010000:1.0:1775772826.650971:0:161288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1775772826.650981:0:161288:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:1.0:1775772826.650998:0:161288:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772826.651020:0:161288:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=1536 00000080:00200000:1.0:1775772826.651025:0:161288:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772826.651033:0:161288:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772826.651041:0:161288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1775772826.651049:0:161288:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:1.0:1775772826.651055:0:161288:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772826.651059:0:161288:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772826.651062:0:161288:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:1.0:1775772826.651065:0:161288:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c1bcbcd0 00010000:00010000:1.0:1775772826.651068:0:161288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1775772826.651076:0:161288:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:1.0:1775772826.651085:0:161288:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775772826.651091:0:161288:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772826.651097:0:161288:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772826.651103:0:161288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1775772826.651111:0:161288:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:1.0:1775772826.651118:0:161288:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772826.651122:0:161288:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772826.651125:0:161288:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e718 00000080:00010000:1.0:1775772826.651128:0:161288:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e718 from it ffff9ba1c1bcbdb0 00010000:00010000:1.0:1775772826.651130:0:161288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1775772826.651137:0:161288:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:1.0:1775772826.651144:0:161288:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775772826.651149:0:161288:0:(namei.c:2106:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=33188, excl=1 00000080:00200000:1.0:1775772826.651153:0:161288:0:(namei.c:2061:ll_mknod()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) mode 100644 dev 0 00010000:00010000:1.0:1775772826.651187:0:161288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1775772826.651487:0:161288:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1775772826.651496:0:161288:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772826.651499:0:161288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da84be expref: -99 pid: 161272 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000020:00100000:1.0:1775772826.651532:0:161288:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772826.651547:0:161288:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e17b80 x1862023612199808/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772826.651576:0:161288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161288:1862023612199808:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:1.0:1775772826.651680:0:161288:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636ac00 going to sleep for 11 seconds 00010000:00010000:0.0:1775772827.392474:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772828.992298:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612200448:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772828.992767:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775772828.992776:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612200576:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772828.997067:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612200576:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772828.997087:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612200448:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772829.001239:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612200832:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772829.001462:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1775772829.001472:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612200704:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772829.001503:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612200960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772829.018967:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612200704:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772829.031509:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612200832:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772829.031552:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612200960:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772829.440029:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772834.115448:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201216:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772834.115573:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201472:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772834.115610:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775772834.115616:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612201088:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772834.115650:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201344:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772834.115673:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201600:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772834.119621:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612201088:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772834.119646:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201344:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772834.119658:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201600:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772834.119671:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201216:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772834.119680:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201472:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.232373:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612201728:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.232502:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201984:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.232533:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612202240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.232566:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1775772839.232573:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201856:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.232598:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612202112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.239896:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201984:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.239921:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612202240:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772839.239961:0:2403:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff8de1e006a000 of lustre-MDT0000_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1775772839.239968:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1775772839.239972:0:2403:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection to lustre-MDT0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1775772839.260180:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772839.260199:0:2403:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8774 00000100:00080000:1.0:1775772839.260229:0:2403:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772839.260245:0:2403:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772839.260286:0:2403:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16300 x1862023612202368/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772839.260327:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612201856:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772839.260370:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612202112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772844.353453:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612202624:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775772844.358203:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775772844.358232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:1.0:1775772844.358238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612202624:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775772849.472012:0:160101:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775772849.472019:0:160101:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775772849.472023:0:160101:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775772849.472062:0:160101:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8821 00000100:00100000:1.0:1775772849.472062:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612203136:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775772849.472078:0:160101:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1775772849.472085:0:160101:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775772849.472098:0:160101:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775772849.472115:0:160101:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c67d4e00 x1862023612203264/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775772849.472162:0:160101:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1775772849.472165:0:160101:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8de1e006a000: disconnect after 23s idle 00000100:00080000:0.0:1775772849.472174:0:160101:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1775772849.472176:0:160101:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8de1e006a000: disconnect after 23s idle 00000100:00100000:1.0:1775772849.472176:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775772849.472182:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612203392:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772849.474488:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612203392:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772854.592828:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772854.592836:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775772854.592840:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772854.592851:0:151211:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8826 00000100:00080000:1.0:1775772854.592865:0:151211:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1775772854.592872:0:151211:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772854.592887:0:151211:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772854.592905:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16d80 x1862023612203904/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772854.593052:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612204032:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772854.593142:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775772854.593153:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612203776:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772854.610308:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612204032:192.168.201.137@tcp:400:kworker.0 00000100:00000400:1.0:1775772855.622282:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775772839/real 1775772839] req@ffff8de1c67d7480 x1862023612201728/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775772855 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772855.659382:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c67d7480 x1862023612201728/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775772855 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775772855.659398:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1775772855.659402:0:2403:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.137@tcp: Connection to MGS (at 192.168.201.137@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1775772855.687944:0:2403:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.201.137@tcp for MGC192.168.201.137@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1775772855.687948:0:2403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1775772855.687957:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c67d7480 x1862023612201728/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775772855 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772855.687969:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d01eed80 x1862023612202496/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775772860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772855.687988:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c67d7b80 x1862023612203136/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775772865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772855.688001:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c2e15880 x1862023612203776/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775772870 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1775772855.688011:0:2403:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1775772855.688014:0:2403:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1775772855.688015:0:2403:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1775772855.688017:0:2403:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1775772855.690979:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612203136:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772855.691034:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612203776:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772855.691040:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612201728:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772860.736567:0:160101:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772860.736576:0:160101:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775772860.736579:0:160101:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772860.736583:0:160101:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775772860.736589:0:160101:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772860.736598:0:160101:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8832 00000100:00080000:1.0:1775772860.736610:0:160101:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775772860.736616:0:160101:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772860.736628:0:160101:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772860.736664:0:160101:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612204544/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775772860.736817:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612204672:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772860.741081:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612204672:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772865.858016:0:160101:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772865.858025:0:160101:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775772865.858028:0:160101:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772865.858031:0:160101:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775772865.858036:0:160101:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772865.858046:0:160101:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8837 00000100:00080000:1.0:1775772865.858057:0:160101:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775772865.858064:0:160101:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772865.858081:0:160101:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772865.858116:0:160101:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16d80 x1862023612204800/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775772865.859218:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612204928:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772865.861253:0:160101:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772865.861258:0:160101:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775772865.861261:0:160101:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772865.861266:0:160101:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 8832 00000100:00080000:1.0:1775772865.861272:0:160101:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775772865.861279:0:160101:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775772865.861305:0:160101:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15f80 x1862023612205056/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775772865.870636:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612204928:192.168.201.137@tcp:400:kworker.0 10000000:01000000:1.0:1775772867.008786:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:1.0:1775772867.008797:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 337 10000000:01000000:1.0:1775772867.008804:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:1.0:1775772867.008886:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.008901:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.008915:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772867.008953:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205184:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.009467:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772867.040139:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205184:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1775772867.040181:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86d9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.040199:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da86d9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772867.040309:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205312:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1775772867.040423:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772867.061272:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205312:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:0.0:1775772867.061351:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1775772867.061486:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1775772867.061520:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1775772867.066379:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:0.0:1775772867.066491:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:0.0:1775772867.066505:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86d9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.066518:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86d9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1775772867.066529:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1775772867.066533:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-client-ffff8de1e006a000 from 52 10000000:01000000:0.0:1775772867.066536:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1775772867.068332:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.068354:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.068369:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772867.068410:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205440:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775772867.068531:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772867.081664:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205440:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775772867.081706:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.081755:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772867.081872:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205568:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.081975:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a540 going to sleep for 11 seconds 00000100:00100000:1.0:1775772867.093220:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205568:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.093294:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205696:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.093398:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a540 going to sleep for 11 seconds 00000100:00100000:1.0:1775772867.106234:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205696:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1775772867.108982:0:161600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1775772867.109787:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1775772867.109821:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1775772867.109837:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.109853:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1775772867.109866:0:160428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1775772867.109870:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log params-ffff8de1e006a000 from 7 10000000:01000000:0.0:1775772867.109873:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1775772867.109933:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.109942:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772867.109960:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772867.109997:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205824:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775772867.110459:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772867.116054:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205824:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775772867.116084:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.116097:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772867.116180:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205952:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.116260:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a840 going to sleep for 11 seconds 00000100:00100000:1.0:1775772867.124565:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612205952:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.124633:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612206080:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.124713:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a840 going to sleep for 11 seconds 00000100:00100000:1.0:1775772867.128391:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612206080:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1775772867.134230:0:161605:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1775772867.134274:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1775772867.134286:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1775772867.134296:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.134305:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775772867.134311:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1775772867.134313:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-sptlrpc-ffff8de1e005cd40 from 1 10000000:01000000:1.0:1775772867.134314:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1775772867.134347:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9200/0x8a9f4e958445e765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.134356:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9200/0x8a9f4e958445e765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772867.134366:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9200/0x8a9f4e958445e765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772867.134394:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612206208:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775772867.134598:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a840 going to sleep for 11 seconds 00000100:00080000:1.0:1775772867.135720:0:161604:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 8, was 0): DISCONN 00010000:00080000:1.0:1775772867.135776:0:161604:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c3008000@lustre-MDT0000-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00000100:00080000:1.0:1775772867.135782:0:161604:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772867.135789:0:161604:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:1.0:1775772867.135797:0:161604:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772867.135807:0:161604:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772867.135829:0:161604:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612206336/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772867.135864:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612206336:192.168.201.137@tcp:38:lctl.0 00010000:00080000:1.0:1775772867.154120:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c2e14e00 x1862023612206336/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775772877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'lctl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775772867.154142:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to target with instance 82 00000100:00080000:1.0:1775772867.154161:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1775772867.154167:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1775772867.154171:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 347892350982 gen 1 00000100:00100000:1.0:1775772867.154176:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1c2e17b80 x1862023612199808/t347892350984(347892350984) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775772842 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775772867.154184:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 347892350982 last 0 00000100:00080000:1.0:1775772867.154192:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1c67d6a00 x1862023612198528/t347892350982(347892350982) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772841 ref 1 fl New:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1775772867.154206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612206336:192.168.201.137@tcp:38:lctl.0 00000100:00100000:1.0:1775772867.154249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612198528:192.168.201.137@tcp:101:lfs.0 00000100:00080000:1.0:1775772870.975986:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level REPLAY/5 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772870.975992:0:151211:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY) 00000100:00100000:1.0:1775772870.976029:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612206592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772870.976131:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775772870.976139:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612206720:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772870.996229:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612206720:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772870.996243:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612206592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772871.631178:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612200320:192.168.201.137@tcp:36:rm.0 00000100:02000000:1.0:1775772871.642168:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00100000:1.0:1775772871.642176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612206848:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000080:00200008:0.0:1775772874.813624:0:161695:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775772874.813636:0:161695:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772874.813659:0:161695:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772874.813718:0:161695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772874.813749:0:161695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772874.813758:0:161695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161695 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772874.813783:0:161695:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161695:1862023612207616:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772874.814499:0:161695:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6631600 going to sleep for 63 seconds 00000100:00100000:1.0:1775772874.825845:0:161695:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161695:1862023612207616:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775772874.825872:0:161695:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825894:0:161695:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825907:0:161695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825917:0:161695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825938:0:161695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825951:0:161695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825958:0:161695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772874.825970:0:161695:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d6d80 x1862023612207616/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772942 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772874.825982:0:161695:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.825995:0:161695:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1775772874.826001:0:161695:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775772874.826028:0:161695:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:1.0:1775772874.826034:0:161695:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:1.0:1775772874.826039:0:161695:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772874.826043:0:161695:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c0d17cb8 00010000:00010000:1.0:1775772874.826046:0:161695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772874.826054:0:161695:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1775772874.829481:0:161695:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772874.829490:0:161695:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772874.829513:0:161695:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772874.829529:0:161695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772874.829545:0:161695:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772874.829553:0:161695:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772874.829560:0:161695:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772874.829563:0:161695:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:0.0:1775772874.829570:0:161695:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c0d17cb8 00010000:00010000:0.0:1775772874.829573:0:161695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772874.829581:0:161695:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772874.830351:0:161695:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772874.830364:0:161695:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772874.830374:0:161695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772874.830385:0:161695:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772874.830393:0:161695:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772874.830397:0:161695:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772874.830400:0:161695:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:0.0:1775772874.830404:0:161695:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c0d17bb0 00010000:00010000:0.0:1775772874.830407:0:161695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772874.830415:0:161695:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772874.830425:0:161695:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775772874.830434:0:161695:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775772874.830527:0:161695:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff6b638190 00800000:00000080:0.0:1775772874.830543:0:161695:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a66c00 uarg=0000000000000000 00800000:00000004:0.0:1775772874.830550:0:161695:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8803, max_age 8850 00000100:00100000:0.0:1775772874.830605:0:161695:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:161695:1862023612207744:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772874.832317:0:161695:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6631540 going to sleep for 63 seconds 00000100:00100000:1.0:1775772874.855494:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612208000:192.168.201.137@tcp:8:lfs.0 00000100:00100000:0.0:1775772874.886344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612208256:192.168.201.137@tcp:8:lfs.0 00000100:00100000:0.0:1775772883.266473:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612209152:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.266701:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612209280:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.266806:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612209408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.266881:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612209536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.266951:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612209664:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.316348:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612209152:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.320884:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612209536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.320901:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612209280:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.320941:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612209664:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772883.320952:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612209408:192.168.201.137@tcp:400:kworker.0 00000080:00200008:0.0:1775772886.418449:0:162143:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775772886.418468:0:162143:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772886.418492:0:162143:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772886.418511:0:162143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772886.418525:0:162143:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772886.418532:0:162143:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772886.418539:0:162143:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772886.418543:0:162143:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:0.0:1775772886.418549:0:162143:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c0d93cb8 00010000:00010000:0.0:1775772886.418553:0:162143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772886.418562:0:162143:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1775772886.419160:0:162143:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772886.419165:0:162143:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772886.419175:0:162143:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772886.419184:0:162143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772886.419201:0:162143:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775772886.419209:0:162143:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772886.419213:0:162143:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772886.419216:0:162143:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:0.0:1775772886.419220:0:162143:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c0d93cb8 00010000:00010000:0.0:1775772886.419223:0:162143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772886.419230:0:162143:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775772886.419318:0:162143:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772886.419327:0:162143:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772886.419334:0:162143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775772886.419342:0:162143:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775772886.419348:0:162143:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772886.419352:0:162143:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772886.419355:0:162143:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:0.0:1775772886.419358:0:162143:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c0d93bb0 00010000:00010000:0.0:1775772886.419361:0:162143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775772886.419369:0:162143:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1775772886.419377:0:162143:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775772886.419395:0:162143:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775772886.419479:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00800000:00000080:0.0:1775772886.419493:0:162143:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64000 uarg=0000000000000000 00800000:00000004:0.0:1775772886.419500:0:162143:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8851, max_age 8862 00000100:00100000:0.0:1775772886.419542:0:162143:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162143:1862023612209792:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772886.419627:0:162143:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5ca33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772886.427065:0:162143:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162143:1862023612209792:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775772886.427097:0:162143:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317249/353529 objects 1023641/1024000 00000080:00200080:1.0:1775772886.427194:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00800000:00000080:1.0:1775772886.427215:0:162143:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00800000:00000004:1.0:1775772886.427224:0:162143:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 8851, max_age 8862 00000100:00100000:1.0:1775772886.427266:0:162143:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162143:1862023612209920:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775772886.427344:0:162143:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a780 going to sleep for 11 seconds 00000080:00200080:1.0:1775772886.461824:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461851:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461861:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461865:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461869:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461872:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461876:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461879:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461883:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461886:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461890:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461894:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461897:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461900:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461904:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461907:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461910:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461914:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461917:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461921:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461924:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461927:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461931:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461934:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461938:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461941:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461944:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461947:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461951:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461955:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461959:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461962:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461965:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461968:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461972:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461975:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461978:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461982:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461985:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461988:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461992:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.461995:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.461998:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462001:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462005:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462008:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462012:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462015:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462019:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462022:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462026:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462029:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462032:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462035:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462039:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462042:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462046:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462049:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462052:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462055:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462059:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462062:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462066:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462070:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462073:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462077:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462081:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462085:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462088:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462092:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462095:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462099:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462113:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462117:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462122:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462125:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462128:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462131:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462135:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462138:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462142:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462145:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462149:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462152:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462156:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462159:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462162:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462166:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462169:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462172:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462176:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462179:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462182:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462186:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462189:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462192:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462196:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462199:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462203:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462206:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200080:1.0:1775772886.462209:0:162143:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff386da6a0 00020000:00000080:1.0:1775772886.462213:0:162143:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c5538c00 uarg=0000000000000000 00000080:00200008:1.0:1775772886.462227:0:162143:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000100:00100000:0.0:1775772886.593411:0:162160:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162160:1862023612211200:192.168.201.137@tcp:35:lfs.0 00000002:00100000:0.0:1775772886.593466:0:162160:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ee300 x1862023612210944/t21474837286(21474837286) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772902 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1775772886.651002:0:162165:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612211456:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772886.651038:0:162165:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651078:0:162165:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651088:0:162165:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651101:0:162165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651118:0:162165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651135:0:162165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651144:0:162165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651151:0:162165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772886.651167:0:162165:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ece00 x1862023612211456/t21474837288(21474837288) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/664 e 0 to 0 dl 1775772902 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772886.651182:0:162165:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ece00 x1862023612211456/t21474837288(21474837288) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/664 e 0 to 0 dl 1775772902 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772886.651618:0:162165:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772886.651637:0:162165:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.651652:0:162165:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/2 (0 0) 00000080:00200000:1.0:1775772886.651660:0:162165:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772886.651678:0:162165:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-0, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08), intent=open|creat 00000080:00200000:1.0:1775772886.651763:0:162165:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x2:0x0](ffff8de1c403b248) 00000080:00200000:1.0:1775772886.651925:0:162165:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x2:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772886.651939:0:162165:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x2:0x0](ffff8de1c403b248) 00000080:00010000:1.0:1775772886.651943:0:162165:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2:0x0](ffff8de1c403b248) for lock 0x8a9f4e958445e788 00000080:00010000:1.0:1775772886.651957:0:162165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2:0x0](ffff8de1c403b248) 00000080:00200008:1.0:1775772886.651974:0:162165:0:(file.c:1057:ll_file_open()) START file f-0:[0x240002729:0x2:0x0](ffff8de1c403b248), flags 100102 00000002:00100000:1.0:1775772886.652000:0:162165:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ece00 x1862023612211456/t21474837288(21474837288) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772902 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772886.652251:0:162165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e788 from it ffff8de1c7ceec00 00010000:00010000:1.0:1775772886.652268:0:162165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.652286:0:162165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385000/0x8a9f4e958445e788 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da8a59 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772886.652320:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2:0x0](ffff8de1c403b248), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772886.652356:0:162165:0:(file.c:447:ll_file_release()) START file f-0:[0x240002729:0x2:0x0](ffff8de1c403b248), flags 100002 00000002:00100000:1.0:1775772886.652422:0:162165:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ece00 x1862023612211456/t21474837288(21474837288) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772902 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772886.652445:0:162165:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772886.652451:0:162165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14000 x1862023612211712/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772886.652481:0:162165:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612211712:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772886.652605:0:162165:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a000 going to sleep for 11 seconds 00000100:00100000:1.0:1775772886.661515:0:162165:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612211712:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772886.661554:0:162165:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ece00 x1862023612211456/t21474837288(21474837288) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772902 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772886.661871:0:162165:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772886.661889:0:162165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772886.661907:0:162165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1775772886.661921:0:162165:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:1.0:1775772886.661930:0:162165:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772886.661937:0:162165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772886.661940:0:162165:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:1.0:1775772886.661946:0:162165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c1ddbbf8 00010000:00010000:1.0:1775772886.661950:0:162165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1775772886.661958:0:162165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:1.0:1775772886.661973:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772886.661979:0:162165:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=25 00000080:00200000:1.0:1775772886.661985:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988), inode mode 41ed mask 1 00000080:00200000:1.0:1775772886.661988:0:162165:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772886.661991:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772886.662001:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:1.0:1775772886.662006:0:162165:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-1, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08), file ffff8de1e0161800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772886.662013:0:162165:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-1, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08), intent=open|creat 00000002:00010000:1.0:1775772886.662033:0:162165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-1,[0x240002729:0x3:0x0]) in obj [0x240002729:0x1:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772886.662085:0:162165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 162165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.662093:0:162165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162165 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772886.662103:0:162165:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772886.662110:0:162165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16a00 x1862023612211968/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772886.662120:0:162165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772886.662142:0:162165:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612211968:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772886.662964:0:162165:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a000 going to sleep for 11 seconds 00000100:00100000:1.0:1775772886.673686:0:162165:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612211968:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772886.673711:0:162165:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 4/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673764:0:162165:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673772:0:162165:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673783:0:162165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673794:0:162165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673818:0:162165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673827:0:162165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673834:0:162165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772886.673851:0:162165:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e16a00 x1862023612211968/t21474837290(21474837290) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772902 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772886.673865:0:162165:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e16a00 x1862023612211968/t21474837290(21474837290) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772902 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772886.673878:0:162165:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772886.673891:0:162165:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.673900:0:162165:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/3 (0 0) 00000080:00200000:1.0:1775772886.673906:0:162165:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772886.673919:0:162165:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-1, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08), intent=open|creat 00000080:00200000:1.0:1775772886.673945:0:162165:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3:0x0](ffff8de1c403aa08) 00000080:00200000:1.0:1775772886.676171:0:162165:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772886.676187:0:162165:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3:0x0](ffff8de1c403aa08) 00000080:00010000:1.0:1775772886.676191:0:162165:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3:0x0](ffff8de1c403aa08) for lock 0x8a9f4e958445e78f 00000080:00010000:1.0:1775772886.676201:0:162165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3:0x0](ffff8de1c403aa08) 00000080:00200008:1.0:1775772886.676286:0:162165:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x3:0x0](ffff8de1c403aa08), flags 100102 00000002:00100000:1.0:1775772886.676319:0:162165:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e16a00 x1862023612211968/t21474837290(21474837290) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772902 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772886.676355:0:162165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e78f from it ffff8de1c670f720 00010000:00010000:1.0:1775772886.676362:0:162165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772886.676406:0:162165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772886.676425:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3:0x0](ffff8de1c403aa08), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772886.676443:0:162165:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x3:0x0](ffff8de1c403aa08), flags 100002 00000002:00100000:1.0:1775772886.676484:0:162165:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e16a00 x1862023612211968/t21474837290(21474837290) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772902 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772886.676494:0:162165:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772886.676499:0:162165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16680 x1862023612212224/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772886.676521:0:162165:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612212224:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772886.676599:0:162165:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a180 going to sleep for 11 seconds 00000100:00100000:0.0:1775772886.948383:0:162165:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612219904:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775772886.948421:0:162165:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ef800 x1862023612219648/t21474837320(21474837320) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772902 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775772886.948489:0:162165:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772886.948507:0:162165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772886.948524:0:162165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:0.0:1775772886.948538:0:162165:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:0.0:1775772886.948551:0:162165:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772886.948556:0:162165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772886.948560:0:162165:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:0.0:1775772886.948566:0:162165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c1ddbbf8 00010000:00010000:0.0:1775772886.948570:0:162165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:0.0:1775772886.948578:0:162165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:0.0:1775772886.948592:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772886.948599:0:162165:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=25 00000080:00200000:0.0:1775772886.948605:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988), inode mode 41ed mask 1 00000080:00200000:0.0:1775772886.948609:0:162165:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775772886.948612:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:0.0:1775772886.948624:0:162165:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:0.0:1775772886.948628:0:162165:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-17, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08), file ffff8de1c2a95800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775772886.948635:0:162165:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-17, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08), intent=open|creat 00000002:00010000:0.0:1775772886.948656:0:162165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-17,[0x240002729:0x13:0x0]) in obj [0x240002729:0x1:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775772886.948702:0:162165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e7ff lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 162165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772886.948710:0:162165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e7ff lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162165 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775772886.948719:0:162165:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775772886.948777:0:162165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6300 x1862023612220160/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775772886.948787:0:162165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e7ff lrc: 3/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772886.948817:0:162165:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612220160:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775772886.948926:0:162165:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5ca3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1775772886.966742:0:162165:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162165:1862023612220160:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775772886.966768:0:162165:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e7ff lrc: 4/0,1 mode: --/CW res: [0x240002729:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8cac expref: -99 pid: 162165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1775772887.074369:0:162172:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772887.074408:0:162172:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772887.074427:0:162172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:1.0:1775772887.074443:0:162172:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:1.0:1775772887.074451:0:162172:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772887.074459:0:162172:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772887.074463:0:162172:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:1.0:1775772887.074469:0:162172:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c1473b58 00010000:00010000:1.0:1775772887.074474:0:162172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:1.0:1775772887.074483:0:162172:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:1.0:1775772887.074497:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.074504:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=8 00000080:00200008:1.0:1775772887.074513:0:162172:0:(file.c:6226:ll_getattr_dentry()) START file d80a.replay-single:[0x200027cd1:0x2:0x0](ffff8de1c4081988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775772887.074518:0:162172:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988),name=d80a.replay-single 00000002:00010000:1.0:1775772887.074531:0:162172:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x2:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772887.074538:0:162172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445e773 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a05 expref: -99 pid: 162160 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.074545:0:162172:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445e773 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a05 expref: -99 pid: 162160 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772887.074551:0:162172:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772887.074555:0:162172:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x2:0x0](ffff8de1c4081988) 00000080:00010000:1.0:1775772887.074557:0:162172:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x2:0x0](ffff8de1c4081988) for lock 0x8a9f4e958445e773 00000080:00010000:1.0:1775772887.074560:0:162172:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e773 from it ffff9ba1c1473cb8 00010000:00010000:1.0:1775772887.074563:0:162172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445e773 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da8a05 expref: -99 pid: 162160 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.074570:0:162172:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445e773 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da8a05 expref: -99 pid: 162160 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772887.074598:0:162172:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772887.074605:0:162172:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772887.074612:0:162172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:1.0:1775772887.074621:0:162172:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:1.0:1775772887.074627:0:162172:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772887.074631:0:162172:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772887.074634:0:162172:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e76c 00000080:00010000:1.0:1775772887.074637:0:162172:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e76c from it ffff9ba1c1473bf8 00010000:00010000:1.0:1775772887.074640:0:162172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:1.0:1775772887.074648:0:162172:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445e76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da89db expref: -99 pid: 161695 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:1.0:1775772887.074656:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.074660:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80a.replay-single, flags=266 00000080:00200000:1.0:1775772887.074664:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x2:0x0](ffff8de1c4081988), inode mode 41ed mask 44 00000080:00200008:1.0:1775772887.074670:0:162172:0:(file.c:1057:ll_file_open()) START file d80a.replay-single:[0x200027cd1:0x2:0x0](ffff8de1c4081988), flags 704400 00000002:00010000:1.0:1775772887.074684:0:162172:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x2:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1775772887.074907:0:162172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 162172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772887.074916:0:162172:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162172 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772887.074928:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772887.074939:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14380 x1862023612222848/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772887.075104:0:162172:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772887.075127:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612222848:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775772887.075530:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.156445:0:162172:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612224256:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772887.156528:0:162172:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0xe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772887.156540:0:162172:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772887.156591:0:162172:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0xe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772887.156604:0:162172:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0xe:0x0](ffff8de1c4087448) 00000080:00200000:1.0:1775772887.156691:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.156703:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-2, flags=0 00000080:00200000:1.0:1775772887.156709:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:1.0:1775772887.156714:0:162172:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-2, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08) 00010000:00010000:1.0:1775772887.156790:0:162172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e796 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8a9f expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772887.156943:0:162172:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4:0x0]: losing layout lock 00010000:00010000:1.0:1775772887.157001:0:162172:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e796 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8a9f expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.157009:0:162172:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772887.157012:0:162172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e796 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8a9f expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772887.157035:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772887.157043:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14a80 x1862023612224512/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772887.157065:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612224512:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772887.158015:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.166577:0:162172:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612224512:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772887.166657:0:162172:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772887.166669:0:162172:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772887.166756:0:162172:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772887.166771:0:162172:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4:0x0](ffff8de1c407aa08) 00000080:00200000:1.0:1775772887.166879:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.166892:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-3, flags=0 00000080:00200000:1.0:1775772887.166897:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:1.0:1775772887.166902:0:162172:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-3, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08) 00010000:00010000:1.0:1775772887.166966:0:162172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e79d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8ac2 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772887.166993:0:162172:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5:0x0]: losing layout lock 00010000:00010000:1.0:1775772887.167039:0:162172:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e79d lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8ac2 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.167046:0:162172:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772887.167049:0:162172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e79d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8ac2 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772887.167070:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772887.167079:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14380 x1862023612224768/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772887.167099:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612224768:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772887.167161:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.174347:0:162172:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612224768:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772887.174449:0:162172:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772887.174464:0:162172:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772887.174522:0:162172:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772887.174536:0:162172:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5:0x0](ffff8de1c407cb08) 00000080:00200000:1.0:1775772887.174630:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.174641:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-8, flags=0 00000080:00200000:1.0:1775772887.174647:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:1.0:1775772887.174651:0:162172:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-8, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08) 00010000:00010000:1.0:1775772887.174701:0:162172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e7c0 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8b71 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772887.174768:0:162172:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0xa:0x0]: losing layout lock 00010000:00010000:1.0:1775772887.174833:0:162172:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e7c0 lrc: 1/0,0 mode: --/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8b71 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.174841:0:162172:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772887.174843:0:162172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e7c0 lrc: 0/0,0 mode: --/PR res: [0x240002729:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8b71 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772887.174868:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772887.174876:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16680 x1862023612225024/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772887.174898:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612225024:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772887.174973:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.183194:0:162172:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612225024:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772887.183288:0:162172:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0xa:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772887.183298:0:162172:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772887.183342:0:162172:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0xa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772887.183351:0:162172:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0xa:0x0](ffff8de1c4084b08) 00000080:00200000:1.0:1775772887.183457:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.183468:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-7, flags=0 00000080:00200000:1.0:1775772887.183474:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:1.0:1775772887.183479:0:162172:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-7, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08) 00010000:00010000:1.0:1775772887.183521:0:162172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445e7b9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8b4e expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772887.183547:0:162172:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x9:0x0]: losing layout lock 00010000:00010000:1.0:1775772887.183596:0:162172:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445e7b9 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8b4e expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.183602:0:162172:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772887.183604:0:162172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445e7b9 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8b4e expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772887.183622:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772887.183628:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16a00 x1862023612225280/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772887.183643:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612225280:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772887.183706:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.190029:0:162172:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612225280:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772887.190110:0:162172:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772887.190133:0:162172:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772887.190466:0:162172:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772887.190484:0:162172:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x9:0x0](ffff8de1c407f448) 00000080:00200000:1.0:1775772887.190580:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772887.190592:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-19, flags=0 00000080:00200000:1.0:1775772887.190599:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:1.0:1775772887.190604:0:162172:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-19, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08) 00010000:00010000:1.0:1775772887.190651:0:162172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445e80d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8cf2 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772887.190673:0:162172:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x15:0x0]: losing layout lock 00010000:00010000:1.0:1775772887.190720:0:162172:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445e80d lrc: 1/0,0 mode: --/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8cf2 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772887.190777:0:162172:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772887.190780:0:162172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445e80d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8cf2 expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772887.190932:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772887.190940:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14000 x1862023612225536/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772887.191009:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612225536:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772887.191065:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.202185:0:162172:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612225536:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772887.202275:0:162172:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772887.202288:0:162172:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772887.202346:0:162172:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772887.202360:0:162172:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x15:0x0](ffff8de1c40821c8) 00000080:00200000:0.0:1775772887.384967:0:162172:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=0 00000080:00200000:0.0:1775772887.384975:0:162172:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1:0x0](ffff8de1c4082a08), inode mode 41ed mask 3 00000080:00200000:0.0:1775772887.384982:0:162172:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-1, dir=[0x240002729:0x1:0x0](ffff8de1c4082a08) 00010000:00010000:0.0:1775772887.385072:0:162172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00000080:00200000:0.0:1775772887.385102:0:162172:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3:0x0]: losing layout lock 00010000:00010000:0.0:1775772887.385161:0:162172:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:0.0:1775772887.385168:0:162172:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775772887.385171:0:162172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e78f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da8a7c expref: -99 pid: 162165 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00000020:00100000:0.0:1775772887.385214:0:162172:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775772887.385226:0:162172:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d4380 x1862023612228864/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775772887.385250:0:162172:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162172:1862023612228864:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775772887.385389:0:162172:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5ca3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1775772887.513635:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:0.0:1775772887.513748:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625068032 00000100:00100000:0.0:1775772887.513758:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625068032 00000100:00100000:0.0:1775772887.513811:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 3 00000100:00100000:0.0:1775772887.513821:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625068032:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775772887.513838:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445e773 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da8a05 expref: -99 pid: 162160 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775772887.513918:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775772887.513926:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625068032:12345-192.168.201.137@tcp:104: Request processed in 107us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1775772887.513934:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 3 00000100:00100000:0.0:1775772888.383851:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612231040:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.383929:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231296:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.383950:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231552:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.383986:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1775772888.383991:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231168:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.384009:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231424:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.388666:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612231040:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.388686:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231296:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.388695:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231552:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.389999:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231168:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772888.390011:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612231424:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772891.903956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772893.954871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772894.979490:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772896.001538:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772897.023829:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1775772897.307901:0:162751:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772897.307935:0:162751:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772897.307999:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772897.308012:0:162751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772897.308188:0:162751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772897.308226:0:162751:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162751:1862023612232320:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772897.308315:0:162751:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1775772897.312397:0:162751:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162751:1862023612232320:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775772897.312424:0:162751:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312436:0:162751:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312447:0:162751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312459:0:162751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312470:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312490:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312498:0:162751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772897.312509:0:162751:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d6680 x1862023612232320/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772913 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772897.312523:0:162751:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312541:0:162751:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1775772897.312548:0:162751:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775772897.312579:0:162751:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:1.0:1775772897.312585:0:162751:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e853 00000080:00010000:1.0:1775772897.312590:0:162751:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772897.312593:0:162751:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e853 from it ffff9ba1c106fb58 00010000:00010000:1.0:1775772897.312596:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312604:0:162751:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772897.312636:0:162751:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772897.312657:0:162751:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80b.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=13 00000080:00200000:1.0:1775772897.312662:0:162751:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80b.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:1.0:1775772897.312686:0:162751:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80b.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772897.312760:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312768:0:162751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.312776:0:162751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772897.312797:0:162751:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162751:1862023612232448:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775772897.312872:0:162751:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2b840 going to sleep for 11 seconds 00000100:00100000:1.0:1775772897.324186:0:162751:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162751:1862023612232448:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775772897.324220:0:162751:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324235:0:162751:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324243:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324251:0:162751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324259:0:162751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324266:0:162751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b9600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775772897.324271:0:162751:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324277:0:162751:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324283:0:162751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324290:0:162751:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775772897.324297:0:162751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772897.324303:0:162751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e85a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 162751 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772897.324327:0:162751:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1c2e17b80 x1862023612232448/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/584 e 0 to 0 dl 1775772913 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772897.324341:0:162751:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1775772897.324369:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772897.324381:0:162751:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1775772897.324389:0:162751:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e853 from it ffff9ba1c106f930 00010000:00010000:1.0:1775772897.324392:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772897.324401:0:162751:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772897.324489:0:162751:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772897.324507:0:162751:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772897.324526:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772897.324534:0:162751:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775772897.324540:0:162751:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772897.324545:0:162751:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772897.324548:0:162751:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e853 00000080:00010000:1.0:1775772897.324554:0:162751:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e853 from it ffff9ba1c106fbe8 00010000:00010000:1.0:1775772897.324557:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775772897.324563:0:162751:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775772897.324572:0:162751:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772897.324579:0:162751:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=16392 00000080:00200008:1.0:1775772897.324602:0:162751:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775772897.324607:0:162751:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772897.324613:0:162751:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772897.324620:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775772897.324628:0:162751:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775772897.324635:0:162751:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772897.324639:0:162751:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772897.324641:0:162751:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e853 00000080:00010000:1.0:1775772897.324645:0:162751:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e853 from it ffff9ba1c106fcb8 00010000:00010000:1.0:1775772897.324647:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775772897.324654:0:162751:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:1.0:1775772897.325758:0:162751:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775772897.325766:0:162751:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772897.325779:0:162751:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772897.325790:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775772897.325801:0:162751:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1775772897.325809:0:162751:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772897.325813:0:162751:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772897.325816:0:162751:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e853 00000080:00010000:1.0:1775772897.325820:0:162751:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e853 from it ffff9ba1c106fcb8 00010000:00010000:1.0:1775772897.325823:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775772897.325830:0:162751:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775772897.325964:0:162751:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772897.325972:0:162751:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772897.325979:0:162751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775772897.325987:0:162751:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775772897.325998:0:162751:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772897.326001:0:162751:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772897.326004:0:162751:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e853 00000080:00010000:1.0:1775772897.326007:0:162751:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e853 from it ffff9ba1c106fbb0 00010000:00010000:1.0:1775772897.326009:0:162751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775772897.326015:0:162751:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775772897.326036:0:162751:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:1.0:1775772897.326043:0:162751:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 300000 00000080:00200080:1.0:1775772897.326060:0:162751:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c03066f0 arg=7ffffda02bd0 00000080:00200000:1.0:1775772897.326072:0:162751:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) name=d80b.replay-single stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:1.0:1775772897.326097:0:162751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775772897.326156:0:162751:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775772897.326162:0:162751:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772897.326165:0:162751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445e853 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9079 expref: -99 pid: 162751 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:1.0:1775772897.326189:0:162751:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772897.326209:0:162751:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e17b80 x1862023612232704/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 568/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772897.326234:0:162751:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162751:1862023612232704:192.168.201.137@tcp:36:lfs.0 00000100:00100000:1.0:1775772897.326321:0:162751:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2b840 going to sleep for 11 seconds 00000100:00100000:1.0:1775772897.332040:0:162751:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162751:1862023612232704:192.168.201.137@tcp:36:lfs.0 00000080:00200000:1.0:1775772897.332084:0:162751:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08) 00000080:00200000:1.0:1775772897.332092:0:162751:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x4:0x0], updating i_size 4096 00000080:00200008:1.0:1775772897.332125:0:162751:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 300000 00010000:00010000:0.0:1775772898.054794:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772898.483206:0:162761:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162761:1862023612233088:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772898.483231:0:162761:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483245:0:162761:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483252:0:162761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483260:0:162761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483270:0:162761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483276:0:162761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775772898.483280:0:162761:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483287:0:162761:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483294:0:162761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483301:0:162761:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1775772898.483307:0:162761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483313:0:162761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445e86f lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772898.483329:0:162761:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d01ee680 x1862023612233088/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775772914 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775772898.483344:0:162761:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x4:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1775772898.483370:0:162761:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/4 (0 0) 00000080:00200000:0.0:1775772898.483431:0:162761:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772898.483444:0:162761:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772898.483453:0:162761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e861 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da90f0 expref: -99 pid: 162761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772898.483468:0:162761:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e861 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da90f0 expref: -99 pid: 162761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772898.483475:0:162761:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772898.483481:0:162761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772898.483484:0:162761:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e861 00000080:00010000:0.0:1775772898.483489:0:162761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e861 from it ffff9ba1c1c23be8 00010000:00010000:0.0:1775772898.483492:0:162761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da90f0 expref: -99 pid: 162761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772898.483501:0:162761:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e861 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da90f0 expref: -99 pid: 162761 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772898.483516:0:162761:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772898.483525:0:162761:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=16408 00000080:00200000:0.0:1775772898.483531:0:162761:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:0.0:1775772898.483540:0:162761:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), flags=16392 00000080:00200000:0.0:1775772898.483544:0:162761:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), intent=getattr 00000002:00010000:0.0:1775772898.483556:0:162761:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772898.483599:0:162761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e876 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483606:0:162761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e876 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772898.483616:0:162761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445e876 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772898.483644:0:162761:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162761:1862023612233216:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772898.483716:0:162761:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9540 going to sleep for 11 seconds 00000100:00100000:1.0:1775772898.531162:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772898.531212:0:160415:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625077632 00000100:00100000:1.0:1775772898.531222:0:160415:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625077632 00000100:00100000:1.0:1775772898.531272:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 4 00000100:00100000:1.0:1775772898.531281:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182027:x1862023625077632:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772898.531299:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445e87d lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da9144 expref: -99 pid: 162761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772898.531372:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772898.531379:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182027:x1862023625077632:12345-192.168.201.137@tcp:104: Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772898.531386:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 4 00000100:00100000:0.0:1775772898.626953:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612234240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772898.627068:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1775772898.627075:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612234112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772898.627117:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612234368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772898.636491:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612234112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772898.636513:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612234368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772898.636525:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612234240:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772899.078594:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1775772899.812209:0:162780:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772899.812240:0:162780:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772899.812301:0:162780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 162780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.812312:0:162780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.812321:0:162780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 162780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772899.812346:0:162780:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162780:1862023612235264:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775772899.812442:0:162780:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1775772899.821996:0:162780:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162780:1862023612235264:192.168.201.137@tcp:101:rm.0 00010000:00010000:0.0:1775772899.822021:0:162780:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822033:0:162780:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822046:0:162780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822057:0:162780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822082:0:162780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822091:0:162780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822098:0:162780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772899.822110:0:162780:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d6a00 x1862023612235264/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772915 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772899.822125:0:162780:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822138:0:162780:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1775772899.822145:0:162780:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772899.822184:0:162780:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:0.0:1775772899.822191:0:162780:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e88b 00000080:00010000:0.0:1775772899.822197:0:162780:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772899.822686:0:162780:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e88b from it ffff9ba1c1be3b58 00010000:00010000:0.0:1775772899.822692:0:162780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.822702:0:162780:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e88b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da918a expref: -99 pid: 162780 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772899.822941:0:162780:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772899.822967:0:162780:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=8 00000080:00200000:0.0:1775772899.822983:0:162780:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:0.0:1775772899.823011:0:162780:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: fsa-oleg137-client.virtnet,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772899.825026:0:162780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e892 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 162780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.825046:0:162780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e892 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772899.826831:0:162780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34200/0x8a9f4e958445e892 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 162780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772899.838890:0:162780:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162780:1862023612235392:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775772899.839541:0:162780:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2b480 going to sleep for 11 seconds 00010000:00010000:0.0:1775772901.123188:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772903.744054:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612235776:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772903.744055:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612235904:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772903.744210:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612236032:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772903.744211:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612236160:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772903.744255:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612236288:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772903.749458:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612236032:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772903.750135:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612235904:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772903.751424:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612235776:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772903.751448:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612236288:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772903.763910:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612236160:192.168.201.137@tcp:400:kworker.0 00000001:02000400:1.0:1775772907.214319:0:162852:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 00000080:00200080:0.0:1775772908.268811:0:162861:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffeac675440 00020000:00000080:0.0:1775772908.268850:0:162861:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a67c00 uarg=0000000000000000 00020000:00000004:0.0:1775772908.268860:0:162861:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 8876, max_age 8884 00000100:00100000:0.0:1775772908.268908:0:162861:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162861:1862023612236928:192.168.201.137@tcp:13:lfs.0 00000100:00100000:0.0:1775772908.268995:0:162861:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9600 going to sleep for 11 seconds 00010000:00010000:3.0:1775772908.446132:0:162871:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445e8a0 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da91ec expref: -99 pid: 162871 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772908.446143:0:162871:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1775772908.446145:0:162871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445e8a7 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9208 expref: -99 pid: 162871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775772908.446165:0:162871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445e8a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da91ec expref: -99 pid: 162871 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1775772908.446188:0:162871:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775772908.446197:0:162871:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ef480 x1862023612237696/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772908.446224:0:162871:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162871:1862023612237696:192.168.201.137@tcp:36:rm.0 00000100:00100000:3.0:1775772908.446395:0:162871:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a9c0 going to sleep for 51 seconds 00000100:00100000:3.0:1775772908.456070:0:162871:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162871:1862023612237696:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775772908.456195:0:162871:0:(vvp_io.c:1817:vvp_io_init()) [0x200027cd1:0x6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1775772908.456207:0:162871:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0x6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1775772908.456237:0:162871:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0x6:0x0](ffff8de1c40863c8) 00000100:00100000:1.0:1775772908.864037:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612237824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772908.872205:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612237824:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772909.317164:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772909.888622:0:162761:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636aa80 going to sleep for 26 seconds 00010000:00010000:3.0:1775772911.360294:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772913.984202:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612237952:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772913.985324:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775772913.985339:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612238080:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772913.987239:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612238336:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772914.000628:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612238336:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772915.114676:0:162761:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162761:1862023612233856:192.168.201.137@tcp:36:lfs.0 00000080:00200000:3.0:1775772915.115004:0:162761:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00000080:00200000:3.0:1775772915.115091:0:162761:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x16:0x0], updating i_size 4096 00000080:00200008:3.0:1775772915.115143:0:162761:0:(file.c:447:ll_file_release()) START file d80b.replay-single:[0x200027cd1:0x4:0x0](ffff8de1c403cb08), flags 300000 00000002:00100000:3.0:1775772915.115237:0:162761:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01eca80 x1862023612233600/t352187318285(352187318285) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772914 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775772915.115251:0:162761:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775772915.115257:0:162761:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eed80 x1862023612238720/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775772915.115284:0:162761:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162761:1862023612238720:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775772915.115527:0:162761:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1775772915.131945:0:162761:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:162761:1862023612238720:192.168.201.137@tcp:35:lfs.0 00000001:02000400:0.0:1775772915.954517:0:162947:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0001 00000100:00100000:3.0:1775772919.107036:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612238848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.107176:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612239104:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.107210:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612239360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.107242:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775772919.107248:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612238976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.107274:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612239232:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.112887:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612238976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.112911:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612238848:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775772919.112925:0:2405:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0001-mdc-ffff8de1e006a000 of lustre-MDT0001_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1775772919.112932:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1775772919.112936:0:2405:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection to lustre-MDT0001 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1775772919.112944:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775772919.112950:0:2405:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8774 00000100:00080000:3.0:1775772919.112961:0:2405:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775772919.112976:0:2405:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775772919.113012:0:2405:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ed880 x1862023612239488/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772919.113047:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612239104:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772919.113125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612239488:192.168.201.137@tcp:38:ptlrpcd_01_01.0 00000100:00080000:0.0:1775772919.129067:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775772919.129086:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:0.0:1775772919.129092:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612239488:192.168.201.137@tcp:38:ptlrpcd_01_01.0 00000100:00100000:3.0:1775772919.129443:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612239232:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772919.129461:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612239360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772924.225469:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612239616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772924.225669:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775772924.225676:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612239744:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772924.228381:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772924.228394:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775772924.228400:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772924.228413:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8895 00000100:00080000:1.0:1775772924.228428:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775772924.228437:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772924.228452:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772924.228496:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16d80 x1862023612239872/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772924.228589:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612240128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772924.228712:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775772924.228841:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612239872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775772924.229075:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612239616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772924.229616:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612240000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772924.234496:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612239744:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772924.234534:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612240000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772924.234557:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612240128:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775772929.344894:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775772929.344901:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775772929.344906:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775772929.344920:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8901 00000100:00080000:0.0:1775772929.344936:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1775772929.344944:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775772929.344957:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775772929.344983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c67d5f80 x1862023612240512/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775772929.345035:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1775772929.345038:0:123972:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8de1e006a000: disconnect after 21s idle 00000100:00080000:0.0:1775772929.345048:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1775772929.345051:0:123972:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8de1e006a000: disconnect after 21s idle 00000100:00100000:1.0:1775772929.345245:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612240256:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772929.345405:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775772929.345413:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612240384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772929.357519:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612240384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772929.357540:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612240256:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772930.820301:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772932.864276:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775772934.464033:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775772934.464040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775772934.464047:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775772934.464061:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8906 00000100:00080000:0.0:1775772934.464077:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1775772934.464084:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775772934.464100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775772934.464119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c67d5f80 x1862023612241152/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772934.466788:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612240896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772934.466930:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775772934.466939:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612241024:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772934.471815:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612240896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772934.478672:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612241024:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772934.912262:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772936.960011:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772939.008258:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775772939.584203:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772939.584210:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775772939.584216:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775772939.584229:0:151211:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8911 00000100:00080000:1.0:1775772939.584241:0:151211:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775772939.584249:0:151211:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772939.584274:0:151211:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775772939.584298:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15c00 x1862023612241536/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772939.584344:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612241408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772939.584492:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775772939.584499:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612241280:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772939.605760:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612241408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772939.615146:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612241280:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772941.056830:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772941.658841:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:0.0:1775772941.666689:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625101568 00000100:00100000:0.0:1775772941.666709:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625101568 00000100:00100000:0.0:1775772941.667692:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 5 00000100:00100000:0.0:1775772941.667705:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:190194:x1862023625101568:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775772941.667746:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445e750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297da86d9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772941.668948:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775772941.668962:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:190194:x1862023625101568:12345-192.168.201.137@tcp:104: Request processed in 1256us (10132us total) trans 0 rc 0/0 00000100:00100000:0.0:1775772941.668972:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 5 00000100:00100000:3.0:1775772941.669461:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612241664:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775772941.685260:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612241664:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775772942.081264:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1775772943.423881:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:3.0:1775772943.423900:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 341 10000000:01000000:3.0:1775772943.423907:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:3.0:1775772943.423984:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772943.423999:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772943.424013:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772943.424052:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612241792:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1775772943.424192:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a180 going to sleep for 11 seconds 00000100:00100000:3.0:1775772943.432636:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612241792:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1775772943.432682:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772943.432700:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772943.432833:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612241920:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1775772943.432954:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c636a180 going to sleep for 11 seconds 00000100:00100000:3.0:1775772943.471791:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612241920:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:3.0:1775772943.471878:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:3.0:1775772943.472081:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:3.0:1775772943.472095:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772943.472118:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775772943.512333:0:163208:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 6, was 0): DISCONN 00010000:00080000:3.0:1775772943.512375:0:163208:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c7278800@lustre-MDT0001-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00000100:00080000:3.0:1775772943.512398:0:163208:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775772943.512411:0:163208:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:3.0:1775772943.512423:0:163208:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775772943.512441:0:163208:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775772943.512481:0:163208:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ef100 x1862023612242048/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1775772943.522105:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d01ef100 x1862023612242048/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775772953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'lctl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775772943.522132:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to target with instance 6 00000100:00080000:0.0:1775772943.522154:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1775772943.522161:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00100000:0.0:1775772943.522165:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 21474837355 gen 1 00000100:00080000:0.0:1775772943.522182:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c7278800 from lustre-MDT0001_UUID committed 21474837355 last 0 00000100:00080000:0.0:1775772943.522186:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1775772943.522860:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612242048:192.168.201.137@tcp:38:lctl.0 00010000:00080000:1.0:1775772943.522978:0:163209:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-mdc-ffff8de1e006a000 to lustre-MDT0001_UUID@192.168.201.137@tcp 00010000:00010000:1.0:1775772943.522985:0:163209:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-mdc-ffff8de1e006a000 (0) 00010000:00010000:1.0:1775772943.522991:0:163209:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-mdc-ffff8de1e006a000 00000100:00080000:1.0:1775772943.523862:0:163209:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1775772943.524524:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612242176:192.168.201.137@tcp:400:ldlm_lock_repla.0 00010000:00010000:3.0:1775772944.129499:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775772944.703987:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775772944.703994:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1775772944.704056:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612242304:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772944.704191:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775772944.704199:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612242432:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772944.722534:0:2403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 0/0 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1775772944.722566:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612242432:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772944.722586:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612242304:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772944.722672:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775772944.722704:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772944.722706:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772944.722708:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772945.152743:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772946.176524:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1775772946.860267:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c2e15880 x1862023612242176/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772973 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775772946.860286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1775772946.860292:0:2401:0:(client.c:3204:ptlrpc_resend_req()) @@@ going to resend req@ffff8de1c2e15880 x1862023612242176/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772973 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775772946.860300:0:2401:0:(client.c:3213:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8de1c2e15880 x1862023612242176/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772973 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775772946.860307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00010000:00010000:3.0:1775772947.199949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772948.231936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772948.736104:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612242688:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772948.736229:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1775772948.736237:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612242560:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772948.736271:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612242816:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772948.747392:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612242560:192.168.201.137@tcp:400:kworker.0 00010000:00080000:0.0:1775772948.770033:0:2402:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c67d5500 x1862023612242816/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775772948.770058:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612242816:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772948.770075:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612242688:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772949.250492:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772950.272999:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:0.0:1775772950.550866:0:163267:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775772950.550896:0:163267:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772950.550928:0:163267:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772950.551015:0:163267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.551027:0:163267:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.551044:0:163267:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772950.551077:0:163267:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612242944:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772950.551195:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192000 going to sleep for 25 seconds 00000100:00100000:0.0:1775772950.554496:0:163267:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612242944:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772950.554536:0:163267:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554553:0:163267:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554570:0:163267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554585:0:163267:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554601:0:163267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554610:0:163267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554619:0:163267:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772950.554638:0:163267:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d4700 x1862023612242944/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772980 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772950.554654:0:163267:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554670:0:163267:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1775772950.554679:0:163267:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772950.554716:0:163267:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:0.0:1775772950.554948:0:163267:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772950.554957:0:163267:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772950.554961:0:163267:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c0d93cb8 00010000:00010000:0.0:1775772950.554964:0:163267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772950.554975:0:163267:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1775772950.556279:0:163267:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772950.556291:0:163267:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772950.556316:0:163267:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772950.556335:0:163267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772950.556352:0:163267:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772950.556365:0:163267:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772950.556373:0:163267:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772950.556376:0:163267:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772950.556383:0:163267:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c0d93cb8 00010000:00010000:0.0:1775772950.556387:0:163267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772950.556395:0:163267:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772950.556540:0:163267:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772950.556548:0:163267:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772950.556555:0:163267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772950.556564:0:163267:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775772950.556570:0:163267:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772950.556574:0:163267:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772950.556576:0:163267:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772950.556579:0:163267:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c0d93bb0 00010000:00010000:0.0:1775772950.556582:0:163267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775772950.556589:0:163267:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772950.556598:0:163267:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775772950.556607:0:163267:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775772950.557533:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.557560:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00800000:00000004:0.0:1775772950.557568:0:163267:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8885, max_age 8926 00000100:00100000:0.0:1775772950.557630:0:163267:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612243072:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772950.557921:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192000 going to sleep for 11 seconds 00000100:00100000:0.0:1775772950.561394:0:163267:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612243072:192.168.201.137@tcp:41:lfs.0 00800000:00000004:0.0:1775772950.561432:0:163267:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317249/353529 objects 1023642/1024000 00000080:00200080:0.0:1775772950.561542:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.561564:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00800000:00000004:0.0:1775772950.561574:0:163267:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 8885, max_age 8926 00000100:00100000:0.0:1775772950.561620:0:163267:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612243200:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772950.561815:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192000 going to sleep for 25 seconds 00010000:00080000:0.0:1775772950.572867:0:163267:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c67d4700 x1862023612243200/t0(0) o41->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 1775772980 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775772950.572892:0:163267:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612243200:192.168.201.137@tcp:41:lfs.0 00800000:00000004:0.0:1775772950.572928:0:163267:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317340/353529 objects 1023720/1024000 00000080:00200080:0.0:1775772950.573025:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573050:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573060:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573064:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573069:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573072:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573077:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573080:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573085:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573088:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573092:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573096:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573100:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573103:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573107:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573111:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573115:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573118:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573122:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573126:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573130:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573134:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573137:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573141:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573145:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573149:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573153:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573156:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573160:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573165:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573169:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573172:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573176:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573180:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573184:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573188:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573191:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573195:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573198:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573201:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573205:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573208:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573212:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573216:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573219:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573223:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573227:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573230:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573234:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573237:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573240:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573244:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573248:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573251:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573267:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573271:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573275:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573279:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573283:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573286:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573290:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573293:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573296:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573299:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573303:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573306:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573310:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573314:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573318:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573322:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573326:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573330:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573334:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573337:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573341:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573345:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573348:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573351:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573355:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573358:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573362:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573365:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573368:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573371:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573375:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573378:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573381:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573384:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573388:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573391:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573395:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573398:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573401:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573404:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573408:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573411:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573414:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573417:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573420:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573423:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573427:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573430:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573434:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573438:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573442:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573445:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573449:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573452:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573456:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573460:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573464:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573467:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573471:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573475:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573479:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573483:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573487:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573490:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573494:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573498:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573502:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573505:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573509:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573513:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573517:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00800000:00000080:0.0:1775772950.573520:0:163267:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00000080:00200080:0.0:1775772950.573524:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.573531:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64800 uarg=0000000000000000 00020000:00000004:0.0:1775772950.573541:0:163267:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 8885, max_age 8926 00000100:00080000:0.0:1775772950.573558:0:163267:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8851 00000100:00080000:0.0:1775772950.573574:0:163267:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775772950.573588:0:163267:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:0.0:1775772950.573616:0:163267:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c67d5500 x1862023612243328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775772950.573672:0:163267:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c67d4700 x1862023612243456/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775772950.573704:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192000 going to sleep for 0 seconds 00000100:00100000:3.0:1775772950.574196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612243328:192.168.201.137@tcp:8:lfs.0 00000100:00100000:3.0:1775772950.583662:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 38654705666 gen 3 00000100:00080000:3.0:1775772950.583681:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8de1e006a000: connect to target with instance 9 00000100:00080000:3.0:1775772950.583691:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:3.0:1775772950.583704:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775772950.583710:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775772950.583715:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1775772950.583719:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1775772950.584352:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7192000 going to sleep for 11 seconds 00000100:00100000:0.0:1775772950.596330:0:163267:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612243456:192.168.201.137@tcp:13:lfs.0 00020000:00000004:0.0:1775772950.596367:0:163267:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:1.0:1775772950.596547:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:1.0:1775772950.596570:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c553b000 uarg=0000000000000000 00020000:00000004:1.0:1775772950.596580:0:163267:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 8885, max_age 8926 00000100:00080000:1.0:1775772950.596595:0:163267:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8851 00000100:00080000:1.0:1775772950.596607:0:163267:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775772950.596620:0:163267:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:1.0:1775772950.596650:0:163267:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16d80 x1862023612243584/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775772950.596710:0:163267:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c2e15c00 x1862023612243712/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772950.596766:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2be40 going to sleep for 0 seconds 00000100:00100000:3.0:1775772950.596874:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612243584:192.168.201.137@tcp:8:lfs.0 00000100:00100000:3.0:1775772950.600789:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1e006a000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1775772950.600816:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8de1e006a000: connect to target with instance 1 00000100:00080000:3.0:1775772950.600831:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:3.0:1775772950.600847:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775772950.600855:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775772950.600862:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1775772950.600867:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000080:00000004:3.0:1775772950.600876:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775772950.600879:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775772950.600895:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000807963b5): req@ffff8de1c2e15c00 x1862023612243712/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775772950.600923:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612243584:192.168.201.137@tcp:8:lfs.0 00000100:00100000:1.0:1775772950.601273:0:163267:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1775772950.606532:0:163267:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163267:1862023612243712:192.168.201.137@tcp:13:lfs.0 00020000:00000004:0.0:1775772950.606571:0:163267:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:0.0:1775772950.606662:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606682:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606687:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606690:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606692:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606694:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606697:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606699:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606700:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606702:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606704:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606707:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606710:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606712:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606714:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606716:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606718:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606719:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606760:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606766:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606771:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606774:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606778:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606781:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606784:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606787:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606791:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606794:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606797:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606801:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606805:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606808:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606812:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606815:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606817:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606819:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606822:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606824:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606826:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606828:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606830:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606832:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606834:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606835:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606837:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606839:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606841:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606842:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606844:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606846:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606848:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606849:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606851:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606853:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606855:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606856:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606858:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606860:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606862:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606863:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606865:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606867:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606870:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606872:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606874:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606876:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606878:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606879:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606881:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606883:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606885:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606888:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606891:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606894:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606898:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606901:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606904:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606907:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606911:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606914:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606918:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606922:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606925:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606928:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606932:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606935:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606940:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606944:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606948:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606951:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606955:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606957:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606960:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606962:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606964:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606965:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606967:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606969:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606971:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606972:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606974:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606976:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606977:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606979:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606981:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606982:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606984:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606986:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606988:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606989:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606991:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606994:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.606996:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.606998:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.607000:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.607002:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.607005:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.607009:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.607012:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.607015:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.607019:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.607022:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.607025:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.607029:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200080:0.0:1775772950.607032:0:163267:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff87770920 00020000:00000080:0.0:1775772950.607035:0:163267:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a64c00 uarg=0000000000000000 00000080:00200008:0.0:1775772950.607054:0:163267:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00010000:00010000:3.0:1775772951.297463:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772952.324146:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772953.344445:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772953.926480:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612243968:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772953.926593:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612244224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772953.926627:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1775772953.926633:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612243840:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772953.926668:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612244096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772953.926689:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612244352:192.168.201.137@tcp:400:kworker.0 00010000:00080000:1.0:1775772953.941036:0:2403:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c2e17b80 x1862023612244096/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775772969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775772953.941062:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612244096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772953.941082:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612243968:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772953.956816:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612244224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772953.956889:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612244352:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772953.956932:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612243840:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772954.368502:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775772955.145145:0:163519:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 00010000:00010000:0.0:1775772956.426139:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772958.468524:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772959.041274:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775772959.041430:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612244480:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772959.042441:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612244608:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772959.042550:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612244864:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772959.042595:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775772959.042605:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612244736:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772959.042638:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612244992:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772959.044552:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612244480:192.168.201.137@tcp:400:kworker.0 00000080:00200008:0.0:1775772959.066656:0:163715:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775772959.066676:0:163715:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772959.066709:0:163715:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772959.066887:0:163715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772959.066908:0:163715:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772959.066918:0:163715:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772959.066930:0:163715:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772959.067032:0:163715:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772959.067041:0:163715:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c0d93cb8 00010000:00010000:0.0:1775772959.067046:0:163715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772959.067058:0:163715:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1775772959.069363:0:163715:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772959.069375:0:163715:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772959.069404:0:163715:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772959.069424:0:163715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772959.069443:0:163715:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775772959.069457:0:163715:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772959.069466:0:163715:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772959.069470:0:163715:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772959.069478:0:163715:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c0d93cb8 00010000:00010000:0.0:1775772959.069482:0:163715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772959.069491:0:163715:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775772959.069702:0:163715:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772959.069712:0:163715:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772959.069720:0:163715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775772959.069762:0:163715:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775772959.069769:0:163715:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772959.069774:0:163715:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772959.069777:0:163715:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772959.069781:0:163715:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c0d93bb0 00010000:00010000:0.0:1775772959.069784:0:163715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775772959.069791:0:163715:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1775772959.069801:0:163715:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775772959.069811:0:163715:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775772959.069930:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00800000:00000080:0.0:1775772959.069964:0:163715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a65800 uarg=0000000000000000 00800000:00000004:0.0:1775772959.069973:0:163715:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8927, max_age 8934 00000100:00100000:0.0:1775772959.070028:0:163715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163715:1862023612245120:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772959.070151:0:163715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1775772959.080219:0:163715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163715:1862023612245120:192.168.201.137@tcp:41:lfs.0 00800000:00000004:0.0:1775772959.080274:0:163715:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317249/353529 objects 1023642/1024000 00000080:00200080:0.0:1775772959.080394:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00800000:00000080:0.0:1775772959.080418:0:163715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1a65800 uarg=0000000000000000 00800000:00000004:0.0:1775772959.080427:0:163715:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 8927, max_age 8934 00000100:00100000:0.0:1775772959.080480:0:163715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163715:1862023612245248:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775772959.080793:0:163715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.094589:0:163715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163715:1862023612245376:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775772959.094632:0:163715:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:3.0:1775772959.094717:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.094784:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00020000:00000004:3.0:1775772959.094794:0:163715:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 8927, max_age 8934 00000100:00100000:3.0:1775772959.094844:0:163715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163715:1862023612245504:192.168.201.137@tcp:13:lfs.0 00000100:00100000:3.0:1775772959.094939:0:163715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.099760:0:163715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163715:1862023612245504:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775772959.099791:0:163715:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:3.0:1775772959.099866:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099888:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099897:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099901:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099905:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099909:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099914:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099937:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099943:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099948:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099953:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099957:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099961:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099965:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099969:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099973:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099977:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099981:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099984:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099987:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099990:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.099993:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.099997:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100003:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100007:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100012:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100016:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100021:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100024:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100029:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100033:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100037:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100041:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100044:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100047:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100050:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100054:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100057:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100061:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100064:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100068:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100072:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100076:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100079:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100083:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100087:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100091:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100095:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100100:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100116:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100122:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100126:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100129:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100133:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100138:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100143:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100149:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100154:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100158:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100162:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100165:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100170:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100175:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100180:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100185:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100189:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100194:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100198:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100201:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100205:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100210:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100214:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100219:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100222:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100225:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100229:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100233:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100237:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100241:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100244:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100250:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100255:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100259:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100263:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100267:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100271:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100275:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100279:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100283:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100286:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100290:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100293:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100297:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100302:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100307:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100311:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100316:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100319:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100324:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100327:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100330:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100334:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100337:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100340:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100346:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100351:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100356:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100360:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100364:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100368:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100372:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100389:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100395:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100400:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100404:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100408:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100412:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100415:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100419:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100422:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100426:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100429:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100433:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100436:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200080:3.0:1775772959.100440:0:163715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd68db5d50 00020000:00000080:3.0:1775772959.100444:0:163715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1400 uarg=0000000000000000 00000080:00200008:3.0:1775772959.100459:0:163715:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00010000:00080000:3.0:1775772959.237749:0:163731:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0e75500 x1862023612246272/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/456 e 0 to 0 dl 1775772975 ref 2 fl Rpc:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1775772959.237772:0:163731:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163731:1862023612246272:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775772959.237806:0:163731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e76a00 x1862023612246016/t25769803777(25769803777) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775772959.399836:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e74e00 x1862023612248576/t25769803787(25769803787) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775772959.399853:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775772959.399858:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d4e00 x1862023612248832/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775772959.399880:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612248832:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775772959.400177:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.408402:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612248832:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772959.408440:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e74e00 x1862023612248576/t25769803787(25769803787) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772959.408533:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772959.408555:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772959.408575:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:1.0:1775772959.408590:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:1.0:1775772959.408600:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772959.408607:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772959.408611:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:1.0:1775772959.408618:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:1.0:1775772959.408621:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:1.0:1775772959.408631:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:1.0:1775772959.408647:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.408656:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:1.0:1775772959.408674:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.408679:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772959.408683:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.408694:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.408698:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-5, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1c9960d80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772959.408705:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-5, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:1.0:1775772959.408866:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-5,[0x240002729:0x1c:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772959.408919:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.409007:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772959.409020:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772959.409027:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e17100 x1862023612249088/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772959.409037:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772959.409062:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249088:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772959.409588:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.416279:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249088:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772959.416308:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416339:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416348:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416359:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416372:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416389:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416397:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416403:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.416413:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e17100 x1862023612249088/t25769803789(25769803789) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772959.416425:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e17100 x1862023612249088/t25769803789(25769803789) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.416437:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772959.416450:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416460:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/28 (0 0) 00000080:00200000:1.0:1775772959.416467:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772959.416481:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-5, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:1.0:1775772959.416523:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x1c:0x0](ffff8de1c403d348) 00000080:00200000:1.0:1775772959.416651:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x1c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772959.416661:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x1c:0x0](ffff8de1c403d348) 00000080:00010000:1.0:1775772959.416665:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x1c:0x0](ffff8de1c403d348) for lock 0x8a9f4e958445e8ed 00000080:00010000:1.0:1775772959.416674:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x1c:0x0](ffff8de1c403d348) 00000080:00200008:1.0:1775772959.416687:0:163738:0:(file.c:1057:ll_file_open()) START file f-5:[0x240002729:0x1c:0x0](ffff8de1c403d348), flags 100102 00000002:00100000:1.0:1775772959.416708:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e17100 x1862023612249088/t25769803789(25769803789) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772959.416805:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8ed from it ffff8de1c670f780 00010000:00010000:1.0:1775772959.416811:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.416820:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.416839:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1c:0x0](ffff8de1c403d348), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772959.416868:0:163738:0:(file.c:447:ll_file_release()) START file f-5:[0x240002729:0x1c:0x0](ffff8de1c403d348), flags 100002 00000002:00100000:1.0:1775772959.416911:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e17100 x1862023612249088/t25769803789(25769803789) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772959.416940:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772959.416945:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e17b80 x1862023612249344/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772959.416968:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249344:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772959.417031:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.423911:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249344:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772959.424135:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c2e17100 x1862023612249088/t25769803789(25769803789) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772959.424209:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772959.424228:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772959.424245:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:1.0:1775772959.424259:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:1.0:1775772959.424268:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772959.424273:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772959.424277:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:1.0:1775772959.424282:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:1.0:1775772959.424286:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:1.0:1775772959.424294:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:1.0:1775772959.424308:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.424314:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:1.0:1775772959.424320:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.424324:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772959.424327:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.424339:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.424343:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-6, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1c9960300, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772959.424351:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-6, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:1.0:1775772959.424371:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-6,[0x240002729:0x1d:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772959.424421:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.424433:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772959.424444:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772959.424450:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16680 x1862023612249600/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772959.424460:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772959.424481:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249600:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772959.424676:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.429175:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249600:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772959.429207:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429242:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429250:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429263:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429274:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429291:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429299:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429306:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.429316:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e16680 x1862023612249600/t25769803791(25769803791) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772959.429328:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e16680 x1862023612249600/t25769803791(25769803791) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.429340:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772959.429352:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429362:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/29 (0 0) 00000080:00200000:1.0:1775772959.429369:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772959.429383:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-6, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:1.0:1775772959.429414:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x1d:0x0](ffff8de1c403e3c8) 00000080:00200000:1.0:1775772959.429716:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x1d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772959.429750:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x1d:0x0](ffff8de1c403e3c8) 00000080:00010000:1.0:1775772959.429754:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x1d:0x0](ffff8de1c403e3c8) for lock 0x8a9f4e958445e8f4 00000080:00010000:1.0:1775772959.429764:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x1d:0x0](ffff8de1c403e3c8) 00000080:00200008:1.0:1775772959.429779:0:163738:0:(file.c:1057:ll_file_open()) START file f-6:[0x240002729:0x1d:0x0](ffff8de1c403e3c8), flags 100102 00000002:00100000:1.0:1775772959.429804:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e16680 x1862023612249600/t25769803791(25769803791) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772959.429850:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8f4 from it ffff8de1c670f780 00010000:00010000:1.0:1775772959.429855:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.429865:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.429885:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1d:0x0](ffff8de1c403e3c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772959.430289:0:163738:0:(file.c:447:ll_file_release()) START file f-6:[0x240002729:0x1d:0x0](ffff8de1c403e3c8), flags 100002 00000002:00100000:1.0:1775772959.430337:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e16680 x1862023612249600/t25769803791(25769803791) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772959.430348:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772959.430352:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14380 x1862023612249856/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772959.430375:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249856:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772959.430492:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.434374:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612249856:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772959.434411:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c2e16680 x1862023612249600/t25769803791(25769803791) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772959.434486:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772959.434802:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772959.434821:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:1.0:1775772959.434835:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:1.0:1775772959.434843:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772959.434849:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772959.434853:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:1.0:1775772959.434860:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:1.0:1775772959.434864:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:1.0:1775772959.434873:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:1.0:1775772959.434888:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.434895:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:1.0:1775772959.434901:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.434905:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772959.434909:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.435086:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.435093:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-7, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1c9961200, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772959.435109:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-7, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:1.0:1775772959.435132:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-7,[0x240002729:0x1e:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772959.435188:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.435201:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772959.435213:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772959.435221:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14a80 x1862023612250112/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772959.435231:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772959.435252:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250112:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772959.435425:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.440265:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250112:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772959.440291:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440321:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440329:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440339:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440350:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440367:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440375:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440381:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.440391:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e14a80 x1862023612250112/t25769803793(25769803793) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772959.440404:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e14a80 x1862023612250112/t25769803793(25769803793) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.440418:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772959.440430:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440440:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/30 (0 0) 00000080:00200000:1.0:1775772959.440446:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772959.440460:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-7, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:1.0:1775772959.440490:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x1e:0x0](ffff8de1c403f448) 00000080:00200000:1.0:1775772959.440750:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x1e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772959.440761:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x1e:0x0](ffff8de1c403f448) 00000080:00010000:1.0:1775772959.440765:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x1e:0x0](ffff8de1c403f448) for lock 0x8a9f4e958445e8fb 00000080:00010000:1.0:1775772959.440775:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x1e:0x0](ffff8de1c403f448) 00000080:00200008:1.0:1775772959.440787:0:163738:0:(file.c:1057:ll_file_open()) START file f-7:[0x240002729:0x1e:0x0](ffff8de1c403f448), flags 100102 00000002:00100000:1.0:1775772959.440808:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e14a80 x1862023612250112/t25769803793(25769803793) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772959.440847:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8fb from it ffff8de1c670f780 00010000:00010000:1.0:1775772959.440852:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.440860:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.440881:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1e:0x0](ffff8de1c403f448), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772959.440907:0:163738:0:(file.c:447:ll_file_release()) START file f-7:[0x240002729:0x1e:0x0](ffff8de1c403f448), flags 100002 00000002:00100000:1.0:1775772959.441123:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e14a80 x1862023612250112/t25769803793(25769803793) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772959.441134:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772959.441139:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15180 x1862023612250368/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772959.441162:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250368:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772959.441293:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627300 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.444872:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250368:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772959.444909:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c2e14a80 x1862023612250112/t25769803793(25769803793) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772959.445152:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772959.445175:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772959.445195:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1775772959.445210:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:1.0:1775772959.445218:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772959.445224:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772959.445228:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:1.0:1775772959.445234:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:1.0:1775772959.445238:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1775772959.445247:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:1.0:1775772959.445260:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.445268:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:1.0:1775772959.445274:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.445278:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772959.445282:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.445294:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.445299:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-8, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1c9960d80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772959.445306:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-8, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:1.0:1775772959.445327:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-8,[0x240002729:0x1f:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772959.445377:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.445390:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772959.445401:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772959.445407:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16a00 x1862023612250624/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772959.445415:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772959.445435:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250624:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772959.445678:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627300 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.455670:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250624:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772959.455698:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455771:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455779:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455792:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455803:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455821:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455829:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455836:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.455847:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e16a00 x1862023612250624/t25769803795(25769803795) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772959.455859:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e16a00 x1862023612250624/t25769803795(25769803795) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.455873:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772959.455885:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.455895:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/31 (0 0) 00000080:00200000:1.0:1775772959.455902:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772959.455931:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-8, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:1.0:1775772959.455959:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x1f:0x0](ffff8de1c40380c8) 00000080:00200000:1.0:1775772959.456068:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x1f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772959.456078:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x1f:0x0](ffff8de1c40380c8) 00000080:00010000:1.0:1775772959.456082:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x1f:0x0](ffff8de1c40380c8) for lock 0x8a9f4e958445e902 00000080:00010000:1.0:1775772959.456091:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x1f:0x0](ffff8de1c40380c8) 00000080:00200008:1.0:1775772959.456114:0:163738:0:(file.c:1057:ll_file_open()) START file f-8:[0x240002729:0x1f:0x0](ffff8de1c40380c8), flags 100102 00000002:00100000:1.0:1775772959.456136:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e16a00 x1862023612250624/t25769803795(25769803795) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772959.456177:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e902 from it ffff8de1c670f780 00010000:00010000:1.0:1775772959.456182:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.456191:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.456213:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x1f:0x0](ffff8de1c40380c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772959.456242:0:163738:0:(file.c:447:ll_file_release()) START file f-8:[0x240002729:0x1f:0x0](ffff8de1c40380c8), flags 100002 00000002:00100000:1.0:1775772959.456285:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e16a00 x1862023612250624/t25769803795(25769803795) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772959.456295:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772959.456299:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14000 x1862023612250880/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772959.456320:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250880:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772959.456382:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627f00 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.459550:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612250880:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772959.459582:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c2e16a00 x1862023612250624/t25769803795(25769803795) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772959.459649:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772959.459666:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772959.459685:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:1.0:1775772959.459699:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:1.0:1775772959.459707:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772959.459713:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772959.459716:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:1.0:1775772959.460045:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:1.0:1775772959.460051:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:1.0:1775772959.460061:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:1.0:1775772959.460077:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.460085:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:1.0:1775772959.460091:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.460095:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772959.460106:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.460119:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.460124:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-9, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1c9960300, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772959.460132:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-9, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:1.0:1775772959.460153:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-9,[0x240002729:0x20:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772959.460205:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.460217:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772959.460228:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772959.460234:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15c00 x1862023612251136/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772959.460242:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772959.460261:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251136:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772959.460384:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627f00 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.465933:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251136:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772959.465960:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.465993:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466001:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466012:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466022:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466041:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466048:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466055:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.466067:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e15c00 x1862023612251136/t25769803797(25769803797) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772959.466080:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e15c00 x1862023612251136/t25769803797(25769803797) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.466094:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772959.466117:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466127:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/32 (0 0) 00000080:00200000:1.0:1775772959.466134:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772959.466148:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-9, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:1.0:1775772959.466180:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x20:0x0](ffff8de1c4038908) 00000080:00200000:1.0:1775772959.466294:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x20:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772959.466304:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x20:0x0](ffff8de1c4038908) 00000080:00010000:1.0:1775772959.466308:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x20:0x0](ffff8de1c4038908) for lock 0x8a9f4e958445e909 00000080:00010000:1.0:1775772959.466317:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x20:0x0](ffff8de1c4038908) 00000080:00200008:1.0:1775772959.466330:0:163738:0:(file.c:1057:ll_file_open()) START file f-9:[0x240002729:0x20:0x0](ffff8de1c4038908), flags 100102 00000002:00100000:1.0:1775772959.466350:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e15c00 x1862023612251136/t25769803797(25769803797) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772959.466394:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e909 from it ffff8de1c670f780 00010000:00010000:1.0:1775772959.466398:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.466406:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.466426:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x20:0x0](ffff8de1c4038908), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772959.466455:0:163738:0:(file.c:447:ll_file_release()) START file f-9:[0x240002729:0x20:0x0](ffff8de1c4038908), flags 100002 00000002:00100000:1.0:1775772959.466498:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e15c00 x1862023612251136/t25769803797(25769803797) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772959.466507:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772959.466512:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16d80 x1862023612251392/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772959.466532:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251392:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772959.466607:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.470975:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251392:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775772959.471013:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c2e15c00 x1862023612251136/t25769803797(25769803797) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775772959.471093:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772959.471124:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772959.471144:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1775772959.471159:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:1.0:1775772959.471167:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772959.471173:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772959.471176:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:1.0:1775772959.471184:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:1.0:1775772959.471188:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1775772959.471197:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:1.0:1775772959.471214:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.471221:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:1.0:1775772959.471227:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.471232:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775772959.471235:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.471249:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.471253:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-10, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1c9960d80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775772959.471261:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-10, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:1.0:1775772959.471279:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-10,[0x240002729:0x21:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775772959.471331:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.471344:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775772959.471354:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775772959.471360:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15880 x1862023612251648/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775772959.471369:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775772959.471388:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251648:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775772959.471518:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.479983:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251648:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775772959.480009:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480039:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480046:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480058:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480069:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480088:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480113:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480128:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.480140:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c2e15880 x1862023612251648/t25769803799(25769803799) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775772959.480153:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e15880 x1862023612251648/t25769803799(25769803799) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.480169:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775772959.480181:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480191:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/33 (0 0) 00000080:00200000:1.0:1775772959.480597:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775772959.480615:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-10, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:1.0:1775772959.480651:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x21:0x0](ffff8de1c403db88) 00000080:00200000:1.0:1775772959.480795:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x21:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775772959.480807:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x21:0x0](ffff8de1c403db88) 00000080:00010000:1.0:1775772959.480811:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x21:0x0](ffff8de1c403db88) for lock 0x8a9f4e958445e910 00000080:00010000:1.0:1775772959.480820:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x21:0x0](ffff8de1c403db88) 00000080:00200008:1.0:1775772959.480833:0:163738:0:(file.c:1057:ll_file_open()) START file f-10:[0x240002729:0x21:0x0](ffff8de1c403db88), flags 100102 00000002:00100000:1.0:1775772959.480854:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c2e15880 x1862023612251648/t25769803799(25769803799) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775772959.480893:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e910 from it ffff8de1c670f780 00010000:00010000:1.0:1775772959.480897:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.480906:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.480928:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x21:0x0](ffff8de1c403db88), inode mode 81a4 mask 40 00000080:00200008:1.0:1775772959.480957:0:163738:0:(file.c:447:ll_file_release()) START file f-10:[0x240002729:0x21:0x0](ffff8de1c403db88), flags 100002 00000002:00100000:1.0:1775772959.480997:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c2e15880 x1862023612251648/t25769803799(25769803799) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775772959.481007:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775772959.481012:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16300 x1862023612251904/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775772959.481032:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612251904:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775772959.481120:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627b40 going to sleep for 11 seconds 00000002:00100000:3.0:1775772959.519451:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75500 x1862023612252672/t25769803803(25769803803) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775772959.519540:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772959.519560:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772959.519578:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:3.0:1775772959.519593:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:3.0:1775772959.519602:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772959.519608:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772959.519612:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:3.0:1775772959.519618:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:3.0:1775772959.519622:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:3.0:1775772959.519631:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:3.0:1775772959.519647:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.519654:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:3.0:1775772959.519661:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.519664:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775772959.519668:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.519681:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775772959.519685:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-13, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1e0178780, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775772959.519693:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-13, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:3.0:1775772959.519714:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-13,[0x240002729:0x24:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775772959.520338:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.520353:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775772959.520367:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775772959.520375:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ee300 x1862023612253184/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775772959.520383:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772959.520402:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253184:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775772959.520531:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.526818:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253184:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775772959.526841:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526869:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526876:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526886:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526895:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526912:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526934:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526941:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775772959.526951:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ee300 x1862023612253184/t25769803805(25769803805) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775772959.526963:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ee300 x1862023612253184/t25769803805(25769803805) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775772959.526975:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775772959.526985:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.526995:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/36 (0 0) 00000080:00200000:3.0:1775772959.527002:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775772959.527013:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-13, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:3.0:1775772959.527037:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x24:0x0](ffff8de1c407ec08) 00000080:00200000:3.0:1775772959.527160:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x24:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775772959.527170:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x24:0x0](ffff8de1c407ec08) 00000080:00010000:3.0:1775772959.527174:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x24:0x0](ffff8de1c407ec08) for lock 0x8a9f4e958445e925 00000080:00010000:3.0:1775772959.527183:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x24:0x0](ffff8de1c407ec08) 00000080:00200008:3.0:1775772959.527197:0:163738:0:(file.c:1057:ll_file_open()) START file f-13:[0x240002729:0x24:0x0](ffff8de1c407ec08), flags 100102 00000002:00100000:3.0:1775772959.527216:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ee300 x1862023612253184/t25769803805(25769803805) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775772959.527255:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e925 from it ffff8de1c7cee2a0 00010000:00010000:3.0:1775772959.527260:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.527268:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772959.527287:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x24:0x0](ffff8de1c407ec08), inode mode 81a4 mask 40 00000080:00200008:3.0:1775772959.527315:0:163738:0:(file.c:447:ll_file_release()) START file f-13:[0x240002729:0x24:0x0](ffff8de1c407ec08), flags 100002 00000002:00100000:3.0:1775772959.527361:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ee300 x1862023612253184/t25769803805(25769803805) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775772959.527370:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775772959.527374:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01efb80 x1862023612253440/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775772959.527394:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253440:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775772959.527472:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.531301:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253440:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775772959.531336:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ee300 x1862023612253184/t25769803805(25769803805) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775772959.531411:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772959.531431:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772959.531450:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:3.0:1775772959.531464:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:3.0:1775772959.531472:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772959.531478:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772959.531482:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:3.0:1775772959.531489:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:3.0:1775772959.531493:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:3.0:1775772959.531502:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:3.0:1775772959.531531:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.531539:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:3.0:1775772959.531546:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.531550:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775772959.531554:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.531567:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775772959.531571:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-14, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1e0179b00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775772959.531579:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-14, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:3.0:1775772959.531600:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-14,[0x240002729:0x25:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775772959.531652:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.531665:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775772959.531675:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775772959.531681:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ed500 x1862023612253696/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775772959.531691:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772959.531710:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253696:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775772959.531858:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.536454:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253696:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775772959.536479:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536522:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 4/0,1 mode: --/PR res: [0x240002729:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536530:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 4/0,1 mode: --/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536542:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536552:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536568:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536575:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536582:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775772959.536592:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ed500 x1862023612253696/t25769803807(25769803807) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775772959.536605:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ed500 x1862023612253696/t25769803807(25769803807) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775772959.536620:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775772959.536633:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.536643:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/37 (0 0) 00000080:00200000:3.0:1775772959.536649:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775772959.536664:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-14, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:3.0:1775772959.536700:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x25:0x0](ffff8de1c407ba88) 00000080:00200000:3.0:1775772959.536866:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x25:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775772959.536877:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x25:0x0](ffff8de1c407ba88) 00000080:00010000:3.0:1775772959.536880:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x25:0x0](ffff8de1c407ba88) for lock 0x8a9f4e958445e92c 00000080:00010000:3.0:1775772959.536890:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x25:0x0](ffff8de1c407ba88) 00000080:00200008:3.0:1775772959.536901:0:163738:0:(file.c:1057:ll_file_open()) START file f-14:[0x240002729:0x25:0x0](ffff8de1c407ba88), flags 100102 00000002:00100000:3.0:1775772959.537141:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ed500 x1862023612253696/t25769803807(25769803807) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775772959.537179:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e92c from it ffff8de1c7cee2a0 00010000:00010000:3.0:1775772959.537184:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.537192:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772959.537212:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x25:0x0](ffff8de1c407ba88), inode mode 81a4 mask 40 00000080:00200008:3.0:1775772959.537245:0:163738:0:(file.c:447:ll_file_release()) START file f-14:[0x240002729:0x25:0x0](ffff8de1c407ba88), flags 100002 00000002:00100000:3.0:1775772959.537286:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ed500 x1862023612253696/t25769803807(25769803807) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775772959.537296:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775772959.537300:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ece00 x1862023612253952/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775772959.537322:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253952:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775772959.537386:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0900 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.541284:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612253952:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775772959.541321:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ed500 x1862023612253696/t25769803807(25769803807) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775772959.541401:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772959.541420:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772959.541436:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:3.0:1775772959.541450:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:3.0:1775772959.541458:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772959.541463:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772959.541467:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:3.0:1775772959.541473:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:3.0:1775772959.541477:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:3.0:1775772959.541486:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:3.0:1775772959.541500:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.541506:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:3.0:1775772959.541717:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.541749:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775772959.541755:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.541770:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775772959.541774:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-15, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1e0178c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775772959.541783:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-15, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:3.0:1775772959.541807:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-15,[0x240002729:0x26:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775772959.541863:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.541876:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775772959.541887:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775772959.541892:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ef100 x1862023612254208/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775772959.541901:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772959.542018:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612254208:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775772959.542214:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0900 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.547301:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612254208:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775772959.547326:0:163738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547357:0:163738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547364:0:163738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547376:0:163738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547385:0:163738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547403:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547411:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547418:0:163738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775772959.547430:0:163738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ef100 x1862023612254208/t25769803809(25769803809) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775772959.547442:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ef100 x1862023612254208/t25769803809(25769803809) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775772959.547457:0:163738:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775772959.547470:0:163738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547479:0:163738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/38 (0 0) 00000080:00200000:3.0:1775772959.547487:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x16:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775772959.547503:0:163738:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-15, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000080:00200000:3.0:1775772959.547532:0:163738:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x26:0x0](ffff8de1c407c2c8) 00000080:00200000:3.0:1775772959.547655:0:163738:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x26:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775772959.547665:0:163738:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x26:0x0](ffff8de1c407c2c8) 00000080:00010000:3.0:1775772959.547670:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x26:0x0](ffff8de1c407c2c8) for lock 0x8a9f4e958445e933 00000080:00010000:3.0:1775772959.547681:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x26:0x0](ffff8de1c407c2c8) 00000080:00200008:3.0:1775772959.547697:0:163738:0:(file.c:1057:ll_file_open()) START file f-15:[0x240002729:0x26:0x0](ffff8de1c407c2c8), flags 100102 00000002:00100000:3.0:1775772959.547718:0:163738:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ef100 x1862023612254208/t25769803809(25769803809) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775772959.547806:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e933 from it ffff8de1c7cee2a0 00010000:00010000:3.0:1775772959.547810:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.547818:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772959.547839:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x26:0x0](ffff8de1c407c2c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775772959.547866:0:163738:0:(file.c:447:ll_file_release()) START file f-15:[0x240002729:0x26:0x0](ffff8de1c407c2c8), flags 100002 00000002:00100000:3.0:1775772959.547906:0:163738:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ef100 x1862023612254208/t25769803809(25769803809) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775772959.547916:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775772959.547920:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ec380 x1862023612254464/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775772959.547941:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612254464:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775772959.548000:0:163738:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.551331:0:163738:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612254464:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775772959.551364:0:163738:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ef100 x1862023612254208/t25769803809(25769803809) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775772959.551440:0:163738:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772959.551459:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772959.551475:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1775772959.551489:0:163738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:3.0:1775772959.551496:0:163738:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772959.551501:0:163738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772959.551505:0:163738:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:3.0:1775772959.551511:0:163738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c151fbf8 00010000:00010000:3.0:1775772959.551516:0:163738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1775772959.551524:0:163738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:3.0:1775772959.551538:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.551546:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=25 00000080:00200000:3.0:1775772959.551553:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.551557:0:163738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775772959.551560:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.551574:0:163738:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775772959.551579:0:163738:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-16, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), file ffff8de1e0178780, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775772959.551587:0:163738:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-16, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8), intent=open|creat 00000002:00010000:3.0:1775772959.551609:0:163738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-16,[0x240002729:0x27:0x0]) in obj [0x240002729:0x16:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775772959.551662:0:163738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385c00/0x8a9f4e958445e93a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.551674:0:163738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385c00/0x8a9f4e958445e93a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775772959.551683:0:163738:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775772959.551689:0:163738:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ed880 x1862023612254720/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775772959.551698:0:163738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385c00/0x8a9f4e958445e93a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 163738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772959.551716:0:163738:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163738:1862023612254720:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775772959.635077:0:163743:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d2b840 going to sleep for 11 seconds 00000100:00100000:0.0:1775772959.643119:0:163743:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163743:1862023612257024:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772959.643148:0:163743:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 4/1,0 mode: --/CR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643174:0:163743:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 4/1,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643182:0:163743:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 4/1,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643192:0:163743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643202:0:163743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643214:0:163743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643222:0:163743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643230:0:163743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772959.643240:0:163743:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0f9bb80 x1862023612257024/t25769803820(25769803820) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775772959.643253:0:163743:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9bb80 x1862023612257024/t25769803820(25769803820) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772959.643266:0:163743:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775772959.643278:0:163743:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643289:0:163743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772959.643301:0:163743:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772959.643309:0:163743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643315:0:163743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643322:0:163743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.643347:0:163743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:0.0:1775772959.643356:0:163743:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x240002729:0x16:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772959.643453:0:163743:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x18:0x0]: layout version change: 0 -> 0 00000080:00010000:0.0:1775772959.643463:0:163743:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x18:0x0](ffff8de1c4083248) for lock 0x8a9f4e958445e8d1 00000080:00010000:0.0:1775772959.643470:0:163743:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8d1 from it ffff9ba1c1bcbbf0 00010000:00010000:0.0:1775772959.643474:0:163743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775772959.643483:0:163743:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1775772959.643525:0:163743:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9bb80 x1862023612257024/t25769803820(25769803820) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1775772959.643601:0:163743:0:(file.c:4602:ll_file_ioctl()) VFS Op:inode=[0x240002729:0x18:0x0](ffff8de1c4083248) cmd=800466af arg=7fffcb578fec 00000080:00200008:0.0:1775772959.643625:0:163743:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x18:0x0](ffff8de1c4083248), flags 100000 00000002:00100000:0.0:1775772959.643665:0:163743:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9bb80 x1862023612257024/t25769803820(25769803820) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775772959.643675:0:163743:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775772959.643680:0:163743:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d7b80 x1862023612257280/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775772959.643701:0:163743:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163743:1862023612257280:192.168.201.137@tcp:35:lfs.0 00010000:00010000:3.0:1775772959.643962:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775772959.643969:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.643977:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c512ec00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775772959.643981:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.643990:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.643998:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.644013:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772959.644043:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 2/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.644049:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775772959.644076:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 1/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.644083:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445e95d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da97bf expref: -99 pid: 163743 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.644109:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772959.644111:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772959.644112:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772959.644121:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775772959.644133:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612257408:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1775772959.644180:0:163743:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9180 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.652270:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612257408:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1775772959.653288:0:163743:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163743:1862023612257280:192.168.201.137@tcp:35:lfs.0 00000002:00100000:0.0:1775772959.653322:0:163743:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9bb80 x1862023612257024/t25769803820(25769803820) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1775772959.653540:0:163743:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x16:0x0](ffff8de1c407a1c8), flags 304000 00000002:00100000:0.0:1775772959.653594:0:163743:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9ad80 x1862023612256768/t25769803819(25769803819) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772975 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775772959.653605:0:163743:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775772959.653610:0:163743:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d7b80 x1862023612257664/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775772959.653638:0:163743:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163743:1862023612257664:192.168.201.137@tcp:35:lfs.0 00000100:00100000:0.0:1775772959.653707:0:163743:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9180 going to sleep for 11 seconds 00000080:00200000:0.0:1775772959.666393:0:163744:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772959.666422:0:163744:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772959.666442:0:163744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:0.0:1775772959.666456:0:163744:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:0.0:1775772959.666464:0:163744:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772959.666473:0:163744:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772959.666476:0:163744:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772959.666483:0:163744:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c1877b58 00010000:00010000:0.0:1775772959.666486:0:163744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:0.0:1775772959.666494:0:163744:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:0.0:1775772959.666510:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772959.666518:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=8 00000080:00200008:0.0:1775772959.666529:0:163744:0:(file.c:6226:ll_getattr_dentry()) START file d80b.replay-single:[0x200027cd1:0x4:0x0](ffff8de1c403cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775772959.666533:0:163744:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08),name=d80b.replay-single 00000002:00010000:0.0:1775772959.666545:0:163744:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772959.666551:0:163744:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/4 (0 0) 00010000:00010000:0.0:1775772959.666598:0:163744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.666605:0:163744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.666614:0:163744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772959.666639:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612257792:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775772959.667289:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.675538:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612257792:192.168.201.137@tcp:101:rm.0 00010000:00010000:1.0:1775772959.675566:0:163744:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675590:0:163744:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675599:0:163744:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675611:0:163744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675622:0:163744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675636:0:163744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675644:0:163744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675651:0:163744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775772959.675663:0:163744:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d7800 x1862023612257792/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772975 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775772959.675676:0:163744:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675685:0:163744:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/4 (0 0) 00000080:00200000:1.0:1775772959.675691:0:163744:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775772959.675718:0:163744:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x4:0x0], updating i_size 4096 00000080:00010000:1.0:1775772959.675742:0:163744:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x4:0x0](ffff8de1c403cb08) for lock 0x8a9f4e958445e964 00000080:00010000:1.0:1775772959.675751:0:163744:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x4:0x0](ffff8de1c403cb08) 00000080:00010000:1.0:1775772959.675754:0:163744:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e964 from it ffff9ba1c1877cb8 00010000:00010000:1.0:1775772959.675759:0:163744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775772959.675768:0:163744:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772959.675958:0:163744:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772959.675979:0:163744:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772959.675989:0:163744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:0.0:1775772959.676001:0:163744:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:0.0:1775772959.676008:0:163744:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772959.676013:0:163744:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772959.676016:0:163744:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e8b5 00000080:00010000:0.0:1775772959.676020:0:163744:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e8b5 from it ffff9ba1c1877bf8 00010000:00010000:0.0:1775772959.676023:0:163744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:0.0:1775772959.676030:0:163744:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94a1 expref: -99 pid: 163267 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:0.0:1775772959.676043:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772959.676051:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80b.replay-single, flags=266 00000080:00200000:0.0:1775772959.676056:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 44 00000080:00200008:0.0:1775772959.676065:0:163744:0:(file.c:1057:ll_file_open()) START file d80b.replay-single:[0x200027cd1:0x4:0x0](ffff8de1c403cb08), flags 704400 00000002:00010000:0.0:1775772959.676080:0:163744:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1775772959.676158:0:163744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34400/0x8a9f4e958445e96b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772959.676167:0:163744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34400/0x8a9f4e958445e96b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775772959.676179:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775772959.676185:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6a00 x1862023612258048/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775772959.676195:0:163744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34400/0x8a9f4e958445e96b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772959.676218:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612258048:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775772959.676384:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9480 going to sleep for 11 seconds 00000080:00200000:1.0:1775772959.753496:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x19:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.753667:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.753795:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x19:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.753815:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x19:0x0](ffff8de1c40842c8) 00000080:00200000:1.0:1775772959.754143:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.754156:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-3, flags=0 00000080:00200000:1.0:1775772959.754161:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.754165:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-3, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.754220:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445e8df lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da956c expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.754246:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x1a:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.754291:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445e8df lrc: 1/0,0 mode: --/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da956c expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.754297:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.754300:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445e8df lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da956c expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.754327:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.754337:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15f80 x1862023612259968/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.754357:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612259968:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.754491:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.770039:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612259968:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.770139:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x1a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.770152:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.770207:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x1a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.770222:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x1a:0x0](ffff8de1c40800c8) 00000080:00200000:1.0:1775772959.770316:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.770329:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-8, flags=0 00000080:00200000:1.0:1775772959.770334:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.770339:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-8, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.770392:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.770418:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x1f:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.770469:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.770476:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.770479:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445e902 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da961b expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.770504:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.770512:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30a80 x1862023612260224/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.770535:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260224:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.770615:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627600 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.779015:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260224:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.779120:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x1f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.779134:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.779190:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x1f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.779204:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x1f:0x0](ffff8de1c40380c8) 00000080:00200000:1.0:1775772959.779290:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.779301:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-7, flags=0 00000080:00200000:1.0:1775772959.779306:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.779311:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-7, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.779364:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.779389:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x1e:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.779435:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 1/0,0 mode: --/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.779441:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.779444:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445e8fb lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da95f8 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.779464:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.779471:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31180 x1862023612260480/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.779496:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260480:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.779563:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627300 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.786795:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260480:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.786881:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x1e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.786893:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.786971:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x1e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.786985:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x1e:0x0](ffff8de1c403f448) 00000080:00200000:1.0:1775772959.787073:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.787084:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-19, flags=0 00000080:00200000:1.0:1775772959.787089:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.787104:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-19, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.787153:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445e94f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da979c expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.787180:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x2a:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.787229:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445e94f lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da979c expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.787237:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.787239:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445e94f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da979c expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.787260:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.787268:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32300 x1862023612260736/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.787288:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260736:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.787357:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.794255:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260736:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.794338:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x2a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.794349:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.794404:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x2a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.794420:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x2a:0x0](ffff8de1c4082a08) 00000080:00200000:1.0:1775772959.794512:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.794524:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-10, flags=0 00000080:00200000:1.0:1775772959.794529:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.794534:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-10, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.794584:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.794613:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x21:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.794665:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.794672:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.794674:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445e910 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9661 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.794695:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.794703:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31880 x1862023612260992/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.795089:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260992:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.795174:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.802127:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612260992:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.802208:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x21:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.802220:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.802270:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x21:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.802282:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x21:0x0](ffff8de1c403db88) 00000080:00200000:1.0:1775772959.802364:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.802375:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-14, flags=0 00000080:00200000:1.0:1775772959.802380:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.802384:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-14, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.802431:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.802455:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x25:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.802501:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 1/0,0 mode: --/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.802507:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.802510:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445e92c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da96ed expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.802533:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.802540:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30000 x1862023612261248/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.802562:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612261248:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.802632:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.808401:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612261248:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.808484:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x25:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.808497:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.808561:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x25:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.808576:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x25:0x0](ffff8de1c407ba88) 00000080:00200000:1.0:1775772959.808672:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.808683:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-6, flags=0 00000080:00200000:1.0:1775772959.808689:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.808693:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-6, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.808802:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.808832:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x1d:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.808882:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.808890:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.808892:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445e8f4 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da95d5 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.809088:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.809107:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30700 x1862023612261504/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.809130:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612261504:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.809194:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.816112:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612261504:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.816208:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x1d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.816219:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.816274:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x1d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.816288:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x1d:0x0](ffff8de1c403e3c8) 00000080:00200000:1.0:1775772959.816377:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.816389:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-11, flags=0 00000080:00200000:1.0:1775772959.816394:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.816399:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-11, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.816455:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445e917 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9684 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.816485:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x22:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.816553:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445e917 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9684 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.816561:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.816564:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445e917 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9684 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.816588:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.816596:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31500 x1862023612261760/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.816616:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612261760:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.816687:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.822589:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612261760:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.822676:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x22:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.822689:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.822791:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x22:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.822805:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x22:0x0](ffff8de1c4080908) 00000080:00200000:1.0:1775772959.822896:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.822907:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-4, flags=0 00000080:00200000:1.0:1775772959.822911:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.822917:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-4, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.822980:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e8e6 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da958f expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.823007:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x1b:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.823052:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e8e6 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da958f expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.823059:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.823061:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e8e6 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da958f expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.823081:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.823088:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33480 x1862023612262016/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.823119:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262016:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.823181:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.828969:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262016:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.829052:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x1b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.829065:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.829128:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x1b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.829141:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x1b:0x0](ffff8de1c4085348) 00000080:00200000:1.0:1775772959.829237:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.829249:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-18, flags=0 00000080:00200000:1.0:1775772959.829254:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.829259:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-18, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.829311:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445e948 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9779 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.829343:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x29:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.829398:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445e948 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9779 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.829406:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.829409:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445e948 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9779 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.829431:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.829439:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32a00 x1862023612262272/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.829465:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262272:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.829554:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.836265:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262272:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.836395:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x29:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.836412:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.836476:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x29:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.836493:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x29:0x0](ffff8de1c4081988) 00000080:00200000:1.0:1775772959.836662:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.836673:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-17, flags=0 00000080:00200000:1.0:1775772959.836679:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.836684:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-17, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.836779:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445e941 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9756 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.836806:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x28:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.836856:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445e941 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9756 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.836864:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.836866:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445e941 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9756 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.836890:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.836899:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32d80 x1862023612262528/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.836922:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262528:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.836983:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.846163:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262528:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.846262:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x28:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.846276:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.846331:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x28:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.846345:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x28:0x0](ffff8de1c40863c8) 00000080:00200000:1.0:1775772959.846446:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.846458:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-0, flags=0 00000080:00200000:1.0:1775772959.846464:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.846468:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-0, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.846519:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e8ca lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9503 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.846546:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x17:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.846594:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e8ca lrc: 1/0,0 mode: --/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9503 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.846607:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.846610:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e8ca lrc: 0/0,0 mode: --/PR res: [0x240002729:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9503 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.846631:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.846639:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33b80 x1862023612262784/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.846659:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262784:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.846787:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.854655:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612262784:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.854812:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x17:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.854825:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.854880:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x17:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.854893:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x17:0x0](ffff8de1c4085b88) 00000080:00200000:1.0:1775772959.855122:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.855134:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-15, flags=0 00000080:00200000:1.0:1775772959.855139:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.855144:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-15, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.855197:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.855304:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x26:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.855354:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.855362:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.855366:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445e933 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9710 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.855388:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.855396:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32680 x1862023612263040/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.855421:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263040:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.855487:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.861851:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263040:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.861951:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x26:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.861963:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.862017:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x26:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.862030:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x26:0x0](ffff8de1c407c2c8) 00000080:00200000:1.0:1775772959.862132:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.862145:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-5, flags=0 00000080:00200000:1.0:1775772959.862151:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.862156:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-5, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.862213:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.862239:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x1c:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.862290:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 1/0,0 mode: --/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.862297:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.862299:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445e8ed lrc: 0/0,0 mode: --/PR res: [0x240002729:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da95b2 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.862324:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.862331:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30e00 x1862023612263296/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.862351:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263296:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.862415:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.868978:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263296:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.869065:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x1c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.869077:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.869138:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x1c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.869150:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x1c:0x0](ffff8de1c403d348) 00000080:00200000:1.0:1775772959.869238:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.869249:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-16, flags=0 00000080:00200000:1.0:1775772959.869254:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.869259:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-16, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.869310:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385c00/0x8a9f4e958445e93a lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9733 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.869336:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x27:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.869390:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385c00/0x8a9f4e958445e93a lrc: 1/0,0 mode: --/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9733 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.869398:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.869401:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385c00/0x8a9f4e958445e93a lrc: 0/0,0 mode: --/PR res: [0x240002729:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9733 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.869424:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.869432:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33100 x1862023612263552/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.869453:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263552:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.869624:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e06279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.875613:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263552:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.875699:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x27:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.875711:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.875812:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x27:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.875826:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x27:0x0](ffff8de1c4086c08) 00000080:00200000:1.0:1775772959.875982:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.875994:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-9, flags=0 00000080:00200000:1.0:1775772959.875999:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.876005:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-9, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.876059:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775772959.876086:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x20:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.876168:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772959.876176:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.876179:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445e909 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da963e expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775772959.876201:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.876211:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31c00 x1862023612263808/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775772959.876241:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263808:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775772959.876308:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1e0627300 going to sleep for 11 seconds 00000100:00100000:1.0:1775772959.887122:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612263808:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775772959.887209:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x20:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775772959.887220:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775772959.887275:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x20:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775772959.887287:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x20:0x0](ffff8de1c4038908) 00000080:00200000:1.0:1775772959.887377:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775772959.887388:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=0 00000080:00200000:1.0:1775772959.887393:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775772959.887397:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-1, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:1.0:1775772959.887448:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775772959.887475:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x18:0x0]: losing layout lock 00010000:00010000:1.0:1775772959.887697:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775772959.887704:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775772959.887707:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e8d1 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9526 expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:1.0:1775772959.887878:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775772959.887886:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31f80 x1862023612264064/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772959.893202:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612264064:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775772959.893284:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1775772959.893296:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1775772959.893346:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1775772959.893358:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x18:0x0](ffff8de1c4083248) 00000080:00200000:3.0:1775772959.893443:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.893454:0:163744:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-13, flags=0 00000080:00200000:3.0:1775772959.893459:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x16:0x0](ffff8de1c407a1c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775772959.893464:0:163744:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-13, dir=[0x240002729:0x16:0x0](ffff8de1c407a1c8) 00010000:00010000:3.0:1775772959.893515:0:163744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772959.893539:0:163744:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x24:0x0]: losing layout lock 00010000:00010000:3.0:1775772959.893586:0:163744:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775772959.893593:0:163744:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775772959.893597:0:163744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445e925 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da96ca expref: -99 pid: 163738 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1775772959.893618:0:163744:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775772959.893626:0:163744:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eed80 x1862023612264320/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772959.893648:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612264320:192.168.201.137@tcp:36:rm.0 00000100:00100000:3.0:1775772959.893754:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1775772959.898513:0:163744:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612264320:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775772959.898604:0:163744:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x24:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1775772959.898617:0:163744:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1775772959.898668:0:163744:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x24:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1775772959.898682:0:163744:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x24:0x0](ffff8de1c407ec08) 00000080:00200008:3.0:1775772959.898806:0:163744:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x16:0x0](ffff8de1c407a1c8), flags 704000 00010000:00010000:3.0:1775772959.898831:0:163744:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445e980 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x16:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9813 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775772959.898866:0:163744:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1775772959.898881:0:163744:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), flags=0 00000080:00200000:3.0:1775772959.898885:0:163744:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x4:0x0](ffff8de1c403cb08), intent=getattr 00000002:00010000:3.0:1775772959.898915:0:163744:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0x4:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772959.899134:0:163744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.899143:0:163744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.899153:0:163744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 163744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772959.899173:0:163744:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eca80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:163744:1862023612264448:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775772959.900236:0:163744:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31e03c0 going to sleep for 11 seconds 00010000:00010000:3.0:1775772959.906269:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775772959.906278:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906287:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384e00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775772959.906292:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906301:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906308:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906326:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e8bc lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da94cb expref: -99 pid: 163731 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775772959.906358:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 2/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906365:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775772959.906397:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906405:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445e987 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x16:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9a66 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772959.906418:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772959.906420:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772959.906422:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772959.906431:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775772959.906446:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612264704:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775772959.910226:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612264704:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775772959.914692:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612264832:192.168.201.137@tcp:103:rm.0 00000100:00100000:3.0:1775772959.920330:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612264832:192.168.201.137@tcp:103:rm.0 00000100:00100000:1.0:1775772959.924757:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772959.924799:0:160416:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1775772959.924818:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625113472 00000100:00100000:1.0:1775772959.924827:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625113472 00000100:00100000:1.0:1775772959.924871:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 6 00000100:00100000:1.0:1775772959.924881:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1d338f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625113472:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772959.924899:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775772959.925132:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772959.925139:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1d338f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625113472:12345-192.168.201.137@tcp:104: Request processed in 259us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772959.925146:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 6 00010000:00010000:3.0:1775772959.926605:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775772959.926616:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926627:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e34a00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775772959.926633:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926641:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926652:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926676:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445e868 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da910c expref: -99 pid: 162761 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772959.926746:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926752:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775772959.926778:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926785:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445e964 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da97d4 expref: -99 pid: 163744 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772959.926798:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772959.926800:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775772959.926801:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772959.926809:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775772959.926827:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612265472:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775772959.937021:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612265472:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775772961.536106:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772964.163981:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612266112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.164101:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.164137:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266624:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.164163:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775772964.164168:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.164193:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266496:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.186294:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.186314:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612266112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.186325:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.186336:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266624:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772964.189768:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612266496:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772964.609219:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772966.663499:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775772966.685201:0:164310:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80c: DNE: create remote dir, drop update rep from MDT1, fail MDT[0,1] ========================================================== 18:16:05 (1775772965) 00000080:00200000:3.0:1775772967.113748:0:164323:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772967.113779:0:164323:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772967.113841:0:164323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.113852:0:164323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.113863:0:164323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772967.113887:0:164323:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164323:1862023612266752:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775772967.113978:0:164323:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772967.143089:0:164323:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164323:1862023612266752:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775772967.143115:0:164323:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143128:0:164323:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143139:0:164323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143151:0:164323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143163:0:164323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143171:0:164323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143178:0:164323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775772967.143190:0:164323:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d01ec700 x1862023612266752/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772983 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775772967.143204:0:164323:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445e995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b54 expref: -99 pid: 164323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772967.143221:0:164323:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775772967.143227:0:164323:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772968.292707:0:164332:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772968.294642:0:164332:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772968.295424:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.295441:0:164332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.295456:0:164332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772968.295489:0:164332:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612267264:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772968.296889:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1775772968.315505:0:164332:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612267264:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772968.315539:0:164332:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315554:0:164332:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315568:0:164332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315582:0:164332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315597:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315606:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315614:0:164332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772968.315633:0:164332:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d4000 x1862023612267264/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772984 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772968.315647:0:164332:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.315664:0:164332:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1775772968.315671:0:164332:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772968.315706:0:164332:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:0.0:1775772968.315714:0:164332:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:0.0:1775772968.317039:0:164332:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772968.317049:0:164332:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1bdbb58 00010000:00010000:0.0:1775772968.317057:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.317071:0:164332:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775772968.317112:0:164332:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772968.317133:0:164332:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=29 00000080:00200000:0.0:1775772968.317138:0:164332:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=0 00000002:00010000:0.0:1775772968.317168:0:164332:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80c.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1775772968.318043:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445e9aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.318057:0:164332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445e9aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.318072:0:164332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445e9aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772968.318101:0:164332:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612267392:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772968.319255:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9f00 going to sleep for 11 seconds 00000080:00200000:2.0:1775772968.342333:0:164332:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775772968.342343:0:164332:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=13 00000080:00200008:2.0:1775772968.342355:0:164332:0:(file.c:6226:ll_getattr_dentry()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775772968.342359:0:164332:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88),name=d80c.replay-single 00000002:00010000:2.0:1775772968.342376:0:164332:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772968.342382:0:164332:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/7 (0 0) 00010000:00010000:2.0:1775772968.342429:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.342437:0:164332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.342447:0:164332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772968.342474:0:164332:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612267776:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775772968.342631:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775772968.362689:0:164332:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612267776:192.168.201.137@tcp:101:lfs.0 00010000:00010000:0.0:1775772968.362740:0:164332:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362777:0:164332:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362785:0:164332:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362798:0:164332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362820:0:164332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362835:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362843:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362855:0:164332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775772968.362866:0:164332:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f9a680 x1862023612267776/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772984 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775772968.362879:0:164332:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.362890:0:164332:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/7 (0 0) 00000080:00200000:0.0:1775772968.362922:0:164332:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775772968.362976:0:164332:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x7:0x0], updating i_size 4096 00000080:00010000:0.0:1775772968.362984:0:164332:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445e9bf 00000080:00010000:0.0:1775772968.362994:0:164332:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00000080:00010000:0.0:1775772968.362998:0:164332:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9bf from it ffff9ba1c1bdbcb8 00010000:00010000:0.0:1775772968.363001:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.363011:0:164332:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1775772968.364398:0:164332:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775772968.364408:0:164332:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772968.364434:0:164332:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772968.364452:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772968.364473:0:164332:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775772968.364481:0:164332:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772968.364488:0:164332:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772968.364491:0:164332:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:0.0:1775772968.364497:0:164332:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1bdbcb8 00010000:00010000:0.0:1775772968.364501:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775772968.364508:0:164332:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775772968.364670:0:164332:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775772968.364679:0:164332:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775772968.364686:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772968.364695:0:164332:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775772968.364701:0:164332:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775772968.364705:0:164332:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775772968.364707:0:164332:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:0.0:1775772968.364711:0:164332:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1bdbbf8 00010000:00010000:0.0:1775772968.364713:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775772968.364750:0:164332:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775772968.365030:0:164332:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775772968.365039:0:164332:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=267 00000080:00200000:0.0:1775772968.365048:0:164332:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 44 00000080:00200008:0.0:1775772968.365055:0:164332:0:(file.c:1057:ll_file_open()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags 300000 00000002:00010000:0.0:1775772968.365075:0:164332:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0240300001 00010000:00010000:0.0:1775772968.365133:0:164332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775772968.365142:0:164332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775772968.365156:0:164332:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775772968.365169:0:164332:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d5c00 x1862023612268032/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775772968.365638:0:164332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775772968.365669:0:164332:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612268032:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775772968.366506:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1775772968.390762:0:164332:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612268032:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775772968.390879:0:164332:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390900:0:164332:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390908:0:164332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390915:0:164332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390925:0:164332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390932:0:164332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e35600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775772968.390938:0:164332:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390957:0:164332:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390967:0:164332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390975:0:164332:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775772968.390983:0:164332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772968.390989:0:164332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445e9c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 164332 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775772968.391011:0:164332:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1c67d5c00 x1862023612268032/t352187318304(352187318304) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772984 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775772968.391024:0:164332:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c67d5c00 x1862023612268032/t352187318304(352187318304) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775772984 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775772968.391043:0:164332:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775772968.391083:0:164332:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x7:0x0], updating i_size 4096 00000002:00100000:2.0:1775772968.391107:0:164332:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c67d5c00 x1862023612268032/t352187318304(352187318304) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772984 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:2.0:1775772968.391197:0:164332:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) cmd=c03066f0 arg=7ffd1fd737d0 00000080:00200000:2.0:1775772968.391218:0:164332:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) name=remote_dir stripe_offset=1 stripe_count=0, hash_type=0 00000020:00100000:2.0:1775772968.391299:0:164332:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775772968.392419:0:164332:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9a300 x1862023612268288/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775772968.392464:0:164332:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612268288:192.168.201.137@tcp:36:lfs.0 00000100:00100000:2.0:1775772968.392570:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c3059e40 going to sleep for 11 seconds 00000100:00100000:1.0:1775772968.398273:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775772968.398323:0:160415:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625123200 00000100:00100000:1.0:1775772968.398337:0:160415:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625123200 00000100:00100000:1.0:1775772968.398412:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 7 00000100:00100000:1.0:1775772968.398426:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1d0a33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625123200:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775772968.398453:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775772968.398556:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775772968.398563:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1d0a33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182028:x1862023625123200:12345-192.168.201.137@tcp:104: Request processed in 142us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1775772968.398571:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 7 00010000:00010000:2.0:1775772968.399126:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775772968.399136:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399148:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c512ea00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775772968.399156:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399167:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399179:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399216:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445e9aa lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9ba8 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772968.399284:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399293:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775772968.399334:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399349:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445e9bf lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297da9be0 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772968.399371:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772968.399373:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772968.399374:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772968.399457:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612268416:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775772968.411098:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612268416:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775772968.704345:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775772969.096547:0:164342:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775772969.096568:0:164342:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772969.096602:0:164342:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772969.096628:0:164342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775772969.096649:0:164342:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775772969.096658:0:164342:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772969.096669:0:164342:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772969.096673:0:164342:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:1.0:1775772969.096681:0:164342:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1c0bcb8 00010000:00010000:1.0:1775772969.096686:0:164342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775772969.096964:0:164342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200008:1.0:1775772969.098304:0:164342:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775772969.098315:0:164342:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772969.098339:0:164342:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772969.098360:0:164342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775772969.098377:0:164342:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775772969.098384:0:164342:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772969.098392:0:164342:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772969.098396:0:164342:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:1.0:1775772969.098405:0:164342:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1c0bcb8 00010000:00010000:1.0:1775772969.098409:0:164342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775772969.098419:0:164342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1775772969.098593:0:164342:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775772969.098603:0:164342:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775772969.098611:0:164342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:1.0:1775772969.098621:0:164342:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1775772969.098627:0:164342:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775772969.098631:0:164342:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775772969.098633:0:164342:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:1.0:1775772969.098637:0:164342:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1c0bbb0 00010000:00010000:1.0:1775772969.098640:0:164342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:1.0:1775772969.098647:0:164342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:1.0:1775772969.098656:0:164342:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:1.0:1775772969.098666:0:164342:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:1.0:1775772969.099416:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:1.0:1775772969.099439:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92800 uarg=0000000000000000 00800000:00000004:1.0:1775772969.099448:0:164342:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8935, max_age 8944 00000100:00100000:1.0:1775772969.099501:0:164342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268544:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775772969.099649:0:164342:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.104127:0:164342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268544:192.168.201.137@tcp:41:lfs.0 00800000:00000004:3.0:1775772969.104170:0:164342:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:3.0:1775772969.104280:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.104300:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00800000:00000004:3.0:1775772969.104309:0:164342:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 8935, max_age 8944 00000100:00100000:3.0:1775772969.104355:0:164342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268672:192.168.201.137@tcp:41:lfs.0 00000100:00100000:3.0:1775772969.104451:0:164342:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.108040:0:164342:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 25769803846 gen 1 00000100:00100000:3.0:1775772969.108293:0:164342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268672:192.168.201.137@tcp:41:lfs.0 00800000:00000004:3.0:1775772969.108317:0:164342:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317328/353529 objects 1023719/1024000 00000080:00200080:3.0:1775772969.108412:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108433:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108443:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108448:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108452:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108456:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108459:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108463:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108468:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108472:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108476:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108480:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108484:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108488:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108492:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108496:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108499:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108503:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108506:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108509:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108512:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108515:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108519:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108522:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108526:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108530:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108533:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108537:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108540:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108544:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108547:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108550:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108554:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108558:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108563:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108566:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108570:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108573:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108577:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108580:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108583:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108587:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108590:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108594:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108597:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108600:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108604:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108608:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108611:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108615:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108619:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108622:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108627:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108630:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108635:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108638:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108642:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108646:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108649:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108652:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108656:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108659:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108662:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108666:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108670:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108673:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108677:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108680:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108683:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108686:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108690:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108694:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108697:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108701:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108705:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108709:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108713:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108717:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108720:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108787:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108792:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108796:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108801:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108804:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108808:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108812:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108815:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108818:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108822:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108825:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108828:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108831:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108835:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108838:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108842:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108845:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108848:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108851:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108855:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108858:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108862:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108866:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108870:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108874:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108878:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108881:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108885:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108889:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108893:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108896:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108899:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108902:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108906:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108910:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108914:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108917:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108922:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108925:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108947:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108952:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108956:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108960:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108965:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108968:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108972:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00800000:00000080:3.0:1775772969.108975:0:164342:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.108979:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.108985:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00020000:00000004:3.0:1775772969.108995:0:164342:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 8935, max_age 8944 00000100:00100000:3.0:1775772969.109042:0:164342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268800:192.168.201.137@tcp:13:lfs.0 00000100:00100000:3.0:1775772969.109143:0:164342:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.115233:0:164342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268800:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775772969.115270:0:164342:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:3.0:1775772969.115368:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.115390:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00020000:00000004:3.0:1775772969.115399:0:164342:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 8935, max_age 8944 00000100:00100000:3.0:1775772969.115440:0:164342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268928:192.168.201.137@tcp:13:lfs.0 00000100:00100000:3.0:1775772969.115533:0:164342:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.122355:0:164342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164342:1862023612268928:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775772969.122402:0:164342:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:3.0:1775772969.122497:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122529:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122538:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122542:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122546:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122550:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122554:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122557:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122561:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122564:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122568:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122571:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122575:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122579:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122583:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122587:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122591:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122595:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122599:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122602:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122607:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122610:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122614:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122617:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122621:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122624:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122628:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122631:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122635:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122638:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122641:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122644:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122648:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122650:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122653:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122656:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122659:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122661:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122664:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122667:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122671:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122675:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122678:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122682:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122685:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122689:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122692:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122696:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122700:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122703:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122707:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122710:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122714:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122717:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122721:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122958:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122965:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122969:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122974:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122978:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122982:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122985:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122989:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122992:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.122996:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.122999:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123003:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123007:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123011:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123014:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123019:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123023:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123027:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123031:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123035:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123038:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123042:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123046:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123051:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123054:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123059:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123062:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123066:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123069:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123073:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123077:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123081:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123231:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123241:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123247:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123252:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123256:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123260:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123264:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123268:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123272:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123277:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123280:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123284:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123287:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123290:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123294:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123297:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123301:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123305:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123309:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123313:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123316:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123334:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123337:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123341:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123345:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123349:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123352:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123356:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123359:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123363:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123366:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123370:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123374:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123378:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123381:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123385:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123389:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775772969.123393:0:164342:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2a7fda50 00020000:00000080:3.0:1775772969.123397:0:164342:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200008:3.0:1775772969.123418:0:164342:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:3.0:1775772969.204612:0:164349:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772969.204654:0:164349:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.204679:0:164349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:3.0:1775772969.204699:0:164349:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:3.0:1775772969.204710:0:164349:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772969.204720:0:164349:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772969.204759:0:164349:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:3.0:1775772969.204768:0:164349:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1d6bbd0 00010000:00010000:3.0:1775772969.204773:0:164349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:3.0:1775772969.204782:0:164349:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:3.0:1775772969.204804:0:164349:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772969.204821:0:164349:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=1536 00000080:00200000:3.0:1775772969.204824:0:164349:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772969.204831:0:164349:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.204837:0:164349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1775772969.204845:0:164349:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:3.0:1775772969.204852:0:164349:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772969.204856:0:164349:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772969.204859:0:164349:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:3.0:1775772969.204862:0:164349:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1d6bcd0 00010000:00010000:3.0:1775772969.204865:0:164349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1775772969.204873:0:164349:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:3.0:1775772969.204882:0:164349:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:3.0:1775772969.204888:0:164349:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772969.204895:0:164349:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.204900:0:164349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1775772969.204914:0:164349:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:3.0:1775772969.204920:0:164349:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772969.206487:0:164349:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772969.206501:0:164349:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9a3 00000080:00010000:3.0:1775772969.206511:0:164349:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9a3 from it ffff9ba1c1d6bdb0 00010000:00010000:3.0:1775772969.206517:0:164349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1775772969.206530:0:164349:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:3.0:1775772969.206546:0:164349:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:3.0:1775772969.206557:0:164349:0:(namei.c:2106:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=33188, excl=1 00000080:00200000:3.0:1775772969.206562:0:164349:0:(namei.c:2061:ll_mknod()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) mode 100644 dev 0 00010000:00010000:3.0:1775772969.206609:0:164349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1775772969.206678:0:164349:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1775772969.206687:0:164349:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775772969.206689:0:164349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445e9a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9b8c expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000020:00100000:3.0:1775772969.206738:0:164349:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775772969.206755:0:164349:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01edc00 x1862023612269184/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772969.206786:0:164349:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164349:1862023612269184:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:3.0:1775772969.206894:0:164349:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.211396:0:164349:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164349:1862023612269184:192.168.201.137@tcp:36:mcreate.0 00000080:00200000:3.0:1775772969.211460:0:164349:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0x8:0x0](ffff8de1c407ec08) 00000080:00200000:3.0:1775772969.211574:0:164349:0:(namei.c:2114:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, unhashed 1 00000080:00200000:3.0:1775772969.248985:0:164352:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772969.249029:0:164352:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.249115:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.249128:0:164352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.249139:0:164352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772969.249176:0:164352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164352:1862023612269312:192.168.201.137@tcp:101:rm.0 00000100:00100000:3.0:1775772969.249298:0:164352:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.267079:0:164352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164352:1862023612269312:192.168.201.137@tcp:101:rm.0 00010000:00010000:3.0:1775772969.267112:0:164352:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267128:0:164352:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267146:0:164352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267157:0:164352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267170:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267179:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267186:0:164352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775772969.267198:0:164352:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d01eed80 x1862023612269312/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772985 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775772969.267213:0:164352:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267228:0:164352:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775772969.267234:0:164352:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775772969.267267:0:164352:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:3.0:1775772969.267274:0:164352:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9cd 00000080:00010000:3.0:1775772969.267280:0:164352:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772969.267283:0:164352:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9cd from it ffff9ba1c1c0bb58 00010000:00010000:3.0:1775772969.267287:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267296:0:164352:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772969.267341:0:164352:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772969.267493:0:164352:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=8 00000080:00200000:3.0:1775772969.267500:0:164352:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:3.0:1775772969.267531:0:164352:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: fsa-oleg137-client.virtnet,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.267583:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 164352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267591:0:164352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.267601:0:164352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775772969.267624:0:164352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164352:1862023612269440:192.168.201.137@tcp:101:rm.0 00000100:00100000:3.0:1775772969.267883:0:164352:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.280473:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612269568:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772969.280490:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612269696:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772969.280604:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612269952:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772969.280611:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612269824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772969.289992:0:164352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164352:1862023612269440:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775772969.290021:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612269696:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772969.290027:0:164352:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772969.290034:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612269952:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772969.290057:0:164352:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.290065:0:164352:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772969.290079:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612269824:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772969.290079:0:164352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772969.290089:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612269568:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775772969.290092:0:164352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.290106:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.290115:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.290123:0:164352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775772969.290135:0:164352:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d01eed80 x1862023612269440/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 600/584 e 0 to 0 dl 1775772985 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775772969.290155:0:164352:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.290167:0:164352:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/8 (0 0) 00000080:00200000:3.0:1775772969.290175:0:164352:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775772969.290204:0:164352:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x8:0x0], updating i_size 0 00000080:00200000:3.0:1775772969.290207:0:164352:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0x8:0x0](ffff8de1c407ec08): rc = 0 00000080:00200000:3.0:1775772969.290265:0:164352:0:(file.c:6766:ll_layout_conf()) [0x200027cd1:0x8:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1775772969.290296:0:164352:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x8:0x0](ffff8de1c407ec08) for lock 0x8a9f4e958445e9d4 00000080:00010000:3.0:1775772969.290312:0:164352:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x8:0x0](ffff8de1c407ec08) 00000080:00010000:3.0:1775772969.290315:0:164352:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9d4 from it ffff9ba1c1c0bb20 00010000:00010000:3.0:1775772969.290318:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775772969.290328:0:164352:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1775772969.290384:0:164352:0:(file.c:6226:ll_getattr_dentry()) START file fsa-oleg137-client.virtnet:[0x200027cd1:0x8:0x0](ffff8de1c407ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775772969.290393:0:164352:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x8:0x0](ffff8de1c407ec08),name=fsa-oleg137-client.virtnet 00000002:00010000:3.0:1775772969.290422:0:164352:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x8:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.290434:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775772969.290447:0:164352:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772969.290455:0:164352:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772969.290461:0:164352:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x8:0x0](ffff8de1c407ec08) 00000080:00010000:3.0:1775772969.290464:0:164352:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x8:0x0](ffff8de1c407ec08) for lock 0x8a9f4e958445e9d4 00000080:00010000:3.0:1775772969.290467:0:164352:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9d4 from it ffff9ba1c1c0bcb8 00010000:00010000:3.0:1775772969.290470:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775772969.290477:0:164352:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775772969.290567:0:164352:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772969.290575:0:164352:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.290582:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775772969.290591:0:164352:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775772969.290597:0:164352:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772969.290602:0:164352:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772969.290604:0:164352:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9cd 00000080:00010000:3.0:1775772969.290607:0:164352:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9cd from it ffff9ba1c1c0bc10 00010000:00010000:3.0:1775772969.290610:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775772969.290617:0:164352:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775772969.290626:0:164352:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772969.290637:0:164352:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=fsa-oleg137-client.virtnet, flags=0 00000080:00200000:3.0:1775772969.290642:0:164352:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772969.290648:0:164352:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772969.290653:0:164352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775772969.290660:0:164352:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775772969.290665:0:164352:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772969.290669:0:164352:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772969.290671:0:164352:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9cd 00000080:00010000:3.0:1775772969.290674:0:164352:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9cd from it ffff9ba1c1c0bd68 00010000:00010000:3.0:1775772969.290677:0:164352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775772969.290684:0:164352:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775772969.290690:0:164352:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:3.0:1775772969.290696:0:164352:0:(namei.c:2395:ll_unlink()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:3.0:1775772969.290801:0:164352:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772969.290828:0:164352:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775772969.290844:0:164352:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0x8:0x0]: losing layout lock 00010000:00010000:3.0:1775772969.290887:0:164352:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775772969.290894:0:164352:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772969.290907:0:164352:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1775772969.290909:0:164352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445e9d4 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9c42 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775772969.290941:0:164352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445e9cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9c26 expref: -99 pid: 164352 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1775772969.290964:0:164352:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775772969.290972:0:164352:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eed80 x1862023612270208/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772969.290998:0:164352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164352:1862023612270208:192.168.201.137@tcp:36:rm.0 00000100:00100000:3.0:1775772969.291087:0:164352:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f600 going to sleep for 11 seconds 00000100:00100000:3.0:1775772969.312287:0:164352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164352:1862023612270208:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775772969.312402:0:164352:0:(vvp_io.c:1817:vvp_io_init()) [0x200027cd1:0x8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1775772969.312415:0:164352:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0x8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1775772969.312445:0:164352:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0x8:0x0](ffff8de1c407ec08) 00010000:00010000:2.0:1775772969.728699:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772970.752449:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772971.775990:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772972.804013:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772973.824047:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772974.400247:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612270336:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.400337:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.400360:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.400384:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1775772974.400389:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270464:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.400407:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270720:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.407798:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270464:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.407819:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270720:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.407830:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612270336:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.407852:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772974.407864:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612270848:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772974.848072:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772975.874315:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772976.895852:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775772977.634331:0:164424:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1775772977.919953:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772978.957283:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:2.0:1775772978.959793:0:164433:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775772978.959805:0:164433:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775772978.959827:0:164433:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772978.959885:0:164433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.959895:0:164433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.959906:0:164433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772978.959930:0:164433:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612270976:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775772978.960013:0:164433:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775772978.964292:0:164433:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612270976:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775772978.964317:0:164433:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964329:0:164433:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964339:0:164433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964348:0:164433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964360:0:164433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964368:0:164433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964381:0:164433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775772978.964392:0:164433:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f9b800 x1862023612270976/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775772994 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775772978.964404:0:164433:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964416:0:164433:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1775772978.964422:0:164433:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775772978.964448:0:164433:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:2.0:1775772978.964453:0:164433:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9db 00000080:00010000:2.0:1775772978.964458:0:164433:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775772978.964461:0:164433:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9db from it ffff9ba1c1bebcb8 00010000:00010000:2.0:1775772978.964463:0:164433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772978.964472:0:164433:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775772978.970074:0:164433:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775772978.970083:0:164433:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775772978.970103:0:164433:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772978.970120:0:164433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772978.970139:0:164433:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775772978.970147:0:164433:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775772978.970154:0:164433:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775772978.970157:0:164433:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9db 00000080:00010000:2.0:1775772978.970164:0:164433:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9db from it ffff9ba1c1bebcb8 00010000:00010000:2.0:1775772978.970168:0:164433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772978.970177:0:164433:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775772978.970310:0:164433:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775772978.970318:0:164433:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772978.970324:0:164433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772978.970333:0:164433:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775772978.970339:0:164433:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775772978.970343:0:164433:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775772978.970346:0:164433:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9db 00000080:00010000:2.0:1775772978.970349:0:164433:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9db from it ffff9ba1c1bebbb0 00010000:00010000:2.0:1775772978.970351:0:164433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772978.970358:0:164433:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775772978.970367:0:164433:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:2.0:1775772978.970374:0:164433:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:2.0:1775772978.971901:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.971924:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00800000:00000004:2.0:1775772978.971931:0:164433:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8945, max_age 8954 00000100:00100000:2.0:1775772978.971971:0:164433:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271104:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775772978.972166:0:164433:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 50 seconds 00000100:00100000:2.0:1775772978.986669:0:164433:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271104:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775772978.986694:0:164433:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:2.0:1775772978.986804:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.986819:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00800000:00000004:2.0:1775772978.986825:0:164433:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 8945, max_age 8954 00000100:00100000:2.0:1775772978.986856:0:164433:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271232:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775772978.986908:0:164433:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775772978.989538:0:164433:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271232:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775772978.989564:0:164433:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317328/353529 objects 1023719/1024000 00000080:00200080:2.0:1775772978.989640:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989656:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989664:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989668:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989672:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989675:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989679:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989683:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989687:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989691:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989694:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989698:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989702:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989706:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989710:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989713:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989717:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989720:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989972:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989980:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989986:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989989:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.989993:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.989996:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990000:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990003:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990007:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990010:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990013:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990017:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990021:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990024:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990028:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990031:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990035:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990038:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990042:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990046:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990049:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990053:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990056:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990059:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990063:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990066:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990069:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990072:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990076:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990079:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990083:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990086:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990090:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990093:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990097:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990101:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990105:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990108:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990112:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990115:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990119:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990122:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990125:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990130:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990133:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990136:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990140:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990143:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990146:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990149:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990152:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990156:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990160:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990163:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990166:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990169:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990173:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990176:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990180:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990184:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990187:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990191:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990194:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990198:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990201:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990204:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990207:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990211:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990214:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990216:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990220:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990222:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990225:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990228:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990231:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990234:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990237:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990240:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990243:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990246:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990250:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990253:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990256:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990259:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990262:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990265:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990269:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990272:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990276:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990280:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990283:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990286:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990289:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990292:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990296:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990299:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990303:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990306:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990309:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990312:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990316:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990319:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990324:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990327:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990331:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990334:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990338:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00800000:00000080:2.0:1775772978.990341:0:164433:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772978.990345:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772978.990352:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00020000:00000004:2.0:1775772978.990359:0:164433:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 8945, max_age 8954 00000100:00100000:2.0:1775772978.990395:0:164433:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271360:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775772978.990466:0:164433:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775772978.993000:0:164433:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271360:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775772978.993025:0:164433:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:2.0:1775772978.993089:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772978.993104:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00020000:00000004:2.0:1775772978.993112:0:164433:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 8945, max_age 8954 00000100:00100000:2.0:1775772978.993141:0:164433:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271488:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775772978.993242:0:164433:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775772979.000396:0:164433:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164433:1862023612271488:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775772979.000425:0:164433:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:2.0:1775772979.000494:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000519:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000526:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000531:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000535:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000538:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000542:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000545:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000548:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000551:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000555:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000559:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000563:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000566:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000934:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000941:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000946:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000950:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000954:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000958:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000961:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000964:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000968:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000971:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000975:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000979:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000983:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000987:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000991:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.000994:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.000998:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001002:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001005:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001009:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001013:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001016:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001019:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001023:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001027:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001033:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001036:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001039:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001043:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001046:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001050:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001052:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001056:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001060:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001064:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001067:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001071:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001075:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001079:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001083:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001087:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001090:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001095:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001098:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001102:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001105:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001109:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001112:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001116:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001120:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001124:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001127:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001131:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001134:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001138:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001141:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001145:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001148:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001152:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001156:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001159:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001163:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001166:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001170:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001173:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001178:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001181:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001184:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001188:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001191:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001194:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001197:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001200:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001204:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001208:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001211:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001215:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001218:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001222:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001225:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001228:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001231:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001235:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001238:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001242:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001245:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001249:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001252:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001256:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001259:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001263:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001266:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001270:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001273:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001276:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001279:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001283:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001287:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001290:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001294:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001297:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001300:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001304:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001307:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001311:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001314:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001318:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001321:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001324:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001328:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200080:2.0:1775772979.001332:0:164433:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffcb7102d10 00020000:00000080:2.0:1775772979.001335:0:164433:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6790800 uarg=0000000000000000 00000080:00200008:2.0:1775772979.001348:0:164433:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:3.0:1775772979.076029:0:164440:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772979.076061:0:164440:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772979.076079:0:164440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772979.076096:0:164440:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775772979.076103:0:164440:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772979.076112:0:164440:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772979.076116:0:164440:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9db 00000080:00010000:3.0:1775772979.076122:0:164440:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9db from it ffff9ba1c1c7bbd0 00010000:00010000:3.0:1775772979.076126:0:164440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775772979.076134:0:164440:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1775772979.076150:0:164440:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775772979.076163:0:164440:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=1536 00000080:00200000:3.0:1775772979.076166:0:164440:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772979.076171:0:164440:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772979.076177:0:164440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772979.076184:0:164440:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1775772979.076190:0:164440:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772979.076194:0:164440:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772979.076197:0:164440:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9db 00000080:00010000:3.0:1775772979.076200:0:164440:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9db from it ffff9ba1c1c7bcd0 00010000:00010000:3.0:1775772979.076203:0:164440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775772979.076210:0:164440:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1775772979.076222:0:164440:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:3.0:1775772979.076226:0:164440:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775772979.076231:0:164440:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775772979.076236:0:164440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775772979.076244:0:164440:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1775772979.076250:0:164440:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775772979.076253:0:164440:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775772979.076256:0:164440:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9db 00000080:00010000:3.0:1775772979.076259:0:164440:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9db from it ffff9ba1c1c7bdb0 00010000:00010000:3.0:1775772979.076262:0:164440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775772979.076269:0:164440:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:3.0:1775772979.076276:0:164440:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:3.0:1775772979.076281:0:164440:0:(namei.c:2106:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=33188, excl=1 00000080:00200000:3.0:1775772979.076284:0:164440:0:(namei.c:2061:ll_mknod()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) mode 100644 dev 0 00010000:00010000:3.0:1775772979.076310:0:164440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1775772979.076360:0:164440:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1775772979.076367:0:164440:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775772979.076370:0:164440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445e9db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9c6c expref: -99 pid: 164433 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:3.0:1775772979.076393:0:164440:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775772979.076405:0:164440:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ed880 x1862023612271744/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772979.076429:0:164440:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164440:1862023612271744:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:3.0:1775772979.076511:0:164440:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f9c0 going to sleep for 50 seconds 00000100:00100000:3.0:1775772979.087268:0:164440:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164440:1862023612271744:192.168.201.137@tcp:36:mcreate.0 00000080:00200000:3.0:1775772979.087311:0:164440:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0x9:0x0](ffff8de1c407ec08) 00000080:00200000:3.0:1775772979.087383:0:164440:0:(namei.c:2114:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, unhashed 1 00000080:00200000:2.0:1775772979.105211:0:164443:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775772979.105241:0:164443:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772979.105304:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.105316:0:164443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.105326:0:164443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772979.105351:0:164443:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164443:1862023612271872:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775772979.105484:0:164443:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 50 seconds 00000100:00100000:2.0:1775772979.115376:0:164443:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164443:1862023612271872:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775772979.115400:0:164443:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115414:0:164443:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115424:0:164443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115436:0:164443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115448:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115457:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115464:0:164443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775772979.115474:0:164443:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f9b800 x1862023612271872/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773034 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775772979.115486:0:164443:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115498:0:164443:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1775772979.115505:0:164443:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775772979.115530:0:164443:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:2.0:1775772979.115536:0:164443:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9e2 00000080:00010000:2.0:1775772979.115541:0:164443:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775772979.115544:0:164443:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9e2 from it ffff9ba1c1c7bb58 00010000:00010000:2.0:1775772979.115546:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115554:0:164443:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775772979.115594:0:164443:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775772979.115612:0:164443:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=8 00000080:00200000:2.0:1775772979.115615:0:164443:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:2.0:1775772979.115636:0:164443:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: fsa-oleg137-client.virtnet,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772979.115673:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 164443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115680:0:164443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.115688:0:164443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 164443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775772979.115706:0:164443:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164443:1862023612272000:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775772979.115800:0:164443:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 50 seconds 00000100:00100000:2.0:1775772979.119627:0:164443:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164443:1862023612272000:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775772979.119651:0:164443:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119672:0:164443:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119680:0:164443:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119691:0:164443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119701:0:164443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119713:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119762:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119770:0:164443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775772979.119782:0:164443:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f9b800 x1862023612272000/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 600/584 e 0 to 0 dl 1775773034 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775772979.119794:0:164443:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119803:0:164443:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/9 (0 0) 00000080:00200000:2.0:1775772979.119809:0:164443:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775772979.119827:0:164443:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x9:0x0], updating i_size 0 00000080:00200000:2.0:1775772979.119830:0:164443:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0x9:0x0](ffff8de1c407ec08): rc = 0 00000080:00200000:2.0:1775772979.119870:0:164443:0:(file.c:6766:ll_layout_conf()) [0x200027cd1:0x9:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1775772979.119893:0:164443:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x9:0x0](ffff8de1c407ec08) for lock 0x8a9f4e958445e9e9 00000080:00010000:2.0:1775772979.119904:0:164443:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x9:0x0](ffff8de1c407ec08) 00000080:00010000:2.0:1775772979.119908:0:164443:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9e9 from it ffff9ba1c1c7bb20 00010000:00010000:2.0:1775772979.119911:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775772979.119921:0:164443:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775772979.119969:0:164443:0:(file.c:6226:ll_getattr_dentry()) START file fsa-oleg137-client.virtnet:[0x200027cd1:0x9:0x0](ffff8de1c407ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775772979.119975:0:164443:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x9:0x0](ffff8de1c407ec08),name=fsa-oleg137-client.virtnet 00000002:00010000:2.0:1775772979.119996:0:164443:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x9:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772979.120005:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772979.120016:0:164443:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775772979.120021:0:164443:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775772979.120026:0:164443:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x9:0x0](ffff8de1c407ec08) 00000080:00010000:2.0:1775772979.120029:0:164443:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x9:0x0](ffff8de1c407ec08) for lock 0x8a9f4e958445e9e9 00000080:00010000:2.0:1775772979.120033:0:164443:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9e9 from it ffff9ba1c1c7bcb8 00010000:00010000:2.0:1775772979.120035:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772979.120043:0:164443:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775772979.120100:0:164443:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775772979.120108:0:164443:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772979.120113:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772979.120120:0:164443:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775772979.120125:0:164443:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775772979.120128:0:164443:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775772979.120130:0:164443:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9e2 00000080:00010000:2.0:1775772979.120134:0:164443:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9e2 from it ffff9ba1c1c7bc10 00010000:00010000:2.0:1775772979.120136:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775772979.120141:0:164443:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775772979.120149:0:164443:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775772979.120156:0:164443:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=fsa-oleg137-client.virtnet, flags=0 00000080:00200000:2.0:1775772979.120161:0:164443:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775772979.120166:0:164443:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775772979.120171:0:164443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772979.120178:0:164443:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775772979.120183:0:164443:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775772979.120186:0:164443:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775772979.120187:0:164443:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445e9e2 00000080:00010000:2.0:1775772979.120190:0:164443:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445e9e2 from it ffff9ba1c1c7bd68 00010000:00010000:2.0:1775772979.120193:0:164443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772979.120199:0:164443:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775772979.120204:0:164443:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:2.0:1775772979.120209:0:164443:0:(namei.c:2395:ll_unlink()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:2.0:1775772979.120242:0:164443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775772979.120264:0:164443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775772979.120279:0:164443:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0x9:0x0]: losing layout lock 00010000:00010000:2.0:1775772979.120316:0:164443:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772979.120323:0:164443:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775772979.120333:0:164443:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775772979.120336:0:164443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445e9e9 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297da9ca4 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775772979.120353:0:164443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445e9e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297da9c88 expref: -99 pid: 164443 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1775772979.120370:0:164443:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775772979.120376:0:164443:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b800 x1862023612272256/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775772979.120396:0:164443:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164443:1862023612272256:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775772979.120469:0:164443:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c30593c0 going to sleep for 50 seconds 00000100:00100000:2.0:1775772979.126948:0:164443:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164443:1862023612272256:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775772979.127042:0:164443:0:(vvp_io.c:1817:vvp_io_init()) [0x200027cd1:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1775772979.127055:0:164443:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775772979.127083:0:164443:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0x9:0x0](ffff8de1c407ec08) 00000100:00100000:2.0:1775772979.521361:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612272512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772979.521428:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612272384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772979.521455:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612272768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772979.521468:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612272640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772979.521486:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612272896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772979.522506:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c3059e40 going to sleep for 25 seconds 00000100:00100000:2.0:1775772979.526640:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612272384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772979.526660:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612272640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772979.526670:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612272896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772979.526718:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612272512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772979.526771:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612272768:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772979.968983:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772980.992363:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772982.020116:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772983.039911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775772983.708901:0:164332:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612268288:192.168.201.137@tcp:36:lfs.0 00000080:00200000:0.0:1775772983.708947:0:164332:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00200000:0.0:1775772983.708954:0:164332:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x2b:0x0], updating i_size 4096 00000080:00200008:0.0:1775772983.708985:0:164332:0:(file.c:447:ll_file_release()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags 300000 00000002:00100000:0.0:1775772983.709045:0:164332:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c67d5c00 x1862023612268032/t352187318304(352187318304) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772984 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775772983.709057:0:164332:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775772983.709061:0:164332:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6300 x1862023612273152/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775772983.709082:0:164332:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612273152:192.168.201.137@tcp:35:lfs.0 00000100:00100000:0.0:1775772983.709225:0:164332:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1775772983.722953:0:164332:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164332:1862023612273152:192.168.201.137@tcp:35:lfs.0 00000002:00100000:0.0:1775772983.722987:0:164332:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c67d5c00 x1862023612268032/t352187318304(352187318304) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775772984 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1775772984.064141:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775772984.643928:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.644055:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273664:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.644094:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1775772984.644100:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612273280:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.644137:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.644160:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273792:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.658457:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612273280:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.658495:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.658505:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273792:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.658530:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775772984.658540:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612273664:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775772985.087994:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775772986.111965:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775772987.136797:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775772987.284799:0:164519:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0001 00010000:00010000:0.0:1775772988.160682:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772989.187853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775772989.767998:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274048:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.768136:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274304:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.768173:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1775772989.768179:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612273920:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.768214:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274176:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.768241:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274432:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.773281:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274176:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.773300:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274432:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775772989.773314:0:2405:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff8de1e006a000 of lustre-MDT0000_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1775772989.773320:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1775772989.773324:0:2405:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection to lustre-MDT0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1775772989.773332:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775772989.773348:0:2405:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8843 00000100:00080000:3.0:1775772989.773360:0:2405:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775772989.773374:0:2405:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775772989.773423:0:2405:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ee300 x1862023612274560/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775772989.773458:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274048:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772989.773473:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612274304:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772989.773668:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612274560:192.168.201.137@tcp:38:ptlrpcd_01_01.0 00000100:00080000:2.0:1775772989.784106:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775772989.784127:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775772989.784134:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612274560:192.168.201.137@tcp:38:ptlrpcd_01_01.0 00010000:00010000:0.0:1775772990.208415:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772991.232036:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772992.256828:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772993.280860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772994.304088:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775772994.883787:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775772994.883793:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775772994.883798:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775772994.883808:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8966 00000100:00100000:3.0:1775772994.884359:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612274688:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775772994.884427:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1775772994.884436:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775772994.884460:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775772994.884491:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f99880 x1862023612274816/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775772994.884569:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612274944:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775772994.884646:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612274816:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775772994.889430:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612275072:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775772994.892408:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612275072:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775772994.896223:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775772994.896246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:1.0:1775772994.896253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612274816:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775772994.898842:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612275200:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772994.905660:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612274944:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775772994.905684:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612275200:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775772995.338568:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772996.352689:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772997.376194:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772998.404503:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775772999.424414:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775772999.999966:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775772999.999973:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775772999.999977:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775772999.999989:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8971 00000100:00080000:2.0:1775773000.000000:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1775773000.000005:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773000.000016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773000.000032:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f9b100 x1862023612275456/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773000.000069:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1775773000.000072:0:123972:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8de1e006a000: disconnect after 21s idle 00000100:00080000:2.0:1775773000.000079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1775773000.000081:0:123972:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8de1e006a000: disconnect after 20s idle 00000100:00100000:2.0:1775773000.000135:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612275584:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773000.000312:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612275328:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773000.000402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612275456:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773000.012848:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612275712:192.168.201.137@tcp:9:kworker.0 00000100:00100000:2.0:1775773000.012943:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612275840:192.168.201.137@tcp:9:kworker.0 00000100:00100000:2.0:1775773000.027244:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612275584:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773000.027481:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773000.027496:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:3.0:1775773000.027501:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612275456:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773000.027521:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1d0f9aa00 x1862023612275712/t0(0) o9->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773010 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773000.027531:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:3.0:1775773000.027535:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612275712:192.168.201.137@tcp:9:kworker.0 00000100:00080000:3.0:1775773000.027549:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1d0f98000 x1862023612275840/t0(0) o9->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773010 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773000.027556:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:3.0:1775773000.027560:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612275840:192.168.201.137@tcp:9:kworker.0 00010000:00010000:0.0:1775773000.449068:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773001.474769:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773002.496972:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773003.520840:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773004.544046:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773005.121221:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773005.121227:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773005.121231:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773005.121242:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8976 00000100:00080000:2.0:1775773005.121255:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1775773005.121261:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773005.121272:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773005.121288:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f99f80 x1862023612276096/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773005.121374:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612276224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773005.121464:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775773005.121471:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612275968:192.168.201.137@tcp:400:kworker.0 00000100:00000400:3.0:1775773005.121768:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775772989/real 1775772989] req@ffff8de1d01ec380 x1862023612273920/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773005.121792:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d01ec380 x1862023612273920/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773005.121801:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1775773005.121805:0:2405:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.137@tcp: Connection to MGS (at 192.168.201.137@tcp) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1775773005.121808:0:2405:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.201.137@tcp for MGC192.168.201.137@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1775773005.121811:0:2405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1775773005.121814:0:2405:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d01ec380 x1862023612273920/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773005.121823:0:2405:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0f9b480 x1862023612274688/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773010 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773005.121832:0:2405:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0f99500 x1862023612275328/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773015 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773005.121841:0:2405:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0f99c00 x1862023612275968/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773021 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1775773005.121860:0:2405:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1775773005.121863:0:2405:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1775773005.121865:0:2405:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1775773005.121867:0:2405:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1775773005.121885:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612275328:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773005.121892:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612274688:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773005.121897:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612273920:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773005.121923:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773005.121926:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773005.121928:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773005.121933:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 8842 00000100:00080000:3.0:1775773005.121939:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773005.121951:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ec380 x1862023612276352/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773005.124376:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612276096:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773005.124473:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612275968:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773005.124500:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612276224:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773005.126081:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612276352:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773005.132438:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773005.132451:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:0.0:1775773005.132456:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612276096:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775773005.572312:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773006.591877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773007.615960:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773008.640464:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773009.665563:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773010.240064:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773010.240077:0:151211:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773010.240081:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773010.240086:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773010.240092:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773010.240104:0:151211:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8981 00000100:00080000:1.0:1775773010.240121:0:151211:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773010.240129:0:151211:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773010.240144:0:151211:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773010.240271:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a30e00 x1862023612276480/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773010.240361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612276480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773010.240376:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612276608:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773010.248463:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612276608:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773010.250324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773010.250338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:3.0:1775773010.250342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612276480:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775773010.692095:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773011.713159:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773012.738915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773013.760154:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773014.786403:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773015.359956:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773005/real 1775773005] req@ffff8de1d01ec380 x1862023612276352/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773015.359995:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d01ec380 x1862023612276352/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773015.360014:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773015.360034:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773015.360038:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612276352:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773015.367090:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773015.367125:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773015.367132:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773015.367145:0:151211:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 8981 00000100:00080000:1.0:1775773015.367163:0:151211:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775773015.367171:0:151211:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773015.367224:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a32680 x1862023612276736/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773015.367273:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773015.367278:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773015.367280:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773015.367284:0:151211:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8987 00000100:00080000:1.0:1775773015.367289:0:151211:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773015.367293:0:151211:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773015.367306:0:151211:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773015.367319:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a33100 x1862023612276864/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773015.367447:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612276736:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773015.367493:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612276992:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773015.367627:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612276864:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773015.371457:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.137@tcp: connect to target with instance 0 00000100:00100000:0.0:1775773015.371559:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612276992:192.168.201.137@tcp:400:kworker.0 10000000:01000000:3.0:1775773015.371867:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:02000400:3.0:1775773015.371876:0:2401:0:(import.c:1282:ptlrpc_connect_interpret()) Evicted from MGS (at 192.168.201.137@tcp) after server handle changed from 0x3797d62297da85b3 to 0x3797d62297da9cea 00000100:00080000:3.0:1775773015.371880:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:3.0:1775773015.371886:0:2401:0:(import.c:1667:ptlrpc_import_recovery_state_machine()) evicted from MGS@192.168.201.137@tcp; invalidating 00000100:00100000:3.0:1775773015.372431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612276736:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773015.372455:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773015.372459:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00080000:1.0:1775773015.372563:0:164742:0:(import.c:1591:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.201.137@tcp to MGS@192.168.201.137@tcp 00000100:00100000:1.0:1775773015.372568:0:164742:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1775773015.372570:0:164742:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1775773015.372586:0:164742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773015.372597:0:164742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773015.372604:0:164742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1775773015.372625:0:164742:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773015.372634:0:164742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da86e0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773015.372647:0:164742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9200/0x8a9f4e958445e765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da86fc expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773015.372653:0:164742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9200/0x8a9f4e958445e765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da86fc expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773015.372659:0:164742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1775773015.372662:0:164742:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773015.372665:0:164742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9200/0x8a9f4e958445e765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da86fc expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773015.372680:0:164742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773015.372687:0:164742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773015.372692:0:164742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1775773015.372695:0:164742:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773015.372699:0:164742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d3385000/0x8a9f4e958445e8ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da9351 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773015.372712:0:164742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773015.372720:0:164742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773015.373203:0:164742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1775773015.373212:0:164742:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773015.373216:0:164742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e75e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da86e7 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775773015.373232:0:164742:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1775773015.373237:0:164742:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1775773015.373240:0:164742:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1775773015.373243:0:164742:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1775773015.373246:0:164742:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) MGC192.168.201.137@tcp: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00100000:3.0:1775773015.373394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612276864:192.168.201.137@tcp:38:kworker.0 00010000:00010000:2.0:1775773015.807982:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1775773016.831842:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:0.0:1775773016.831850:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 342 10000000:01000000:0.0:1775773016.831855:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:0.0:1775773016.831906:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.831918:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.831929:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773016.831959:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277120:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775773016.832052:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e99c0 going to sleep for 11 seconds 00010000:00010000:2.0:1775773016.832289:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773016.837152:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277120:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1775773016.837179:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.837202:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773016.837281:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277248:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1775773016.838373:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773016.855150:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277248:192.168.201.137@tcp:256:ll_cfg_requeue.0 10000000:01000000:0.0:1775773016.855196:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' failed (-2). 00010000:00010000:0.0:1775773016.855207:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.855217:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000400:0.0:1775773016.855228:0:160428:0:(mgc_request.c:1917:mgc_process_log()) MGC192.168.201.137@tcp: IR log lustre-cliir failed, not fatal: rc = -2 10000000:01000000:0.0:1775773016.869780:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1775773016.869786:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-client-ffff8de1e006a000 from 52 10000000:01000000:0.0:1775773016.869791:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1775773016.869841:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.869853:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.869864:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773016.869891:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277376:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775773016.869985:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773016.879379:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277376:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1775773016.879407:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.879420:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773016.879593:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277504:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1775773016.879671:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.906355:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277504:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773016.906425:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277632:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1775773016.906801:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c3059b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.913802:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277632:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:2.0:1775773016.915234:0:164743:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1775773016.915833:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1775773016.915855:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1775773016.915866:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.915878:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1775773016.915887:0:160428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1775773016.915890:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log params-ffff8de1e006a000 from 7 10000000:01000000:0.0:1775773016.915893:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1775773016.915940:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.915948:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.915958:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773016.915985:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277760:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775773016.916655:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9300 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.930271:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277760:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1775773016.930302:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773016.930315:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773016.930391:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277888:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773016.930481:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c3059b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.945053:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612277888:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773016.945126:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278016:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1775773016.945218:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c3059b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.948390:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278016:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:2.0:1775773016.950106:0:164744:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1775773016.950612:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1775773016.950633:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1775773016.950644:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.950656:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1775773016.950665:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1775773016.950668:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-sptlrpc-ffff8de1e005cd40 from 1 10000000:01000000:0.0:1775773016.950672:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1775773016.950711:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.950719:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773016.950753:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773016.950782:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278144:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775773016.950873:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.959757:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278144:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1775773016.959787:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773016.959800:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773016.959881:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278272:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773016.959950:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c3059b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773016.978206:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278272:192.168.201.137@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1775773016.978253:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1775773016.978263:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773016.978274:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773017.863860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773018.879892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773019.904550:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773020.480627:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773020.480633:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773020.480637:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773020.480647:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8992 00000100:00080000:3.0:1775773020.480658:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773020.480665:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773020.480675:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773020.480691:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ed500 x1862023612278528/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773020.480757:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612278528:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773020.481386:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612278400:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773020.481445:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773020.481454:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612278656:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775773020.485487:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773020.485502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:0.0:1775773020.485507:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612278528:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773020.485998:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612278400:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773020.493877:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612278656:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773020.582078:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:0.0:1775773020.582311:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625147136 00000100:00100000:0.0:1775773020.582323:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625147136 00000100:00100000:0.0:1775773020.582419:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 8 00000100:00100000:0.0:1775773020.582431:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1d0a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:194722:x1862023625147136:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775773020.582449:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773020.582529:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775773020.582537:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1d0a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:194722:x1862023625147136:12345-192.168.201.137@tcp:104: Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1775773020.582545:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 8 00010000:00010000:2.0:1775773020.582599:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773020.582604:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773020.582610:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e34c00 already unused, calling callback (ffffffffc1197c20) 10000000:00010000:2.0:1775773020.582614:0:160426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773020.582622:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1775773020.582634:0:160426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1775773020.582639:0:160426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1775773020.582686:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773020.582693:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773020.582716:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773020.582755:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34c00/0x8a9f4e958445e9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297da9cf1 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773020.582772:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773020.582774:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773020.582775:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773020.582782:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775773020.582797:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612278784:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773020.607123:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612278784:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775773020.929404:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773021.957347:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1775773022.464568:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:3.0:1775773022.464575:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 342 10000000:01000000:3.0:1775773022.464581:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:3.0:1775773022.464625:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773022.464637:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773022.464648:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773022.464676:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278912:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1775773022.464802:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773022.474448:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612278912:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1775773022.474489:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773022.474502:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773022.474577:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612279040:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1775773022.474654:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773022.499218:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612279040:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:3.0:1775773022.499270:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:3.0:1775773022.499376:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:3.0:1775773022.499418:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:3.0:1775773022.503407:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:3.0:1775773022.503421:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773022.503434:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1775773022.556211:0:164796:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 16, was 0): DISCONN 00010000:00080000:2.0:1775773022.556239:0:164796:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c3008000@lustre-MDT0000-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00000100:00080000:2.0:1775773022.556244:0:164796:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773022.556253:0:164796:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:2.0:1775773022.556263:0:164796:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773022.556277:0:164796:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773022.556305:0:164796:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f98380 x1862023612279168/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773022.556376:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612279168:192.168.201.137@tcp:38:lctl.0 00010000:00080000:0.0:1775773022.574895:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0f98380 x1862023612279168/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775773032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'lctl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773022.574921:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to target with instance 83 00000100:00080000:0.0:1775773022.574939:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1775773022.574949:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1775773022.574953:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318285 gen 1 00000100:00100000:0.0:1775773022.574960:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d01eea00 x1862023612235136/t352187318287(352187318287) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775772915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773022.574968:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318285 last 0 00000100:00080000:0.0:1775773022.574978:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d01eea00 x1862023612235136/t352187318287(352187318287) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775772915 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773022.575005:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612279168:192.168.201.137@tcp:38:lctl.0 00000100:00100000:0.0:1775773022.575041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612235136:192.168.201.137@tcp:36:mcreate.0 00010000:00010000:0.0:1775773022.976042:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773024.000276:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773025.025972:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773025.599995:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level REPLAY/5 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773025.600004:0:151211:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY) 00000100:00100000:3.0:1775773025.600057:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612279424:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773025.600463:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612279296:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773025.614317:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612279424:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773025.618548:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612279296:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773026.048173:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773026.216651:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d01eea00 x1862023612235136/t352187318287(352187318287) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773052 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.216669:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1775773026.216672:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318285 gen 1 00000100:00100000:0.0:1775773026.216678:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d01eea00 x1862023612235136/t352187318287(352187318287) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773052 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.216687:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318285 last 352187318287 00000100:00080000:0.0:1775773026.216697:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0e77b80 x1862023612235648/t352187318288(352187318288) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775772915 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773026.216710:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612235136:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:0.0:1775773026.216776:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612235648:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773026.225464:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318287 gen 1 00000100:00100000:0.0:1775773026.225506:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0e77b80 x1862023612235648/t352187318288(352187318288) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.225628:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0e77b80 x1862023612235648/t352187318288(352187318288) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.225637:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1775773026.225640:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318287 gen 1 00000100:00100000:0.0:1775773026.225645:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0e77b80 x1862023612235648/t352187318288(352187318288) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.225653:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318287 last 352187318288 00000100:00080000:0.0:1775773026.225663:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0e76300 x1862023612237184/t352187318289(352187318289) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775772964 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773026.225677:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612235648:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773026.225703:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612237184:192.168.201.137@tcp:36:mcreate.0 00000100:00080000:2.0:1775773026.237505:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0e76300 x1862023612237184/t352187318289(352187318289) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.237533:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773026.237536:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318287 gen 1 00000100:00100000:2.0:1775773026.237543:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0e77b80 x1862023612235648/t352187318288(352187318288) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.237552:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318287 last 352187318289 00000100:00080000:2.0:1775773026.237561:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d01ef480 x1862023612237696/t352187318290(352187318290) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775772964 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773026.237575:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612237184:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:2.0:1775773026.237601:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612237696:192.168.201.137@tcp:36:rm.0 00000100:00080000:2.0:1775773026.253792:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d01ef480 x1862023612237696/t352187318290(352187318290) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.253809:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773026.253813:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318287 gen 1 00000100:00100000:2.0:1775773026.253820:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0e77b80 x1862023612235648/t352187318288(352187318288) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.253829:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318287 last 352187318290 00000100:00080000:2.0:1775773026.253838:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775772975 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773026.253851:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612237696:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773026.253876:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612265984:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773026.294892:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:2.0:1775773026.295056:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.295077:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.295087:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773026.295090:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:2.0:1775773026.295093:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.295101:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318290 last 352187318302 00000100:00080000:2.0:1775773026.295110:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0f9ad80 x1862023612267136/t352187318303(352187318303) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 568/448 e 0 to 0 dl 1775772983 ref 1 fl New:RQU/204/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773026.295123:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612265984:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773026.295149:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612267136:192.168.201.137@tcp:36:lfs.0 00000100:00080000:2.0:1775773026.311856:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0f9ad80 x1862023612267136/t352187318303(352187318303) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 568/448 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.311880:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773026.311883:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:2.0:1775773026.311890:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.311899:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318290 last 352187318303 00000100:00080000:2.0:1775773026.311908:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d01edc00 x1862023612269184/t352187318306(352187318306) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775772985 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773026.311961:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612267136:192.168.201.137@tcp:36:lfs.0 00000100:00100000:2.0:1775773026.312693:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612269184:192.168.201.137@tcp:36:mcreate.0 00000100:00080000:2.0:1775773026.352373:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d01edc00 x1862023612269184/t352187318306(352187318306) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.352391:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773026.352394:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:2.0:1775773026.352402:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.352410:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318290 last 352187318306 00000100:00080000:2.0:1775773026.352420:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d01eed80 x1862023612270208/t352187318307(352187318307) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775772985 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773026.352434:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612269184:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:2.0:1775773026.352461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612270208:192.168.201.137@tcp:36:rm.0 00000100:00080000:1.0:1775773026.367178:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d01eed80 x1862023612270208/t352187318307(352187318307) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773026.367194:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1775773026.367198:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:1.0:1775773026.367205:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773026.367212:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318290 last 352187318307 00000100:00080000:1.0:1775773026.367221:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d01ed880 x1862023612271744/t352187318308(352187318308) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773034 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773026.367233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612270208:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773026.367258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612271744:192.168.201.137@tcp:36:mcreate.0 00000100:00080000:0.0:1775773026.374335:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d01ed880 x1862023612271744/t352187318308(352187318308) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.374354:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1775773026.374358:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:0.0:1775773026.374365:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773026.374374:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318290 last 352187318308 00000100:00080000:0.0:1775773026.374384:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0f9b800 x1862023612272256/t352187318309(352187318309) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773034 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773026.374398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612271744:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:0.0:1775773026.374427:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612272256:192.168.201.137@tcp:36:rm.0 00000100:00080000:2.0:1775773026.381214:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0f9b800 x1862023612272256/t352187318309(352187318309) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.381234:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773026.381237:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318290 gen 1 00000100:00100000:2.0:1775773026.381245:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f99180 x1862023612265984/t352187318302(352187318302) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.381254:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 352187318290 last 352187318309 00000100:00080000:2.0:1775773026.381260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1775773026.381827:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612272256:192.168.201.137@tcp:36:rm.0 00010000:00080000:2.0:1775773026.381856:0:164817:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-mdc-ffff8de1e006a000 to lustre-MDT0000_UUID@192.168.201.137@tcp 00010000:00010000:2.0:1775773026.381861:0:164817:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-mdc-ffff8de1e006a000 (1) 00010000:00010000:2.0:1775773026.381949:0:164817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445e9aa lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x3797d62297da9ba8 expref: -99 pid: 164332 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773026.381973:0:164817:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-mdc-ffff8de1e006a000 00000100:00080000:2.0:1775773026.382444:0:164817:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1775773026.382517:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612279552:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000100:00100000:2.0:1775773026.402559:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 352187318309 gen 1 00000100:00080000:2.0:1775773026.402616:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1775773026.402634:0:2401:0:(client.c:3204:ptlrpc_resend_req()) @@@ going to resend req@ffff8de1d0f99c00 x1862023612279552/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773056 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.402644:0:2401:0:(client.c:3213:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8de1d0f99c00 x1862023612279552/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773056 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773026.402651:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1775773026.404451:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00100000:3.0:1775773026.404463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612279552:192.168.201.137@tcp:400:ldlm_lock_repla.0 00010000:00010000:0.0:1775773027.072226:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773027.649863:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612279680:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773027.649865:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612279808:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773027.650004:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612279936:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773027.657202:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612279808:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773027.657577:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612279936:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773027.657603:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612279680:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773028.096370:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:0.0:1775773029.042275:0:164850:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775773029.042295:0:164850:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773029.042326:0:164850:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773029.042410:0:164850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773029.042424:0:164850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773029.042436:0:164850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773029.042471:0:164850:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280064:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775773029.042773:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baa240 going to sleep for 25 seconds 00000100:00100000:3.0:1775773029.045510:0:164850:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280064:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773029.045544:0:164850:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045558:0:164850:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045572:0:164850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045587:0:164850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045681:0:164850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045692:0:164850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045831:0:164850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773029.045845:0:164850:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d6d80 x1862023612280064/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773059 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773029.045861:0:164850:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045885:0:164850:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775773029.045892:0:164850:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773029.045933:0:164850:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:3.0:1775773029.045941:0:164850:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773029.045948:0:164850:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773029.045952:0:164850:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c24e7cb8 00010000:00010000:3.0:1775773029.045955:0:164850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773029.045964:0:164850:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1775773029.047251:0:164850:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1775773029.047260:0:164850:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773029.047282:0:164850:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773029.047297:0:164850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773029.047312:0:164850:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773029.047320:0:164850:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773029.047327:0:164850:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773029.047330:0:164850:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773029.047337:0:164850:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c24e7cb8 00010000:00010000:3.0:1775773029.047341:0:164850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773029.047349:0:164850:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773029.047487:0:164850:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773029.047495:0:164850:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773029.047501:0:164850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773029.047511:0:164850:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773029.047518:0:164850:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773029.047521:0:164850:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773029.047524:0:164850:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773029.047527:0:164850:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c24e7bb0 00010000:00010000:3.0:1775773029.047530:0:164850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773029.047537:0:164850:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773029.047545:0:164850:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:3.0:1775773029.047553:0:164850:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:3.0:1775773029.047948:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:3.0:1775773029.047968:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f000 uarg=0000000000000000 00800000:00000004:3.0:1775773029.047976:0:164850:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 8955, max_age 9004 00000100:00100000:3.0:1775773029.048024:0:164850:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280192:192.168.201.137@tcp:41:lfs.0 00000100:00100000:3.0:1775773029.048157:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f240 going to sleep for 25 seconds 00000100:00100000:1.0:1775773029.051206:0:164850:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280192:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773029.051248:0:164850:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:1.0:1775773029.051324:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.051346:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00800000:00000004:1.0:1775773029.051355:0:164850:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 8955, max_age 9004 00000100:00100000:1.0:1775773029.051404:0:164850:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280320:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773029.051508:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd000 going to sleep for 25 seconds 00000100:00100000:1.0:1775773029.054304:0:164850:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280320:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773029.054338:0:164850:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317328/353529 objects 1023719/1024000 00000080:00200080:1.0:1775773029.054405:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054424:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054433:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054438:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054443:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054446:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054452:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054455:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054459:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054463:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054466:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054470:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054473:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054476:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054479:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054482:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054486:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054489:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054493:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054496:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054500:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054503:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054508:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054511:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054515:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054518:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054523:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054527:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054531:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054534:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054538:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054542:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054545:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054548:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054551:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054555:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054558:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054561:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054565:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054569:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054573:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054576:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054580:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054584:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054588:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054591:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054595:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054598:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054679:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054686:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054690:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.054694:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.054698:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055099:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055108:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055112:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055116:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055120:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055124:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055127:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055131:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055134:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055138:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055141:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055145:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055149:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055152:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055155:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055159:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055162:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055166:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055169:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055173:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055177:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055181:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055184:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055188:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055191:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055195:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055198:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055201:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055206:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055210:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055214:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055218:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055222:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055226:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055230:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055234:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055238:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055242:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055245:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055248:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055252:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055255:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055259:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055262:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055265:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055269:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055273:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055277:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055281:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055285:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055288:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055292:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055296:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055300:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055304:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055308:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055311:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055314:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055317:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055321:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055324:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055328:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055332:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055335:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055339:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055343:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055346:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055351:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055354:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055358:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055362:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055365:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00800000:00000080:1.0:1775773029.055369:0:164850:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00000080:00200080:1.0:1775773029.055373:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:1.0:1775773029.055379:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00020000:00000004:1.0:1775773029.055390:0:164850:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 8955, max_age 9004 00000100:00080000:1.0:1775773029.055409:0:164850:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8927 00000100:00080000:1.0:1775773029.055425:0:164850:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773029.055441:0:164850:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:1.0:1775773029.055473:0:164850:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a32a00 x1862023612280448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773029.055538:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612280448:192.168.201.137@tcp:8:lfs.0 00000100:00080000:1.0:1775773029.056101:0:164850:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1d0a32d80 x1862023612280576/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773029.056113:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd000 going to sleep for 0 seconds 00000100:00100000:3.0:1775773029.058117:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 38654705666 gen 4 00000100:00080000:3.0:1775773029.058136:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8de1e006a000: connect to target with instance 9 00000100:00080000:3.0:1775773029.058148:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:3.0:1775773029.058161:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775773029.058169:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775773029.058175:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1775773029.058180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000080:00000004:3.0:1775773029.058188:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775773029.058190:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775773029.058204:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 0000000065f350bf): req@ffff8de1d0a32d80 x1862023612280576/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773029.058427:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd000 going to sleep for 11 seconds 00000100:00100000:3.0:1775773029.058468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612280448:192.168.201.137@tcp:8:lfs.0 00000100:00100000:1.0:1775773029.065370:0:164850:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280576:192.168.201.137@tcp:13:lfs.0 00020000:00000004:1.0:1775773029.065419:0:164850:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:1.0:1775773029.065512:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:1.0:1775773029.065535:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00020000:00000004:1.0:1775773029.065545:0:164850:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 8955, max_age 9004 00000100:00080000:1.0:1775773029.065560:0:164850:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8927 00000100:00080000:1.0:1775773029.065570:0:164850:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773029.065583:0:164850:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:0.0:1775773029.066200:0:164850:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a33480 x1862023612280704/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773029.066264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612280704:192.168.201.137@tcp:8:lfs.0 00000100:00080000:0.0:1775773029.066442:0:164850:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1d0a32d80 x1862023612280832/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773029.066459:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baad80 going to sleep for 0 seconds 00000100:00100000:3.0:1775773029.069395:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1e006a000: committing for last_committed 0 gen 4 00000100:00080000:3.0:1775773029.069419:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8de1e006a000: connect to target with instance 1 00000100:00080000:3.0:1775773029.069430:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:3.0:1775773029.069445:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775773029.069462:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775773029.069471:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1775773029.069476:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000080:00000004:3.0:1775773029.069485:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775773029.069487:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775773029.069503:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000dd063b14): req@ffff8de1d0a32d80 x1862023612280832/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773029.069993:0:164850:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baad80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773029.071437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612280704:192.168.201.137@tcp:8:lfs.0 00000100:00100000:3.0:1775773029.077398:0:164850:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:164850:1862023612280832:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775773029.077444:0:164850:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:3.0:1775773029.077690:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077715:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077754:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077761:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077766:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077770:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077774:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077778:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077782:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077786:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077790:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077793:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077797:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077800:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077803:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077807:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077810:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077813:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077817:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077820:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077823:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077826:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077830:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077833:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077837:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077839:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077843:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077845:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077849:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077852:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077855:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077858:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077861:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077864:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077867:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077885:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077890:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077894:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077898:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077902:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077905:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077908:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077911:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077914:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077929:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077934:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077938:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077942:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077946:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077949:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077953:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077956:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077959:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077971:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077976:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077980:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077984:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077987:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077991:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.077994:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.077998:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078002:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078006:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078009:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078012:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078016:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078019:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078023:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078027:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078030:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078033:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078037:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078042:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078045:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078050:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078053:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078057:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078061:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078064:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078942:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078968:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078979:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078983:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078986:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078990:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.078993:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.078997:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079001:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079005:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079008:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079012:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079016:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079020:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079024:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079028:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079031:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079035:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079040:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079044:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079048:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079052:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079056:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079060:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079064:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079067:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079071:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079075:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079078:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079082:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079086:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079090:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079093:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079096:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079100:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079105:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079109:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079113:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079116:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079120:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079124:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079129:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079131:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079134:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079136:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200080:3.0:1775773029.079139:0:164850:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffa0b631f0 00020000:00000080:3.0:1775773029.079141:0:164850:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c000 uarg=0000000000000000 00000080:00200008:3.0:1775773029.079156:0:164850:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00010000:00010000:3.0:1775773029.123134:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773030.146093:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773031.172285:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773032.193870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773032.771841:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612280960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773032.771974:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281216:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773032.772009:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281472:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773032.772044:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775773032.772051:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281088:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773032.772076:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281344:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773032.779593:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281472:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773032.785947:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281088:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773032.786044:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281344:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773032.786058:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612280960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773032.786071:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612281216:192.168.201.137@tcp:400:kworker.0 00000001:02000400:3.0:1775773033.165241:0:165103:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1775773033.223266:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773034.256885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773035.265000:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775773035.276511:0:165260:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1775773036.291410:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:3.0:1775773037.296182:0:165298:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775773037.296199:0:165298:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773037.296233:0:165298:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773037.296259:0:165298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773037.296279:0:165298:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773037.296290:0:165298:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773037.296301:0:165298:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773037.296306:0:165298:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773037.296315:0:165298:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0da3cb8 00010000:00010000:3.0:1775773037.296320:0:165298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773037.296329:0:165298:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:3.0:1775773037.297001:0:165298:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1775773037.297008:0:165298:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773037.297018:0:165298:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773037.297028:0:165298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775773037.297038:0:165298:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1775773037.297045:0:165298:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773037.297050:0:165298:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773037.297052:0:165298:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773037.297055:0:165298:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0da3cb8 00010000:00010000:3.0:1775773037.297058:0:165298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775773037.297070:0:165298:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1775773037.297184:0:165298:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773037.297193:0:165298:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773037.297200:0:165298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773037.297209:0:165298:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1775773037.297217:0:165298:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773037.297220:0:165298:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773037.297223:0:165298:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773037.297226:0:165298:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0da3bb0 00010000:00010000:3.0:1775773037.297229:0:165298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773037.297237:0:165298:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:3.0:1775773037.297247:0:165298:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:3.0:1775773037.297254:0:165298:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:3.0:1775773037.297389:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:3.0:1775773037.297408:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660d000 uarg=0000000000000000 00800000:00000004:3.0:1775773037.297416:0:165298:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9005, max_age 9013 00000100:00100000:3.0:1775773037.297474:0:165298:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281600:192.168.201.137@tcp:41:lfs.0 00000100:00100000:3.0:1775773037.297597:0:165298:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773037.302415:0:165298:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281600:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773037.302459:0:165298:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:2.0:1775773037.302775:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.302799:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00800000:00000004:2.0:1775773037.302811:0:165298:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9005, max_age 9013 00000100:00100000:2.0:1775773037.302879:0:165298:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281728:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773037.302971:0:165298:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c11cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773037.307271:0:165298:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281728:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773037.307322:0:165298:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317328/353529 objects 1023719/1024000 00000080:00200080:2.0:1775773037.307398:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307420:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307428:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307432:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307437:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307441:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307445:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307449:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307454:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307457:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307462:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307465:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307469:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307473:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307476:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307479:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307482:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307485:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307488:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307491:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307494:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307496:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307499:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307502:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307506:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307508:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307511:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307513:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307516:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307519:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307522:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307524:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307527:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307530:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307533:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307537:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307541:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307544:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307547:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307549:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307552:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307554:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307557:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307559:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307562:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307565:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307568:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307571:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307574:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307576:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307579:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307581:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307584:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307586:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307590:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307593:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307596:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307598:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307602:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307605:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307608:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307610:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307613:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307616:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307618:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307621:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307624:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307627:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307630:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307633:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307636:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307639:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307641:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307644:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307647:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307649:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307652:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307654:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307657:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307661:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307665:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307668:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307671:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307674:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307677:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307680:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307683:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307686:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307689:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307691:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307694:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307697:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307699:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307702:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307705:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307707:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307710:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307712:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307715:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307718:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307763:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307769:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307774:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307777:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307781:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307784:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307788:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307792:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307796:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307799:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307803:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307806:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307810:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307812:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307816:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307818:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307821:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307824:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307827:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307830:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307834:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307837:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307842:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307845:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307848:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00800000:00000080:2.0:1775773037.307850:0:165298:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.307853:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.307860:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00020000:00000004:2.0:1775773037.307869:0:165298:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9005, max_age 9013 00000100:00100000:2.0:1775773037.307918:0:165298:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281856:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773037.308005:0:165298:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c11cac00 going to sleep for 11 seconds 00010000:00010000:3.0:1775773037.312135:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773037.315298:0:165298:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281856:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773037.315337:0:165298:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:2.0:1775773037.315429:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.315451:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00020000:00000004:2.0:1775773037.315461:0:165298:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9005, max_age 9013 00000100:00100000:2.0:1775773037.315505:0:165298:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281984:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773037.315605:0:165298:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c11cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773037.321370:0:165298:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165298:1862023612281984:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773037.321405:0:165298:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:2.0:1775773037.321487:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321507:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321515:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321519:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321522:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321526:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321529:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321532:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321535:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321538:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321541:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321544:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321548:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321552:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321556:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321559:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321562:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321565:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321569:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321571:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321575:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321578:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321581:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321584:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321587:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321590:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321593:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321596:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321599:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321602:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321605:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321608:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321611:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321614:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321617:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321620:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321623:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321626:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321629:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321633:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321636:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321640:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321643:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321646:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321649:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321652:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321655:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321658:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321661:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321664:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321667:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321670:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321673:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321676:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321679:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321682:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321686:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321688:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321691:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321694:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321697:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321700:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321703:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321707:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321711:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.321714:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.321718:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322311:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322329:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322338:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322343:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322347:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322351:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322354:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322357:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322360:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322363:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322366:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322369:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322372:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322376:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322378:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322382:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322384:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322388:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322391:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322395:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322398:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322402:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322407:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322410:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322414:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322418:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322421:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322424:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322427:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322430:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322433:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322437:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322440:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322444:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322447:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322451:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322454:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322458:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322461:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322464:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322467:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322470:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322473:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322476:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322479:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322482:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322486:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322489:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322492:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322495:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322498:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322501:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322504:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322507:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322509:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322513:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322515:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773037.322519:0:165298:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd5dd35030 00020000:00000080:2.0:1775773037.322521:0:165298:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200008:2.0:1775773037.322537:0:165298:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000100:00100000:1.0:1775773037.889898:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775773037.889935:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612282112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773037.894973:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612282112:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773038.354004:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773039.360024:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773040.384008:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773041.415161:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773042.433227:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773043.008187:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.008307:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282624:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.008340:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1775773043.008346:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612282240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.008379:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282496:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.008397:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282752:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.015488:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282752:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.015512:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282624:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.018074:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612282240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773043.023893:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282368:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773043.025958:0:2405:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0001-mdc-ffff8de1e006a000 of lustre-MDT0001_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1775773043.026042:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1775773043.026050:0:2405:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection to lustre-MDT0001 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1775773043.026059:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773043.026066:0:2405:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8920 00000100:00080000:2.0:1775773043.026080:0:2405:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773043.026095:0:2405:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773043.026137:0:2405:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f9ad80 x1862023612282880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773043.026173:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612282496:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773043.026307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612282880:192.168.201.137@tcp:38:ptlrpcd_01_01.0 00000100:00080000:3.0:1775773043.034120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773043.034142:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:3.0:1775773043.034148:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612282880:192.168.201.137@tcp:38:ptlrpcd_01_01.0 00010000:00010000:0.0:1775773043.458038:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773044.483590:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773045.504351:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773046.528129:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773047.552798:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773048.128246:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773048.128263:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773048.128269:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773048.128284:0:151211:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9019 00000100:00080000:3.0:1775773048.128309:0:151211:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1775773048.128317:0:151211:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773048.128332:0:151211:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773048.128352:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ed180 x1862023612283264/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773048.128438:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612283264:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773048.128440:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612283136:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773048.128776:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612283520:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773048.128816:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1775773048.128822:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612283008:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773048.128857:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612283392:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773048.141867:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612283008:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775773048.141882:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773048.141890:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:0.0:1775773048.141894:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612283264:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773048.141894:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612283392:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773048.141907:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612283136:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773048.141917:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612283520:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773048.576323:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773049.610129:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773050.624032:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773051.649056:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773052.672177:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773053.248103:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612283648:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773053.252578:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773053.252610:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612283776:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773053.253187:0:151211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773053.253195:0:151211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773053.253200:0:151211:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773053.253208:0:151211:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9024 00000100:00080000:3.0:1775773053.253216:0:151211:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1775773053.253226:0:151211:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773053.253239:0:151211:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773053.253276:0:151211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ec000 x1862023612283904/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773053.253482:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612283904:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773053.254151:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612284160:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773053.254210:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775773053.254217:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612284032:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773053.268061:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612283648:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775773053.271328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773053.271348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:0.0:1775773053.271355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612283904:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773053.271403:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612284032:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773053.271418:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612284160:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773053.271664:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612283776:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773053.699246:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773054.728773:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773055.744025:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773056.768435:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773057.792100:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773058.370425:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612284288:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773058.370620:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775773058.370628:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612284416:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775773058.371400:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773058.371408:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773058.371413:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773058.371421:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9030 00000100:00080000:1.0:1775773058.371431:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1775773058.371439:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773058.371455:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773058.371478:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a31880 x1862023612284544/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773058.371525:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612284544:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775773058.371601:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1775773058.371604:0:123972:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8de1e006a000: disconnect after 21s idle 00000100:00100000:0.0:1775773058.371638:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612284672:192.168.201.137@tcp:9:kworker.0 00000100:00080000:1.0:1775773058.372527:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1775773058.372533:0:123972:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8de1e006a000: disconnect after 21s idle 00000100:00100000:0.0:1775773058.372581:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612284800:192.168.201.137@tcp:9:kworker.0 00000100:00080000:2.0:1775773058.386411:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1d0a31180 x1862023612284800/t0(0) o9->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773068 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773058.386429:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:2.0:1775773058.386435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612284800:192.168.201.137@tcp:9:kworker.0 00000100:00080000:2.0:1775773058.386453:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1d0a32300 x1862023612284672/t0(0) o9->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773068 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773058.386462:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:2.0:1775773058.386466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612284672:192.168.201.137@tcp:9:kworker.0 00000100:00080000:2.0:1775773058.386479:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773058.386484:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775773058.386488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612284544:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773058.387496:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612284416:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773058.395375:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612284288:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773058.820011:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773059.840554:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773060.866216:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773061.893306:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773062.242831:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775773062.243320:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625177472 00000100:00100000:1.0:1775773062.243334:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625177472 00000100:00100000:1.0:1775773062.243444:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 9 00000100:00100000:1.0:1775773062.243456:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:194722:x1862023625177472:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775773062.243477:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773062.243590:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775773062.243597:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:194722:x1862023625177472:12345-192.168.201.137@tcp:104: Request processed in 144us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1775773062.243606:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 9 00010000:00010000:2.0:1775773062.243674:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773062.243683:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773062.243691:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3385800 already unused, calling callback (ffffffffc1197c20) 10000000:00010000:2.0:1775773062.243696:0:160426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773062.243707:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1775773062.243714:0:160426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1775773062.243759:0:160426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1775773062.243806:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773062.243812:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773062.243840:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773062.243846:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d3385800/0x8a9f4e958445ea0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297da9ee9 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773062.243868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773062.243870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773062.243872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773062.243892:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612284928:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773062.251986:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612284928:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775773062.914266:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1775773063.295934:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:3.0:1775773063.295944:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 345 10000000:01000000:3.0:1775773063.295952:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:3.0:1775773063.296023:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773063.296038:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773063.296053:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773063.296324:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612285056:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1775773063.296537:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773063.313927:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612285056:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1775773063.313970:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773063.313986:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773063.314381:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612285184:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1775773063.314498:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773063.334432:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612285184:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:3.0:1775773063.334514:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:3.0:1775773063.334695:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:3.0:1775773063.334709:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773063.334766:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775773063.419658:0:165548:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 11, was 0): DISCONN 00010000:00080000:3.0:1775773063.419714:0:165548:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c7278800@lustre-MDT0001-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00000100:00080000:3.0:1775773063.419747:0:165548:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773063.419760:0:165548:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:3.0:1775773063.419774:0:165548:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773063.419792:0:165548:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773063.419833:0:165548:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d01ece00 x1862023612285312/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773063.423378:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612285312:192.168.201.137@tcp:38:lctl.0 00010000:00080000:2.0:1775773063.447246:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d01ece00 x1862023612285312/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'lctl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773063.447287:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to target with instance 7 00000100:00080000:2.0:1775773063.447313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1775773063.447322:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00100000:2.0:1775773063.447326:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 25769803846 gen 1 00000100:00080000:2.0:1775773063.447349:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c7278800 from lustre-MDT0001_UUID committed 25769803846 last 0 00000100:00080000:2.0:1775773063.447354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1775773063.450895:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612285312:192.168.201.137@tcp:38:lctl.0 00010000:00080000:0.0:1775773063.450949:0:165554:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-mdc-ffff8de1e006a000 to lustre-MDT0001_UUID@192.168.201.137@tcp 00010000:00010000:0.0:1775773063.450954:0:165554:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-mdc-ffff8de1e006a000 (0) 00010000:00010000:0.0:1775773063.450961:0:165554:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-mdc-ffff8de1e006a000 00000100:00080000:0.0:1775773063.452518:0:165554:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1775773063.452906:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612285440:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000100:00100000:0.0:1775773063.490295:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612285568:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775773063.501164:0:2403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 0/0 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1775773063.501192:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612285568:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773063.501580:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773063.501603:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773063.501605:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773063.501607:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773063.937613:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773064.972322:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773065.984686:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773067.008091:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1775773067.722792:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d01edf80 x1862023612285440/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773079 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773067.722818:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1775773067.722825:0:2401:0:(client.c:3204:ptlrpc_resend_req()) @@@ going to resend req@ffff8de1d01edf80 x1862023612285440/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773079 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773067.722835:0:2401:0:(client.c:3213:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8de1d01edf80 x1862023612285440/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773079 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773067.722843:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1775773067.723864:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00100000:0.0:1775773067.723873:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612285440:192.168.201.137@tcp:400:ldlm_lock_repla.0 00010000:00010000:3.0:1775773068.031977:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773068.609474:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612285824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773068.609696:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612285696:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773068.612412:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612285952:192.168.201.137@tcp:400:kworker.0 00010000:00080000:3.0:1775773068.618901:0:2404:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0f9a680 x1862023612285952/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773068.618925:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612285952:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773068.619426:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612285824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773068.620286:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612285696:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773069.056297:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773070.080091:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773071.107193:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775773071.815874:0:165642:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775773071.815893:0:165642:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773071.815925:0:165642:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773071.816033:0:165642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773071.816055:0:165642:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775773071.816064:0:165642:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773071.816074:0:165642:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773071.816078:0:165642:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:1.0:1775773071.816086:0:165642:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0d93cb8 00010000:00010000:1.0:1775773071.816091:0:165642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773071.816102:0:165642:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200008:1.0:1775773071.818420:0:165642:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775773071.818434:0:165642:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773071.818467:0:165642:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773071.818560:0:165642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:1.0:1775773071.818576:0:165642:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1775773071.818585:0:165642:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773071.818592:0:165642:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773071.818596:0:165642:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:1.0:1775773071.818605:0:165642:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0d93cb8 00010000:00010000:1.0:1775773071.818610:0:165642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:1.0:1775773071.818619:0:165642:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:1.0:1775773071.819351:0:165642:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773071.819366:0:165642:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773071.819377:0:165642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:1.0:1775773071.819387:0:165642:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:1.0:1775773071.819395:0:165642:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773071.819400:0:165642:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773071.819403:0:165642:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:1.0:1775773071.819407:0:165642:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0d93bb0 00010000:00010000:1.0:1775773071.819410:0:165642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:1.0:1775773071.819417:0:165642:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:1.0:1775773071.819429:0:165642:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:1.0:1775773071.819440:0:165642:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:1.0:1775773071.820109:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:1.0:1775773071.820141:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00800000:00000004:1.0:1775773071.820150:0:165642:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9014, max_age 9047 00000100:00100000:1.0:1775773071.820210:0:165642:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165642:1862023612286080:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773071.820573:0:165642:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773071.828078:0:165642:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165642:1862023612286080:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773071.828138:0:165642:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023641/1024000 00000080:00200080:2.0:1775773071.828237:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.828257:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00800000:00000004:2.0:1775773071.828266:0:165642:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9014, max_age 9047 00000100:00100000:2.0:1775773071.828311:0:165642:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165642:1862023612286208:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773071.828400:0:165642:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baaa80 going to sleep for 11 seconds 00010000:00080000:2.0:1775773071.832215:0:165642:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0f98700 x1862023612286208/t0(0) o41->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 1775773087 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773071.832240:0:165642:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165642:1862023612286208:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773071.832270:0:165642:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317331/353529 objects 1023719/1024000 00000080:00200080:2.0:1775773071.832349:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832371:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832381:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832385:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832389:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832393:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832396:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832400:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832404:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832407:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832411:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832414:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832418:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832421:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832424:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832427:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832431:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832434:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832438:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832441:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832444:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832447:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832452:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832455:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832459:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832462:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832465:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832468:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832472:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832487:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832492:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832496:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832500:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832503:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832507:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832510:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832514:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832517:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832521:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832524:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832528:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832532:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832536:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832539:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832543:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832546:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832550:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832553:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832557:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832560:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832564:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832567:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832570:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832573:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832577:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832580:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832585:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832588:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832591:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832595:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832598:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832602:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832607:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832610:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832614:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832617:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832622:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832625:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832629:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832632:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832636:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832639:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832643:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832646:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832650:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832653:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832657:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832661:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832665:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832670:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832673:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832677:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832681:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832684:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832688:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832691:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832694:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832697:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832701:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832704:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832708:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832712:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832715:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832718:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832747:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832752:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832756:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832761:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832764:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832768:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832772:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832776:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832779:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832783:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832788:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832790:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832794:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832796:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832800:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832803:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832807:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832810:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832814:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832817:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832821:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832824:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832827:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832830:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832834:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832837:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832841:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832844:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832847:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832850:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832854:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00800000:00000080:2.0:1775773071.832858:0:165642:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00000080:00200080:2.0:1775773071.832861:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:2.0:1775773071.832868:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00020000:00000004:2.0:1775773071.832878:0:165642:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9014, max_age 9047 00000100:00080000:2.0:1775773071.832895:0:165642:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9005 00000100:00080000:2.0:1775773071.832908:0:165642:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773071.832921:0:165642:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:2.0:1775773071.833180:0:165642:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f98e00 x1862023612286336/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773071.833233:0:165642:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1d0f98700 x1862023612286464/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773071.833244:0:165642:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baaa80 going to sleep for 0 seconds 00000100:00100000:0.0:1775773071.833280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612286336:192.168.201.137@tcp:8:lfs.0 00000100:00100000:0.0:1775773071.836895:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 38654705666 gen 5 00000100:00080000:0.0:1775773071.836919:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8de1e006a000: connect to target with instance 9 00000100:00080000:0.0:1775773071.836932:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:2.0:1775773071.837290:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1775773071.837300:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1775773071.837307:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1775773071.837313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000080:00000004:2.0:1775773071.837321:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1775773071.837324:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1775773071.837340:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 0000000085f7b5ec): req@ffff8de1d0f98700 x1862023612286464/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773071.837589:0:165642:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773071.838477:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612286336:192.168.201.137@tcp:8:lfs.0 00000100:00100000:2.0:1775773071.840463:0:165642:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165642:1862023612286464:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773071.840510:0:165642:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:2.0:1775773071.840610:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:2.0:1775773071.841464:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6793400 uarg=0000000000000000 00020000:00000004:2.0:1775773071.841485:0:165642:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9014, max_age 9047 00000100:00080000:2.0:1775773071.841504:0:165642:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9005 00000100:00080000:2.0:1775773071.841520:0:165642:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773071.841535:0:165642:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:2.0:1775773071.841567:0:165642:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f98e00 x1862023612286592/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773071.841928:0:165642:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1d0f98700 x1862023612286720/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773071.841940:0:165642:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baaa80 going to sleep for 0 seconds 00000100:00100000:0.0:1775773071.842028:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612286592:192.168.201.137@tcp:8:lfs.0 00000100:00100000:2.0:1775773071.854520:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1e006a000: committing for last_committed 0 gen 5 00000100:00080000:2.0:1775773071.854541:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8de1e006a000: connect to target with instance 1 00000100:00080000:2.0:1775773071.854554:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:2.0:1775773071.854569:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1775773071.854577:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1775773071.854585:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1775773071.854590:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000080:00000004:2.0:1775773071.854598:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1775773071.854601:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1775773071.854627:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 0000000085f7b5ec): req@ffff8de1d0f98700 x1862023612286720/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773071.854657:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612286592:192.168.201.137@tcp:8:lfs.0 00000100:00100000:1.0:1775773071.854845:0:165642:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1775773071.863214:0:165642:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:165642:1862023612286720:192.168.201.137@tcp:13:lfs.0 00020000:00000004:1.0:1775773071.863252:0:165642:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:1.0:1775773071.863358:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863383:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863391:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863396:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863400:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863404:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863407:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863411:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863414:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863418:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863421:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863425:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863429:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863432:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863436:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863439:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863443:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863447:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863451:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863455:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863458:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863461:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863466:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863469:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863473:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863477:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863490:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863494:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863498:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863501:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863505:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863508:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863512:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863515:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863519:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863522:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863526:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863530:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863534:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863537:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863541:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863545:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863549:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863554:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863557:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863561:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863564:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863568:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863572:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863576:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863579:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863583:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863587:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863591:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863594:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863598:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863602:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863606:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863610:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863613:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863628:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863633:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863636:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863640:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863644:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863647:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863651:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863654:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863659:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863662:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863666:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863670:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863674:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863677:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863681:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863684:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863688:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863691:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863695:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863698:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863701:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863704:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863708:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863710:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863713:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863716:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863719:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863771:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863776:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863779:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863783:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863786:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863789:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863793:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863796:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863799:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863803:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863806:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863810:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863813:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863816:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863819:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863822:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863825:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863828:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863831:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863835:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863838:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863842:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863845:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863848:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863851:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863854:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863857:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863860:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863863:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863866:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863869:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863874:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863877:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863881:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863884:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863889:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863892:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200080:1.0:1775773071.863896:0:165642:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffe2b670310 00020000:00000080:1.0:1775773071.863900:0:165642:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b91c00 uarg=0000000000000000 00000080:00200008:1.0:1775773071.863919:0:165642:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00010000:00010000:0.0:1775773072.129055:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773073.152796:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773073.730466:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612286848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773073.730606:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287104:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773073.730638:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773073.730671:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1775773073.730677:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612286976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773073.730700:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287232:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773073.737487:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612286848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773073.738150:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773073.747328:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612286976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773073.747349:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287232:192.168.201.137@tcp:400:kworker.0 00010000:00080000:3.0:1775773073.747364:0:2405:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0f9b800 x1862023612287104/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773073.747376:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287104:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773074.183180:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773075.200030:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775773076.208656:0:165893:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 00010000:00010000:2.0:1775773076.228271:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773077.250743:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775773077.741513:0:166050:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1775773078.271980:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773078.848017:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.848128:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.848160:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1775773078.848166:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612287488:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.848206:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287744:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.848228:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612288000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.855243:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612287488:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.855267:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.863287:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612288000:192.168.201.137@tcp:400:kworker.0 00010000:00080000:3.0:1775773078.865428:0:2405:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d01edc00 x1862023612287744/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773078.865447:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287744:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773078.865461:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612287616:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773079.301914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:2.0:1775773079.679088:0:166088:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773079.679105:0:166088:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.679129:0:166088:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.679149:0:166088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:2.0:1775773079.679165:0:166088:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:2.0:1775773079.679174:0:166088:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.679182:0:166088:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.679185:0:166088:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.679192:0:166088:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bcb8 00010000:00010000:2.0:1775773079.679196:0:166088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:2.0:1775773079.679205:0:166088:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200008:2.0:1775773079.681167:0:166088:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773079.681176:0:166088:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.681195:0:166088:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.681211:0:166088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1775773079.681229:0:166088:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:2.0:1775773079.681236:0:166088:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.681243:0:166088:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.681247:0:166088:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.681253:0:166088:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bcb8 00010000:00010000:2.0:1775773079.681257:0:166088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1775773079.681265:0:166088:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:2.0:1775773079.681372:0:166088:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.681381:0:166088:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.681387:0:166088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1775773079.681395:0:166088:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:2.0:1775773079.681402:0:166088:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.681406:0:166088:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.681408:0:166088:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.681412:0:166088:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bbb0 00010000:00010000:2.0:1775773079.681414:0:166088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1775773079.681421:0:166088:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:2.0:1775773079.681430:0:166088:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:2.0:1775773079.681438:0:166088:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:2.0:1775773079.681553:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.681568:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00800000:00000004:2.0:1775773079.681575:0:166088:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9048, max_age 9055 00000100:00100000:2.0:1775773079.681618:0:166088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288128:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773079.681704:0:166088:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27900 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.685131:0:166088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288128:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773079.685160:0:166088:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023641/1024000 00000080:00200080:2.0:1775773079.685278:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.685295:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00800000:00000004:2.0:1775773079.685302:0:166088:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9048, max_age 9055 00000100:00100000:2.0:1775773079.685335:0:166088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288256:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773079.685410:0:166088:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27900 going to sleep for 11 seconds 00010000:00080000:2.0:1775773079.690526:0:166088:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0f98380 x1862023612288256/t0(0) o41->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 1775773095 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773079.690545:0:166088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288256:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773079.690569:0:166088:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317331/353529 objects 1023719/1024000 00000080:00200080:2.0:1775773079.690647:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690662:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690669:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690674:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690678:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690681:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690686:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690689:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690692:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690696:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690700:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690703:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690707:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690710:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690714:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690717:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690720:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690753:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690758:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690761:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690765:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690769:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690772:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690776:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690780:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690783:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690787:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690791:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690795:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690815:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690819:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690824:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690828:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690831:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690835:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690838:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690841:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690845:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690848:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690852:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690855:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690859:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690863:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690866:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690869:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690873:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690877:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690881:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690884:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690887:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690891:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690895:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690899:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690902:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690906:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690910:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690914:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690918:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690922:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690925:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690929:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690932:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690936:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690939:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690943:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690946:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690949:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690952:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690956:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690959:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690963:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690966:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690970:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690974:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690987:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.690993:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.690998:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691002:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691005:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691009:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691013:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691016:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691019:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691023:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691027:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691030:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691034:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691038:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691041:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691045:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691048:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691052:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691056:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691059:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691063:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691066:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691070:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691073:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691077:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691080:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691084:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691087:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691091:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691094:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691098:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691102:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691106:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691109:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691113:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691116:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691120:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691123:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691127:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691130:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691134:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691138:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691141:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691144:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691148:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691152:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691155:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691159:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691163:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691166:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691170:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00800000:00000080:2.0:1775773079.691173:0:166088:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00000080:00200080:2.0:1775773079.691177:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:2.0:1775773079.691183:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c6791000 uarg=0000000000000000 00020000:00000004:2.0:1775773079.691191:0:166088:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9048, max_age 9055 00000100:00100000:2.0:1775773079.691226:0:166088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288384:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773079.691284:0:166088:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27900 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.693530:0:166088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288384:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775773079.693556:0:166088:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:3.0:1775773079.693622:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.693637:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00020000:00000004:3.0:1775773079.693644:0:166088:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9048, max_age 9055 00000100:00100000:3.0:1775773079.693674:0:166088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288512:192.168.201.137@tcp:13:lfs.0 00000100:00100000:3.0:1775773079.693754:0:166088:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.701326:0:166088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166088:1862023612288512:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775773079.701356:0:166088:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:3.0:1775773079.701456:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701473:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701480:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701484:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701488:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701492:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701496:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701499:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701503:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701507:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701511:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701514:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701518:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701522:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701525:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701528:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701532:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701535:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701539:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701542:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701546:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701549:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701552:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701556:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701560:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701563:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701567:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701570:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701574:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701577:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701580:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701583:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701586:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701589:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701593:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701596:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701599:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701602:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701606:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701609:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701613:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701616:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701620:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701623:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701628:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701631:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701634:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701637:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701641:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701644:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701648:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701652:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701656:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701659:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701663:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701667:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701670:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701674:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701677:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701680:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701684:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701687:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701690:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701694:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701697:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701700:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.701704:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.701707:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702035:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702041:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702044:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702048:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702051:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702054:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702058:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702062:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702066:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702069:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702073:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702076:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702080:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702083:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702087:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702090:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702093:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702096:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702100:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702103:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702107:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702110:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702114:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702117:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702121:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702125:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702129:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702133:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702137:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702140:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702143:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702147:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702150:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702153:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702157:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702160:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702165:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702168:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702172:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702175:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702179:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702182:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702185:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702189:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702193:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702196:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702200:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702205:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702208:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702212:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702216:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702219:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702223:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702226:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702231:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702234:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200080:3.0:1775773079.702238:0:166088:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffdf65ad3d0 00020000:00000080:3.0:1775773079.702241:0:166088:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660c800 uarg=0000000000000000 00000080:00200008:3.0:1775773079.702254:0:166088:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:0.0:1775773079.738231:0:166104:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773079.738260:0:166104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773079.738279:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:0.0:1775773079.738296:0:166104:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:0.0:1775773079.738306:0:166104:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773079.738314:0:166104:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773079.738318:0:166104:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:0.0:1775773079.738325:0:166104:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0da3bf8 00010000:00010000:0.0:1775773079.738329:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:0.0:1775773079.738338:0:166104:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:0.0:1775773079.738351:0:166104:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773079.738364:0:166104:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=27 00000080:00200000:0.0:1775773079.738368:0:166104:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=0 00000002:00010000:0.0:1775773079.738381:0:166104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80c.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1775773079.738434:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.738444:0:166104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.738455:0:166104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773079.738485:0:166104:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612288640:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775773079.738628:0:166104:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.748570:0:166104:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612288640:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773079.748594:0:166104:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748614:0:166104:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748621:0:166104:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748632:0:166104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748644:0:166104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748657:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748665:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748673:0:166104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773079.748684:0:166104:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8de1c67d5180 x1862023612288640/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773079.748699:0:166104:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748710:0:166104:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/7 (0 0) 00000080:00200000:2.0:1775773079.748715:0:166104:0:(namei.c:943:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773079.748773:0:166104:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x7:0x0], updating i_size 4096 00000080:00200000:2.0:1775773079.748777:0:166104:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0x7:0x0](ffff8de1c4083a88): rc = 0 00000080:00010000:2.0:1775773079.748783:0:166104:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445ea21 00000080:00010000:2.0:1775773079.748807:0:166104:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00000080:00010000:2.0:1775773079.748947:0:166104:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea21 from it ffff9ba1c0da3ac8 00010000:00010000:2.0:1775773079.748952:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.748962:0:166104:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773079.749005:0:166104:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.749029:0:166104:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), file ffff8de1d2a20000, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1775773079.749036:0:166104:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), intent=open 00000002:00010000:2.0:1775773079.749058:0:166104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0x7:0x0], intent: open flags 0304001 00010000:00010000:2.0:1775773079.749105:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.749114:0:166104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773079.749125:0:166104:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773079.749132:0:166104:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99f80 x1862023612288896/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 656/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773079.749141:0:166104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773079.749163:0:166104:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612288896:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773079.749327:0:166104:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.761198:0:166104:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612288896:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773079.761225:0:166104:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761246:0:166104:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761255:0:166104:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761267:0:166104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761283:0:166104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761296:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761304:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761310:0:166104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.761322:0:166104:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=0 req@ffff8de1d0f99f80 x1862023612288896/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 656/608 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773079.761335:0:166104:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761345:0:166104:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 9663686441/43 (0 0) 00000002:00010000:3.0:1775773079.761360:0:166104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x240002729:0x2b:0x0], intent: open flags 0304001 00010000:00010000:3.0:1775773079.761405:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.761413:0:166104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773079.761423:0:166104:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773079.761430:0:166104:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eed80 x1862023612289152/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773079.761438:0:166104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773079.761459:0:166104:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612289152:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773079.761637:0:166104:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.783434:0:166104:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612289152:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773079.783459:0:166104:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783474:0:166104:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783482:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783488:0:166104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 3/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783497:0:166104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 4/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783503:0:166104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384e00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773079.783508:0:166104:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 4/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783515:0:166104:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 4/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783522:0:166104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 5/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783530:0:166104:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773079.783536:0:166104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 3/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783543:0:166104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea2f lrc: 0/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 166104 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.783569:0:166104:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d01eed80 x1862023612289152/t30064771073(30064771073) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773079.783582:0:166104:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01eed80 x1862023612289152/t30064771073(30064771073) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773079.783637:0:166104:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0x7:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773079.783664:0:166104:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x2b:0x0], updating i_size 4096 00000080:00200000:3.0:1775773079.783667:0:166104:0:(namei.c:147:ll_iget()) got inode: [0x240002729:0x2b:0x0](ffff8de1c40763c8): rc = 0 00000080:00010000:3.0:1775773079.783673:0:166104:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for lock 0x8a9f4e958445ea28 00000080:00010000:3.0:1775773079.783685:0:166104:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00200008:3.0:1775773079.783699:0:166104:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 304000 00000002:00100000:3.0:1775773079.783719:0:166104:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01eed80 x1862023612289152/t30064771073(30064771073) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773079.783794:0:166104:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea28 from it ffff8de1d2129d20 00010000:00010000:3.0:1775773079.783800:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.783880:0:166104:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773079.783906:0:166104:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 44 00000080:00200000:3.0:1775773079.783960:0:166104:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773079.783990:0:166104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773079.784003:0:166104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1775773079.784015:0:166104:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:3.0:1775773079.784022:0:166104:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773079.784027:0:166104:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773079.784031:0:166104:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773079.784034:0:166104:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c0da3bf8 00010000:00010000:3.0:1775773079.784037:0:166104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1775773079.784044:0:166104:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:3.0:1775773079.784052:0:166104:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.784058:0:166104:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=24 00000080:00200000:3.0:1775773079.784063:0:166104:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.784067:0:166104:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=264 00000080:00200000:3.0:1775773079.784071:0:166104:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 44 00000080:00200008:3.0:1775773079.784075:0:166104:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 504000 00000080:00200008:3.0:1775773079.784093:0:166104:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 304000 00000080:00200080:3.0:1775773079.784121:0:166104:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8) cmd=800466af arg=7fffaff6b7ec 00000080:00200008:3.0:1775773079.784207:0:166104:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 504000 00000002:00100000:3.0:1775773079.784245:0:166104:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01eed80 x1862023612289152/t30064771073(30064771073) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773079.784255:0:166104:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773079.784259:0:166104:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01edc00 x1862023612289408/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773079.784280:0:166104:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612289408:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775773079.784341:0:166104:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6a80 going to sleep for 11 seconds 00010000:00080000:3.0:1775773079.787247:0:166104:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d01edc00 x1862023612289408/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/456 e 0 to 0 dl 1775773095 ref 2 fl Rpc:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1775773079.787269:0:166104:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166104:1862023612289408:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773079.787296:0:166104:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01eed80 x1862023612289152/t30064771073(30064771073) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773079.800577:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773079.800615:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773079.800634:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1775773079.800649:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:0.0:1775773079.800657:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773079.800663:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773079.800667:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:0.0:1775773079.800673:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:0.0:1775773079.800676:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1775773079.800684:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:0.0:1775773079.800700:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773079.800707:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:0.0:1775773079.800713:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:0.0:1775773079.800717:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773079.801744:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773079.801768:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773079.801773:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-0, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c2d20180, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773079.801782:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-0, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:0.0:1775773079.801883:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-0,[0x240002729:0x2c:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773079.801939:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.801948:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773079.801959:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773079.801970:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d4e00 x1862023612289664/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773079.801990:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773079.802011:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612289664:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773079.802493:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.814794:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612289664:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773079.814883:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814912:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814919:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814929:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814940:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814951:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814963:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.814971:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773079.814992:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c67d4e00 x1862023612289664/t30064771075(30064771075) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773079.815003:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c67d4e00 x1862023612289664/t30064771075(30064771075) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773079.815015:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773079.815027:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.815036:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/44 (0 0) 00000080:00200000:2.0:1775773079.815043:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773079.815056:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-0, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:2.0:1775773079.815085:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x2c:0x0](ffff8de1c40821c8) 00000080:00200000:2.0:1775773079.815206:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x2c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773079.815217:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x2c:0x0](ffff8de1c40821c8) 00000080:00010000:2.0:1775773079.815221:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2c:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445ea36 00000080:00010000:2.0:1775773079.815229:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2c:0x0](ffff8de1c40821c8) 00000080:00200008:2.0:1775773079.815242:0:166110:0:(file.c:1057:ll_file_open()) START file f-0:[0x240002729:0x2c:0x0](ffff8de1c40821c8), flags 100102 00000002:00100000:2.0:1775773079.815262:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c67d4e00 x1862023612289664/t30064771075(30064771075) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773079.815300:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea36 from it ffff8de1d2190c00 00010000:00010000:2.0:1775773079.815305:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.815313:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773079.815335:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2c:0x0](ffff8de1c40821c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773079.815364:0:166110:0:(file.c:447:ll_file_release()) START file f-0:[0x240002729:0x2c:0x0](ffff8de1c40821c8), flags 100002 00000002:00100000:2.0:1775773079.815405:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c67d4e00 x1862023612289664/t30064771075(30064771075) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773079.815415:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773079.815419:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b480 x1862023612289920/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773079.815442:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612289920:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773079.815577:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27d80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.826025:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612289920:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773079.826063:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c67d4e00 x1862023612289664/t30064771075(30064771075) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773079.826129:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.826151:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.826171:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:2.0:1775773079.826191:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:2.0:1775773079.826199:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.826205:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.826208:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.826216:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:2.0:1775773079.826220:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:2.0:1775773079.826228:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:2.0:1775773079.826242:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.826249:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:2.0:1775773079.826254:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.826257:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773079.826260:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.826271:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773079.826275:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-1, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c99bec00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773079.826283:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-1, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:2.0:1775773079.826304:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-1,[0x240002729:0x2d:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773079.826355:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.826363:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773079.826375:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773079.826381:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99500 x1862023612290176/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773079.826389:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773079.826408:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290176:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773079.826524:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27d80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.832198:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290176:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773079.832223:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832248:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832257:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832267:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832276:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832290:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832305:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832311:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773079.832321:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f99500 x1862023612290176/t30064771077(30064771077) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773079.832333:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99500 x1862023612290176/t30064771077(30064771077) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773079.832345:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773079.832355:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832364:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/45 (0 0) 00000080:00200000:2.0:1775773079.832379:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773079.832392:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-1, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:2.0:1775773079.832426:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x2d:0x0](ffff8de1c4084b08) 00000080:00200000:2.0:1775773079.832549:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x2d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773079.832558:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x2d:0x0](ffff8de1c4084b08) 00000080:00010000:2.0:1775773079.832562:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2d:0x0](ffff8de1c4084b08) for lock 0x8a9f4e958445ea3d 00000080:00010000:2.0:1775773079.832570:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2d:0x0](ffff8de1c4084b08) 00000080:00200008:2.0:1775773079.832583:0:166110:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x2d:0x0](ffff8de1c4084b08), flags 100102 00000002:00100000:2.0:1775773079.832601:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99500 x1862023612290176/t30064771077(30064771077) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773079.832650:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea3d from it ffff8de1d2129660 00010000:00010000:2.0:1775773079.832654:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.832663:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773079.832682:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2d:0x0](ffff8de1c4084b08), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773079.832707:0:166110:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x2d:0x0](ffff8de1c4084b08), flags 100002 00000002:00100000:2.0:1775773079.832765:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f99500 x1862023612290176/t30064771077(30064771077) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773079.832775:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773079.832779:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98000 x1862023612290432/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773079.832800:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290432:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773079.832865:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27900 going to sleep for 11 seconds 00000100:00100000:1.0:1775773079.840174:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290432:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775773079.840211:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f99500 x1862023612290176/t30064771077(30064771077) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773079.840269:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773079.840286:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773079.840304:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1775773079.840319:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:1.0:1775773079.840327:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773079.840333:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773079.840336:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:1.0:1775773079.840342:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:1.0:1775773079.840346:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1775773079.840360:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:1.0:1775773079.840375:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773079.840382:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:1.0:1775773079.840388:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:1.0:1775773079.840392:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775773079.840395:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773079.840406:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773079.840410:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-2, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c2a95200, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775773079.840418:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-2, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:1.0:1775773079.840438:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-2,[0x240002729:0x2e:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775773079.840642:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.840651:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773079.840663:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773079.840669:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30a80 x1862023612290688/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773079.840680:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773079.840702:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290688:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775773079.843645:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.859450:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290688:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773079.859497:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859532:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859541:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859553:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859565:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859578:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859585:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859593:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.859604:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0a30a80 x1862023612290688/t30064771079(30064771079) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773079.859618:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a30a80 x1862023612290688/t30064771079(30064771079) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773079.859632:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773079.859645:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.859655:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/46 (0 0) 00000080:00200000:3.0:1775773079.859662:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773079.859675:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-2, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773079.859710:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x2e:0x0](ffff8de1c407b248) 00000080:00200000:3.0:1775773079.860033:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x2e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773079.860044:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x2e:0x0](ffff8de1c407b248) 00000080:00010000:3.0:1775773079.860048:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2e:0x0](ffff8de1c407b248) for lock 0x8a9f4e958445ea44 00000080:00010000:3.0:1775773079.860059:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2e:0x0](ffff8de1c407b248) 00000080:00200008:3.0:1775773079.860072:0:166110:0:(file.c:1057:ll_file_open()) START file f-2:[0x240002729:0x2e:0x0](ffff8de1c407b248), flags 100102 00000002:00100000:3.0:1775773079.860093:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a30a80 x1862023612290688/t30064771079(30064771079) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773079.860131:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea44 from it ffff8de1c670f720 00010000:00010000:3.0:1775773079.860136:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.860146:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773079.860166:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2e:0x0](ffff8de1c407b248), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773079.860195:0:166110:0:(file.c:447:ll_file_release()) START file f-2:[0x240002729:0x2e:0x0](ffff8de1c407b248), flags 100002 00000002:00100000:3.0:1775773079.860239:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a30a80 x1862023612290688/t30064771079(30064771079) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773079.860251:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773079.860255:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01edc00 x1862023612290944/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773079.860274:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290944:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773079.860349:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.870064:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edc00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612290944:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773079.870181:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a30a80 x1862023612290688/t30064771079(30064771079) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773079.870262:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.870280:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.870300:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:2.0:1775773079.870315:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:2.0:1775773079.870325:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.870330:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.870333:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.870339:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:2.0:1775773079.870343:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:2.0:1775773079.870352:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:2.0:1775773079.870367:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.870373:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:2.0:1775773079.870378:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.870382:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773079.870385:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.870397:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773079.870401:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-3, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c8674c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773079.870407:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-3, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:2.0:1775773079.870425:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-3,[0x240002729:0x2f:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773079.870534:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.870543:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773079.870555:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773079.870561:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9aa00 x1862023612291200/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773079.870571:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773079.870590:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9aa00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291200:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773079.870968:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27900 going to sleep for 11 seconds 00000100:00100000:1.0:1775773079.878621:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9aa00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291200:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775773079.878648:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878678:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878686:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878697:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878720:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878765:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878773:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878779:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773079.878790:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f9aa00 x1862023612291200/t30064771081(30064771081) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775773079.878802:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9aa00 x1862023612291200/t30064771081(30064771081) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773079.878816:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1775773079.878828:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.878838:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/47 (0 0) 00000080:00200000:1.0:1775773079.878844:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775773079.878857:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-3, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:1.0:1775773079.878889:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x2f:0x0](ffff8de1c4038908) 00000080:00200000:1.0:1775773079.879021:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x2f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1775773079.879031:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x2f:0x0](ffff8de1c4038908) 00000080:00010000:1.0:1775773079.879034:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2f:0x0](ffff8de1c4038908) for lock 0x8a9f4e958445ea4b 00000080:00010000:1.0:1775773079.879042:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2f:0x0](ffff8de1c4038908) 00000080:00200008:1.0:1775773079.879055:0:166110:0:(file.c:1057:ll_file_open()) START file f-3:[0x240002729:0x2f:0x0](ffff8de1c4038908), flags 100102 00000002:00100000:1.0:1775773079.879074:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9aa00 x1862023612291200/t30064771081(30064771081) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1775773079.879113:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea4b from it ffff8de1d2129660 00010000:00010000:1.0:1775773079.879117:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.879125:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773079.879144:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2f:0x0](ffff8de1c4038908), inode mode 81a4 mask 40 00000080:00200008:1.0:1775773079.879171:0:166110:0:(file.c:447:ll_file_release()) START file f-3:[0x240002729:0x2f:0x0](ffff8de1c4038908), flags 100002 00000002:00100000:1.0:1775773079.879209:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9aa00 x1862023612291200/t30064771081(30064771081) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775773079.879218:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775773079.879222:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30380 x1862023612291456/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775773079.879241:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291456:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775773079.879316:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7bafc00 going to sleep for 11 seconds 00000100:00100000:1.0:1775773079.888098:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291456:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775773079.888128:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9aa00 x1862023612291200/t30064771081(30064771081) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773079.888197:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773079.888213:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773079.888230:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1775773079.888244:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:1.0:1775773079.888251:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773079.888256:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773079.888260:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:1.0:1775773079.888266:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:1.0:1775773079.888269:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1775773079.888278:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:1.0:1775773079.888291:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773079.888298:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:1.0:1775773079.888303:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:1.0:1775773079.888306:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775773079.888310:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773079.888321:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773079.888326:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-4, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c2a95380, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775773079.888333:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-4, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:1.0:1775773079.888353:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-4,[0x240002729:0x30:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775773079.888399:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773079.888408:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773079.888417:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773079.888422:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30000 x1862023612291712/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773079.888431:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773079.888447:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291712:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775773079.888557:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7bafc00 going to sleep for 11 seconds 00000100:00100000:1.0:1775773079.893803:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291712:192.168.201.137@tcp:101:createmany.0 00010000:00010000:1.0:1775773079.893829:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.893955:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.893965:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.893987:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.894003:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.894016:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.894024:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.894030:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773079.894041:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0a30000 x1862023612291712/t30064771083(30064771083) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773079.894053:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a30000 x1862023612291712/t30064771083(30064771083) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773079.894066:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773079.894079:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.894090:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/48 (0 0) 00000080:00200000:0.0:1775773079.894095:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773079.894108:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-4, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:0.0:1775773079.894144:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x30:0x0](ffff8de1c4077448) 00000080:00200000:0.0:1775773079.894262:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x30:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773079.894272:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x30:0x0](ffff8de1c4077448) 00000080:00010000:0.0:1775773079.894276:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x30:0x0](ffff8de1c4077448) for lock 0x8a9f4e958445ea52 00000080:00010000:0.0:1775773079.894284:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x30:0x0](ffff8de1c4077448) 00000080:00200008:0.0:1775773079.894299:0:166110:0:(file.c:1057:ll_file_open()) START file f-4:[0x240002729:0x30:0x0](ffff8de1c4077448), flags 100102 00000002:00100000:0.0:1775773079.894320:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a30000 x1862023612291712/t30064771083(30064771083) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773079.894365:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea52 from it ffff8de1c670f600 00010000:00010000:0.0:1775773079.894369:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773079.894378:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773079.894399:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x30:0x0](ffff8de1c4077448), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773079.894428:0:166110:0:(file.c:447:ll_file_release()) START file f-4:[0x240002729:0x30:0x0](ffff8de1c4077448), flags 100002 00000002:00100000:0.0:1775773079.894468:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a30000 x1862023612291712/t30064771083(30064771083) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773079.894478:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773079.894483:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d4000 x1862023612291968/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773079.894504:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291968:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773079.894574:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.897658:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612291968:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773079.897694:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a30000 x1862023612291712/t30064771083(30064771083) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773079.897841:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.897872:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.897893:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1775773079.897908:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:2.0:1775773079.897916:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.897923:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.897927:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.897934:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:2.0:1775773079.897938:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1775773079.897946:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00000080:00200000:2.0:1775773079.897965:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.897973:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:2.0:1775773079.897991:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.897996:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773079.897999:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.898015:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773079.898019:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-5, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c8675980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773079.898028:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-5, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:2.0:1775773079.898052:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-5,[0x240002729:0x31:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773079.898107:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.898117:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773079.898127:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773079.898135:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b100 x1862023612292224/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773079.898144:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773079.898168:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292224:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773079.898305:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d0a27900 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.904869:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292224:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773079.904894:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904922:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904930:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904941:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904950:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904961:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904969:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.904986:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773079.904997:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f9b100 x1862023612292224/t30064771085(30064771085) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773079.905009:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9b100 x1862023612292224/t30064771085(30064771085) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773079.905022:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773079.905034:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.905045:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/49 (0 0) 00000080:00200000:2.0:1775773079.905051:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773079.905064:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-5, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:2.0:1775773079.905091:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x31:0x0](ffff8de1c4087448) 00000080:00200000:2.0:1775773079.905211:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x31:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773079.905222:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x31:0x0](ffff8de1c4087448) 00000080:00010000:2.0:1775773079.905225:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x31:0x0](ffff8de1c4087448) for lock 0x8a9f4e958445ea59 00000080:00010000:2.0:1775773079.905236:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x31:0x0](ffff8de1c4087448) 00000080:00200008:2.0:1775773079.905251:0:166110:0:(file.c:1057:ll_file_open()) START file f-5:[0x240002729:0x31:0x0](ffff8de1c4087448), flags 100102 00000002:00100000:2.0:1775773079.905272:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9b100 x1862023612292224/t30064771085(30064771085) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773079.905315:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea59 from it ffff8de1d2129120 00010000:00010000:2.0:1775773079.905319:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.905328:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773079.905348:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x31:0x0](ffff8de1c4087448), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773079.905375:0:166110:0:(file.c:447:ll_file_release()) START file f-5:[0x240002729:0x31:0x0](ffff8de1c4087448), flags 100002 00000002:00100000:2.0:1775773079.905422:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9b100 x1862023612292224/t30064771085(30064771085) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773079.905437:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773079.905441:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99880 x1862023612292480/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773079.905462:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292480:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773079.905538:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.912857:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292480:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773079.912895:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9b100 x1862023612292224/t30064771085(30064771085) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773079.913008:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773079.913027:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773079.913045:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00010000:00010000:2.0:1775773079.913065:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00000080:00200000:2.0:1775773079.913073:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773079.913078:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773079.913081:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773079.913088:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:2.0:1775773079.913092:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00010000:00010000:2.0:1775773079.913100:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:2.0:1775773079.913115:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.913122:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:2.0:1775773079.913128:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.913132:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773079.913135:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773079.913149:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773079.913153:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-6, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c8675680, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773079.913161:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-6, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:2.0:1775773079.913179:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-6,[0x240002729:0x32:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773079.913225:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.913233:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773079.913242:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773079.913248:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98a80 x1862023612292736/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773079.913257:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773079.913275:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292736:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773079.913398:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773079.920762:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292736:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773079.920805:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920839:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920848:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920860:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920871:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920883:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920893:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920900:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773079.920912:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f98a80 x1862023612292736/t30064771087(30064771087) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773079.920925:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98a80 x1862023612292736/t30064771087(30064771087) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773079.920937:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773079.920951:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.920962:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/50 (0 0) 00000080:00200000:2.0:1775773079.920968:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773079.920991:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-6, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:2.0:1775773079.921035:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x32:0x0](ffff8de1c4081148) 00000080:00200000:2.0:1775773079.921227:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x32:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773079.921238:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x32:0x0](ffff8de1c4081148) 00000080:00010000:2.0:1775773079.921241:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x32:0x0](ffff8de1c4081148) for lock 0x8a9f4e958445ea60 00000080:00010000:2.0:1775773079.921252:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x32:0x0](ffff8de1c4081148) 00000080:00200008:2.0:1775773079.921266:0:166110:0:(file.c:1057:ll_file_open()) START file f-6:[0x240002729:0x32:0x0](ffff8de1c4081148), flags 100102 00000002:00100000:2.0:1775773079.921286:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98a80 x1862023612292736/t30064771087(30064771087) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773079.921324:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea60 from it ffff8de1d2129120 00010000:00010000:2.0:1775773079.921328:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773079.921336:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773079.921358:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x32:0x0](ffff8de1c4081148), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773079.921385:0:166110:0:(file.c:447:ll_file_release()) START file f-6:[0x240002729:0x32:0x0](ffff8de1c4081148), flags 100002 00000002:00100000:2.0:1775773079.921428:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f98a80 x1862023612292736/t30064771087(30064771087) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773079.921443:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773079.921448:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99f80 x1862023612292992/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773079.921472:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292992:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773079.921561:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.928343:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612292992:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773079.928381:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f98a80 x1862023612292736/t30064771087(30064771087) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773079.928461:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773079.928479:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773079.928496:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:3.0:1775773079.928512:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:3.0:1775773079.928520:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773079.928526:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773079.928530:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773079.928537:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773079.928541:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:3.0:1775773079.928549:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:3.0:1775773079.928564:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.928571:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773079.928576:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.928581:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773079.928584:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.928597:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773079.928602:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-7, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773079.928609:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-7, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773079.928630:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-7,[0x240002729:0x33:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773079.928677:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.928686:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773079.928696:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773079.928702:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eed80 x1862023612293248/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773079.928712:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773079.928757:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612293248:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773079.930376:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.942545:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eed80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612293248:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773079.942573:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942607:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942616:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942632:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942643:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942656:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942664:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942671:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.942683:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01eed80 x1862023612293248/t30064771089(30064771089) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773079.942697:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01eed80 x1862023612293248/t30064771089(30064771089) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773079.942710:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773079.942773:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.942784:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/51 (0 0) 00000080:00200000:3.0:1775773079.942791:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773079.942818:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-7, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773079.942855:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x33:0x0](ffff8de1c407ec08) 00000080:00200000:3.0:1775773079.942983:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x33:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773079.942996:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x33:0x0](ffff8de1c407ec08) 00000080:00010000:3.0:1775773079.943000:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x33:0x0](ffff8de1c407ec08) for lock 0x8a9f4e958445ea67 00000080:00010000:3.0:1775773079.943013:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x33:0x0](ffff8de1c407ec08) 00000080:00200008:3.0:1775773079.943028:0:166110:0:(file.c:1057:ll_file_open()) START file f-7:[0x240002729:0x33:0x0](ffff8de1c407ec08), flags 100102 00000002:00100000:3.0:1775773079.943051:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01eed80 x1862023612293248/t30064771089(30064771089) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773079.943092:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea67 from it ffff8de1c7cee480 00010000:00010000:3.0:1775773079.943097:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.943106:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773079.943128:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x33:0x0](ffff8de1c407ec08), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773079.943157:0:166110:0:(file.c:447:ll_file_release()) START file f-7:[0x240002729:0x33:0x0](ffff8de1c407ec08), flags 100002 00000002:00100000:3.0:1775773079.943199:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01eed80 x1862023612293248/t30064771089(30064771089) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773079.943209:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773079.943214:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eea00 x1862023612293504/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773079.943234:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eea00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612293504:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773079.943310:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.947579:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eea00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612293504:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773079.947619:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01eed80 x1862023612293248/t30064771089(30064771089) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773079.947697:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773079.947717:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773079.947782:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:3.0:1775773079.947812:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:3.0:1775773079.947820:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773079.947825:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773079.947828:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773079.947834:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773079.947838:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:3.0:1775773079.947845:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:3.0:1775773079.947858:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.947865:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773079.947873:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.947876:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773079.947879:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.947890:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773079.947896:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-8, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211080, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773079.947903:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-8, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773079.947921:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-8,[0x240002729:0x34:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773079.947969:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.947987:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773079.947997:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773079.948004:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ef480 x1862023612293760/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773079.948013:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773079.948032:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612293760:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773079.948154:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.958419:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612293760:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773079.958445:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958477:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 4/0,1 mode: --/PR res: [0x240002729:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958485:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 4/0,1 mode: --/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958496:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958506:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958517:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958525:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958532:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.958544:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ef480 x1862023612293760/t30064771091(30064771091) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773079.958557:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ef480 x1862023612293760/t30064771091(30064771091) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773079.958570:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773079.958582:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958593:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/52 (0 0) 00000080:00200000:3.0:1775773079.958599:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773079.958613:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-8, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773079.958644:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x34:0x0](ffff8de1c407a1c8) 00000080:00200000:3.0:1775773079.958828:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x34:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773079.958838:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x34:0x0](ffff8de1c407a1c8) 00000080:00010000:3.0:1775773079.958841:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x34:0x0](ffff8de1c407a1c8) for lock 0x8a9f4e958445ea6e 00000080:00010000:3.0:1775773079.958860:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x34:0x0](ffff8de1c407a1c8) 00000080:00200008:3.0:1775773079.958874:0:166110:0:(file.c:1057:ll_file_open()) START file f-8:[0x240002729:0x34:0x0](ffff8de1c407a1c8), flags 100102 00000002:00100000:3.0:1775773079.958892:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ef480 x1862023612293760/t30064771091(30064771091) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773079.958932:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea6e from it ffff8de1c7cee480 00010000:00010000:3.0:1775773079.958937:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.958946:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773079.958968:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x34:0x0](ffff8de1c407a1c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773079.959008:0:166110:0:(file.c:447:ll_file_release()) START file f-8:[0x240002729:0x34:0x0](ffff8de1c407a1c8), flags 100002 00000002:00100000:3.0:1775773079.959051:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ef480 x1862023612293760/t30064771091(30064771091) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773079.959060:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773079.959065:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ed880 x1862023612294016/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773079.959085:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294016:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773079.959165:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.965236:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294016:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773079.965275:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ef480 x1862023612293760/t30064771091(30064771091) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773079.965352:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773079.965372:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773079.965390:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:3.0:1775773079.965404:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:3.0:1775773079.965412:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773079.965418:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773079.965422:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773079.965429:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773079.965433:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:3.0:1775773079.965442:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:3.0:1775773079.965456:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.965463:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773079.965468:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.965472:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773079.965476:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.965488:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773079.965492:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-9, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773079.965500:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-9, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773079.965520:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-9,[0x240002729:0x35:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773079.965572:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.965581:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773079.965593:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773079.965600:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01efb80 x1862023612294272/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773079.965609:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773079.965630:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294272:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773079.965801:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.974566:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01efb80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294272:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773079.974594:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974625:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974634:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974644:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974655:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974667:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974675:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974682:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.974693:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01efb80 x1862023612294272/t30064771093(30064771093) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773079.974704:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01efb80 x1862023612294272/t30064771093(30064771093) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773079.974717:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773079.974763:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.974774:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/53 (0 0) 00000080:00200000:3.0:1775773079.974780:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773079.975068:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-9, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773079.975098:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x35:0x0](ffff8de1c407c2c8) 00000080:00200000:3.0:1775773079.975220:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x35:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773079.975231:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x35:0x0](ffff8de1c407c2c8) 00000080:00010000:3.0:1775773079.975235:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x35:0x0](ffff8de1c407c2c8) for lock 0x8a9f4e958445ea75 00000080:00010000:3.0:1775773079.975244:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x35:0x0](ffff8de1c407c2c8) 00000080:00200008:3.0:1775773079.975258:0:166110:0:(file.c:1057:ll_file_open()) START file f-9:[0x240002729:0x35:0x0](ffff8de1c407c2c8), flags 100102 00000002:00100000:3.0:1775773079.975278:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01efb80 x1862023612294272/t30064771093(30064771093) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773079.975315:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea75 from it ffff8de1c7cee480 00010000:00010000:3.0:1775773079.975319:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.975328:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773079.975349:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x35:0x0](ffff8de1c407c2c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773079.975379:0:166110:0:(file.c:447:ll_file_release()) START file f-9:[0x240002729:0x35:0x0](ffff8de1c407c2c8), flags 100002 00000002:00100000:3.0:1775773079.975426:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01efb80 x1862023612294272/t30064771093(30064771093) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773079.975436:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773079.975441:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ef100 x1862023612294528/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773079.975460:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294528:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773079.975583:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.978711:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294528:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773079.979121:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01efb80 x1862023612294272/t30064771093(30064771093) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773079.979197:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773079.979218:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773079.979236:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1775773079.979251:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:3.0:1775773079.979259:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773079.979264:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773079.979268:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773079.979274:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773079.979278:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1775773079.979286:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:3.0:1775773079.979300:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.979305:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773079.979311:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.979315:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773079.979318:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.979331:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773079.979336:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-10, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211080, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773079.979343:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-10, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773079.979365:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-10,[0x240002729:0x36:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773079.979416:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.979425:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773079.979437:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773079.979443:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ec380 x1862023612294784/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773079.979453:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773079.979474:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294784:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773079.979608:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.985639:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612294784:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773079.985670:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985703:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 4/0,1 mode: --/PR res: [0x240002729:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985712:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 4/0,1 mode: --/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985775:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985787:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985801:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985809:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985817:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773079.985828:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ec380 x1862023612294784/t30064771095(30064771095) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773079.985842:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ec380 x1862023612294784/t30064771095(30064771095) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773079.985855:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773079.985869:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.985879:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/54 (0 0) 00000080:00200000:3.0:1775773079.985886:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773079.985899:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-10, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773079.985925:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x36:0x0](ffff8de1c407ba88) 00000080:00200000:3.0:1775773079.986070:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x36:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773079.986081:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x36:0x0](ffff8de1c407ba88) 00000080:00010000:3.0:1775773079.986086:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x36:0x0](ffff8de1c407ba88) for lock 0x8a9f4e958445ea7c 00000080:00010000:3.0:1775773079.986096:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x36:0x0](ffff8de1c407ba88) 00000080:00200008:3.0:1775773079.986110:0:166110:0:(file.c:1057:ll_file_open()) START file f-10:[0x240002729:0x36:0x0](ffff8de1c407ba88), flags 100102 00000002:00100000:3.0:1775773079.986131:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ec380 x1862023612294784/t30064771095(30064771095) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773079.986171:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea7c from it ffff8de1c7cee480 00010000:00010000:3.0:1775773079.986175:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.986185:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773079.986206:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x36:0x0](ffff8de1c407ba88), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773079.986237:0:166110:0:(file.c:447:ll_file_release()) START file f-10:[0x240002729:0x36:0x0](ffff8de1c407ba88), flags 100002 00000002:00100000:3.0:1775773079.986281:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ec380 x1862023612294784/t30064771095(30064771095) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773079.986291:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773079.986295:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ed500 x1862023612295040/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773079.986317:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295040:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773079.986397:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1775773079.990969:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295040:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773079.991018:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ec380 x1862023612294784/t30064771095(30064771095) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773079.991092:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773079.991108:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773079.991126:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:3.0:1775773079.991139:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:3.0:1775773079.991146:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773079.991152:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773079.991155:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773079.991162:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773079.991166:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:3.0:1775773079.991174:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:3.0:1775773079.991188:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.991194:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773079.991200:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.991204:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773079.991208:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773079.991219:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773079.991223:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-11, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773079.991230:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-11, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773079.991248:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-11,[0x240002729:0x37:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773079.991295:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773079.991303:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773079.991313:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773079.991319:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ee300 x1862023612295296/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773079.991329:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773079.991348:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295296:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773079.991927:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.003014:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295296:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773080.003042:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003076:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003085:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003097:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003109:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003122:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003132:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003140:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.003151:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ee300 x1862023612295296/t30064771097(30064771097) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.003165:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ee300 x1862023612295296/t30064771097(30064771097) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.003178:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.003191:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003201:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/55 (0 0) 00000080:00200000:3.0:1775773080.003208:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.003221:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-11, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773080.003253:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x37:0x0](ffff8de1c407d348) 00000080:00200000:3.0:1775773080.003377:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x37:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773080.003388:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x37:0x0](ffff8de1c407d348) 00000080:00010000:3.0:1775773080.003391:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x37:0x0](ffff8de1c407d348) for lock 0x8a9f4e958445ea83 00000080:00010000:3.0:1775773080.003401:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x37:0x0](ffff8de1c407d348) 00000080:00200008:3.0:1775773080.003416:0:166110:0:(file.c:1057:ll_file_open()) START file f-11:[0x240002729:0x37:0x0](ffff8de1c407d348), flags 100102 00000002:00100000:3.0:1775773080.003438:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ee300 x1862023612295296/t30064771097(30064771097) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773080.003482:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea83 from it ffff8de1c7cee480 00010000:00010000:3.0:1775773080.003487:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.003496:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.003520:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x37:0x0](ffff8de1c407d348), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773080.003555:0:166110:0:(file.c:447:ll_file_release()) START file f-11:[0x240002729:0x37:0x0](ffff8de1c407d348), flags 100002 00000002:00100000:3.0:1775773080.003596:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ee300 x1862023612295296/t30064771097(30064771097) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.003607:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.003612:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ec700 x1862023612295552/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.003634:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295552:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773080.003718:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.012013:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295552:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773080.012051:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ee300 x1862023612295296/t30064771097(30064771097) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773095 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.012131:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.012148:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.012165:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:3.0:1775773080.012179:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:3.0:1775773080.012187:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.012192:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.012196:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.012202:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773080.012206:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:3.0:1775773080.012280:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:3.0:1775773080.012296:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.012304:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773080.012310:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.012313:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773080.012316:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.012328:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773080.012332:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-12, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211080, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773080.012340:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-12, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773080.012363:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-12,[0x240002729:0x38:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773080.012411:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.012419:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.012429:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.012434:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01eca80 x1862023612295808/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.012443:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.012461:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01eca80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295808:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773080.012586:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.018811:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01eca80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612295808:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773080.018840:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018870:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 4/0,1 mode: --/PR res: [0x240002729:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018879:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 4/0,1 mode: --/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018890:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018902:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018915:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018924:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.018931:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.018943:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01eca80 x1862023612295808/t30064771099(30064771099) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.018956:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01eca80 x1862023612295808/t30064771099(30064771099) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.018969:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.018990:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.019000:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/56 (0 0) 00000080:00200000:3.0:1775773080.019006:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.019019:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-12, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773080.019053:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x38:0x0](ffff8de1c4079988) 00000080:00200000:3.0:1775773080.019371:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x38:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773080.019384:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x38:0x0](ffff8de1c4079988) 00000080:00010000:3.0:1775773080.019387:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x38:0x0](ffff8de1c4079988) for lock 0x8a9f4e958445ea8a 00000080:00010000:3.0:1775773080.019396:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x38:0x0](ffff8de1c4079988) 00000080:00200008:3.0:1775773080.019410:0:166110:0:(file.c:1057:ll_file_open()) START file f-12:[0x240002729:0x38:0x0](ffff8de1c4079988), flags 100102 00000002:00100000:3.0:1775773080.019431:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01eca80 x1862023612295808/t30064771099(30064771099) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773080.019530:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea8a from it ffff8de1c7cee480 00010000:00010000:3.0:1775773080.019535:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.019544:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.019565:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x38:0x0](ffff8de1c4079988), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773080.019592:0:166110:0:(file.c:447:ll_file_release()) START file f-12:[0x240002729:0x38:0x0](ffff8de1c4079988), flags 100002 00000002:00100000:3.0:1775773080.019632:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01eca80 x1862023612295808/t30064771099(30064771099) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.019641:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.019645:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01edf80 x1862023612296064/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.019665:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296064:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773080.019800:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.025521:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01edf80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296064:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773080.025555:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01eca80 x1862023612295808/t30064771099(30064771099) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.025632:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.025653:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.025673:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:3.0:1775773080.025690:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:3.0:1775773080.025698:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.025705:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.025708:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.025716:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773080.025720:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:3.0:1775773080.025769:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:3.0:1775773080.025785:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.025793:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773080.025799:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.025803:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773080.025807:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.025823:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773080.025828:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-13, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773080.025837:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-13, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773080.025858:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-13,[0x240002729:0x39:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773080.025908:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.025915:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.025925:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.025931:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ece00 x1862023612296320/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.025941:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.025961:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296320:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773080.026093:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.038044:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ece00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296320:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773080.038072:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038102:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038111:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038122:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038133:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038146:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038155:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038163:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.038174:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ece00 x1862023612296320/t30064771101(30064771101) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.038187:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ece00 x1862023612296320/t30064771101(30064771101) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.038201:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.038214:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038224:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/57 (0 0) 00000080:00200000:3.0:1775773080.038231:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.038244:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-13, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773080.038269:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x39:0x0](ffff8de1c4078908) 00000080:00200000:3.0:1775773080.038383:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x39:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773080.038394:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x39:0x0](ffff8de1c4078908) 00000080:00010000:3.0:1775773080.038397:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x39:0x0](ffff8de1c4078908) for lock 0x8a9f4e958445ea91 00000080:00010000:3.0:1775773080.038406:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x39:0x0](ffff8de1c4078908) 00000080:00200008:3.0:1775773080.038420:0:166110:0:(file.c:1057:ll_file_open()) START file f-13:[0x240002729:0x39:0x0](ffff8de1c4078908), flags 100102 00000002:00100000:3.0:1775773080.038441:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ece00 x1862023612296320/t30064771101(30064771101) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773080.038498:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea91 from it ffff8de1c7cee480 00010000:00010000:3.0:1775773080.038502:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.038512:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.038530:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x39:0x0](ffff8de1c4078908), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773080.038560:0:166110:0:(file.c:447:ll_file_release()) START file f-13:[0x240002729:0x39:0x0](ffff8de1c4078908), flags 100002 00000002:00100000:3.0:1775773080.038601:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ece00 x1862023612296320/t30064771101(30064771101) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.038611:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.038615:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ef800 x1862023612296576/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.038635:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296576:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773080.038704:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.047124:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ef800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296576:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773080.047160:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ece00 x1862023612296320/t30064771101(30064771101) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.047231:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.047248:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.047265:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:3.0:1775773080.047279:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:3.0:1775773080.047287:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.047292:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.047296:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.047303:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773080.047307:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:3.0:1775773080.047317:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:3.0:1775773080.047332:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.047338:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773080.047344:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.047348:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773080.047352:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.047365:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773080.047370:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-14, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211080, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773080.047379:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-14, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773080.047399:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-14,[0x240002729:0x3a:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773080.047449:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.047458:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.047483:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.047488:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ec000 x1862023612296832/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.047498:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.047520:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296832:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773080.047644:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.062076:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ec000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612296832:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773080.062105:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062137:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062145:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062156:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062167:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062179:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062187:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062194:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.062204:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d01ec000 x1862023612296832/t30064771103(30064771103) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.062216:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ec000 x1862023612296832/t30064771103(30064771103) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.062230:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.062244:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062254:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/58 (0 0) 00000080:00200000:3.0:1775773080.062260:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.062274:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-14, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773080.062307:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3a:0x0](ffff8de1c407e3c8) 00000080:00200000:3.0:1775773080.062420:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773080.062431:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3a:0x0](ffff8de1c407e3c8) 00000080:00010000:3.0:1775773080.062435:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3a:0x0](ffff8de1c407e3c8) for lock 0x8a9f4e958445ea98 00000080:00010000:3.0:1775773080.062443:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3a:0x0](ffff8de1c407e3c8) 00000080:00200008:3.0:1775773080.062457:0:166110:0:(file.c:1057:ll_file_open()) START file f-14:[0x240002729:0x3a:0x0](ffff8de1c407e3c8), flags 100102 00000002:00100000:3.0:1775773080.062492:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d01ec000 x1862023612296832/t30064771103(30064771103) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773080.062531:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea98 from it ffff8de1c7cee480 00010000:00010000:3.0:1775773080.062536:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.062544:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.062564:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3a:0x0](ffff8de1c407e3c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773080.062592:0:166110:0:(file.c:447:ll_file_release()) START file f-14:[0x240002729:0x3a:0x0](ffff8de1c407e3c8), flags 100002 00000002:00100000:3.0:1775773080.062631:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d01ec000 x1862023612296832/t30064771103(30064771103) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.062640:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.062645:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ee680 x1862023612297088/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.062664:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297088:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773080.067200:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.076153:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ee680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297088:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773080.076191:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d01ec000 x1862023612296832/t30064771103(30064771103) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773080.076266:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773080.076284:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.076302:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:2.0:1775773080.076316:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:2.0:1775773080.076324:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773080.076330:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773080.076333:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773080.076339:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:2.0:1775773080.076343:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:2.0:1775773080.076351:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:2.0:1775773080.076367:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.076374:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:2.0:1775773080.076380:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.076383:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773080.076386:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.076399:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.076403:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-15, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c8675980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773080.076411:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-15, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:2.0:1775773080.076433:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-15,[0x240002729:0x3b:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773080.076503:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.076511:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773080.076523:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773080.076531:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98380 x1862023612297344/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773080.076539:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773080.076558:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297344:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773080.076680:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.082227:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297344:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773080.082253:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082282:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082289:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082300:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082310:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082323:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082331:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082337:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.082349:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f98380 x1862023612297344/t30064771105(30064771105) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.082361:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98380 x1862023612297344/t30064771105(30064771105) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.082374:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.082388:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082398:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/59 (0 0) 00000080:00200000:3.0:1775773080.082407:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.082421:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-15, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773080.082455:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3b:0x0](ffff8de1c407db88) 00000080:00200000:3.0:1775773080.082609:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773080.082622:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3b:0x0](ffff8de1c407db88) 00000080:00010000:3.0:1775773080.082625:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3b:0x0](ffff8de1c407db88) for lock 0x8a9f4e958445ea9f 00000080:00010000:3.0:1775773080.082637:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3b:0x0](ffff8de1c407db88) 00000080:00200008:3.0:1775773080.082652:0:166110:0:(file.c:1057:ll_file_open()) START file f-15:[0x240002729:0x3b:0x0](ffff8de1c407db88), flags 100102 00000002:00100000:3.0:1775773080.082673:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98380 x1862023612297344/t30064771105(30064771105) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773080.082720:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea9f from it ffff8de1d2129120 00010000:00010000:3.0:1775773080.082760:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.082770:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.082793:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3b:0x0](ffff8de1c407db88), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773080.082837:0:166110:0:(file.c:447:ll_file_release()) START file f-15:[0x240002729:0x3b:0x0](ffff8de1c407db88), flags 100002 00000002:00100000:3.0:1775773080.082883:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f98380 x1862023612297344/t30064771105(30064771105) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.082901:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.082906:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d01ed180 x1862023612297600/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.082932:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d01ed180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297600:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773080.083018:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.087098:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d01ed180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297600:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773080.087134:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f98380 x1862023612297344/t30064771105(30064771105) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.087212:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.087229:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.087246:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:3.0:1775773080.087259:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:3.0:1775773080.087266:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.087272:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.087274:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.087281:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773080.087285:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:3.0:1775773080.087293:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:3.0:1775773080.087308:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.087314:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773080.087321:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.087325:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773080.087327:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.087344:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773080.087349:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-16, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6211800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773080.087357:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-16, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773080.087379:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-16,[0x240002729:0x3c:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773080.087433:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.087441:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.087451:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.087457:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76300 x1862023612297856/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.087466:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.087485:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297856:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773080.087635:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.096093:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612297856:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773080.096118:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096149:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096158:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096170:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096180:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096193:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096201:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096208:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.096217:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e76300 x1862023612297856/t30064771107(30064771107) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.096229:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76300 x1862023612297856/t30064771107(30064771107) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.096242:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.096254:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096264:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/60 (0 0) 00000080:00200000:3.0:1775773080.096271:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.096284:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-16, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:3.0:1775773080.096312:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3c:0x0](ffff8de1c40780c8) 00000080:00200000:3.0:1775773080.096428:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773080.096437:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3c:0x0](ffff8de1c40780c8) 00000080:00010000:3.0:1775773080.096440:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3c:0x0](ffff8de1c40780c8) for lock 0x8a9f4e958445eaa6 00000080:00010000:3.0:1775773080.096449:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3c:0x0](ffff8de1c40780c8) 00000080:00200008:3.0:1775773080.096463:0:166110:0:(file.c:1057:ll_file_open()) START file f-16:[0x240002729:0x3c:0x0](ffff8de1c40780c8), flags 100102 00000002:00100000:3.0:1775773080.096481:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76300 x1862023612297856/t30064771107(30064771107) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773080.096523:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eaa6 from it ffff8de1c7cee480 00010000:00010000:3.0:1775773080.096529:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.096538:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.096559:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3c:0x0](ffff8de1c40780c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773080.096589:0:166110:0:(file.c:447:ll_file_release()) START file f-16:[0x240002729:0x3c:0x0](ffff8de1c40780c8), flags 100002 00000002:00100000:3.0:1775773080.096629:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e76300 x1862023612297856/t30064771107(30064771107) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.096645:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.096649:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77b80 x1862023612298112/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.096670:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298112:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773080.096793:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.105480:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298112:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773080.105530:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e76300 x1862023612297856/t30064771107(30064771107) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.105610:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.105630:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.105650:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:3.0:1775773080.105665:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:3.0:1775773080.105673:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.105679:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.105683:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.105689:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:3.0:1775773080.105693:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:3.0:1775773080.105702:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:3.0:1775773080.105714:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.105719:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773080.105767:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.105772:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773080.105775:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.105797:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773080.105809:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-17, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c6210000, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773080.105818:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-17, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:3.0:1775773080.105840:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-17,[0x240002729:0x3d:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773080.105986:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.106002:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773080.106013:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773080.106020:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75180 x1862023612298368/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773080.106030:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773080.106051:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298368:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773080.106178:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.113113:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298368:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773080.113137:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113165:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113172:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113181:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113190:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113206:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113212:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113218:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773080.113228:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e75180 x1862023612298368/t30064771109(30064771109) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773080.113240:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75180 x1862023612298368/t30064771109(30064771109) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773080.113251:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773080.113263:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113272:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/61 (0 0) 00000080:00200000:0.0:1775773080.113279:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773080.113291:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-17, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:0.0:1775773080.113320:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3d:0x0](ffff8de1c4073248) 00000080:00200000:0.0:1775773080.113436:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773080.113445:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3d:0x0](ffff8de1c4073248) 00000080:00010000:0.0:1775773080.113448:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3d:0x0](ffff8de1c4073248) for lock 0x8a9f4e958445eaad 00000080:00010000:0.0:1775773080.113456:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3d:0x0](ffff8de1c4073248) 00000080:00200008:0.0:1775773080.113478:0:166110:0:(file.c:1057:ll_file_open()) START file f-17:[0x240002729:0x3d:0x0](ffff8de1c4073248), flags 100102 00000002:00100000:0.0:1775773080.113499:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75180 x1862023612298368/t30064771109(30064771109) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773080.113543:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eaad from it ffff8de1c9687f00 00010000:00010000:0.0:1775773080.113547:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.113556:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.113578:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3d:0x0](ffff8de1c4073248), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773080.113607:0:166110:0:(file.c:447:ll_file_release()) START file f-17:[0x240002729:0x3d:0x0](ffff8de1c4073248), flags 100002 00000002:00100000:0.0:1775773080.113646:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e75180 x1862023612298368/t30064771109(30064771109) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773080.113656:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773080.113661:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d4a80 x1862023612298624/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773080.113681:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298624:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773080.113799:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1540 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.119119:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298624:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773080.119152:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75180 x1862023612298368/t30064771109(30064771109) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773080.119220:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773080.119238:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773080.119256:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:0.0:1775773080.119271:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:0.0:1775773080.119280:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773080.119285:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773080.119289:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:0.0:1775773080.119295:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:0.0:1775773080.119299:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:0.0:1775773080.119308:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:0.0:1775773080.119324:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.119330:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:0.0:1775773080.119336:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.119340:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773080.119344:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.119356:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.119360:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-18, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c2d20300, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773080.119368:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-18, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:0.0:1775773080.119386:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-18,[0x240002729:0x3e:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773080.119434:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.119447:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773080.119458:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773080.119480:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6a00 x1862023612298880/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773080.119489:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773080.119508:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298880:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773080.119632:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1540 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.126181:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612298880:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773080.126211:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126245:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126252:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126262:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126271:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126287:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126294:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126300:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773080.126310:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c67d6a00 x1862023612298880/t30064771111(30064771111) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773080.126321:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c67d6a00 x1862023612298880/t30064771111(30064771111) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773080.126333:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773080.126345:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126355:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/62 (0 0) 00000080:00200000:0.0:1775773080.126361:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773080.126374:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-18, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:0.0:1775773080.126401:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3e:0x0](ffff8de1c40742c8) 00000080:00200000:0.0:1775773080.126547:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773080.126559:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3e:0x0](ffff8de1c40742c8) 00000080:00010000:0.0:1775773080.126563:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3e:0x0](ffff8de1c40742c8) for lock 0x8a9f4e958445eab4 00000080:00010000:0.0:1775773080.126573:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3e:0x0](ffff8de1c40742c8) 00000080:00200008:0.0:1775773080.126586:0:166110:0:(file.c:1057:ll_file_open()) START file f-18:[0x240002729:0x3e:0x0](ffff8de1c40742c8), flags 100102 00000002:00100000:0.0:1775773080.126607:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c67d6a00 x1862023612298880/t30064771111(30064771111) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773080.126648:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eab4 from it ffff8de1d2190a20 00010000:00010000:0.0:1775773080.126652:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.126661:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.126681:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3e:0x0](ffff8de1c40742c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773080.128307:0:166110:0:(file.c:447:ll_file_release()) START file f-18:[0x240002729:0x3e:0x0](ffff8de1c40742c8), flags 100002 00000002:00100000:0.0:1775773080.128377:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c67d6a00 x1862023612298880/t30064771111(30064771111) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773080.128389:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773080.128395:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d7800 x1862023612299136/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773080.128419:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612299136:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773080.128505:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.141288:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612299136:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775773080.141381:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c67d6a00 x1862023612298880/t30064771111(30064771111) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773080.141453:0:166110:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773080.141481:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773080.141500:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:1.0:1775773080.141514:0:166110:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:1.0:1775773080.141522:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773080.141529:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773080.141532:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:1.0:1775773080.141538:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c16f3bf8 00010000:00010000:1.0:1775773080.141542:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:1.0:1775773080.141549:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:1.0:1775773080.141563:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773080.141570:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:1.0:1775773080.141576:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:1.0:1775773080.141580:0:166110:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775773080.141583:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773080.141593:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773080.141598:0:166110:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-19, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), file ffff8de1c2a95980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775773080.141606:0:166110:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-19, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000002:00010000:1.0:1775773080.141626:0:166110:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-19,[0x240002729:0x3f:0x0]) in obj [0x240002729:0x2b:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775773080.141677:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773080.141686:0:166110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773080.141696:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773080.141713:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30700 x1862023612299392/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773080.141755:0:166110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773080.141777:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612299392:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775773080.141915:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7bafc00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.154981:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612299392:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773080.155008:0:166110:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 4/0,1 mode: --/CW res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155045:0:166110:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155054:0:166110:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 4/0,1 mode: --/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155065:0:166110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155075:0:166110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155088:0:166110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155095:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155102:0:166110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773080.155113:0:166110:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0a30700 x1862023612299392/t30064771113(30064771113) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773080.155126:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a30700 x1862023612299392/t30064771113(30064771113) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773080.155138:0:166110:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773080.155151:0:166110:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155160:0:166110:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/63 (0 0) 00000080:00200000:2.0:1775773080.155166:0:166110:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x2b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773080.155178:0:166110:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-19, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8), intent=open|creat 00000080:00200000:2.0:1775773080.155206:0:166110:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x3f:0x0](ffff8de1c4083248) 00000080:00200000:2.0:1775773080.155322:0:166110:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x3f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773080.155332:0:166110:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x3f:0x0](ffff8de1c4083248) 00000080:00010000:2.0:1775773080.155336:0:166110:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x3f:0x0](ffff8de1c4083248) for lock 0x8a9f4e958445eabb 00000080:00010000:2.0:1775773080.155345:0:166110:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x3f:0x0](ffff8de1c4083248) 00000080:00200008:2.0:1775773080.155359:0:166110:0:(file.c:1057:ll_file_open()) START file f-19:[0x240002729:0x3f:0x0](ffff8de1c4083248), flags 100102 00000002:00100000:2.0:1775773080.155379:0:166110:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a30700 x1862023612299392/t30064771113(30064771113) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773080.155421:0:166110:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eabb from it ffff8de1c670f4e0 00010000:00010000:2.0:1775773080.155425:0:166110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.155434:0:166110:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.155459:0:166110:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x3f:0x0](ffff8de1c4083248), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773080.155501:0:166110:0:(file.c:447:ll_file_release()) START file f-19:[0x240002729:0x3f:0x0](ffff8de1c4083248), flags 100002 00000002:00100000:2.0:1775773080.155540:0:166110:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a30700 x1862023612299392/t30064771113(30064771113) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773080.155556:0:166110:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773080.155560:0:166110:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b800 x1862023612299648/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773080.155581:0:166110:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612299648:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773080.155651:0:166110:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.158569:0:166110:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166110:1862023612299648:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773080.158601:0:166110:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a30700 x1862023612299392/t30064771113(30064771113) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.171673:0:166116:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.171703:0:166116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.171760:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:3.0:1775773080.171776:0:166116:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:3.0:1775773080.171785:0:166116:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.171794:0:166116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.171797:0:166116:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.171804:0:166116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c180fbf8 00010000:00010000:3.0:1775773080.171808:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:3.0:1775773080.171815:0:166116:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:3.0:1775773080.171835:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.171842:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=27 00000080:00200000:3.0:1775773080.171848:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.171852:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=27 00000080:00200000:3.0:1775773080.171855:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.171857:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=267 00000080:00200000:3.0:1775773080.171884:0:166116:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.171891:0:166116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.171898:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:3.0:1775773080.171906:0:166116:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:3.0:1775773080.171912:0:166116:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.171916:0:166116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.171918:0:166116:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.171922:0:166116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c180fbf8 00010000:00010000:3.0:1775773080.171925:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:3.0:1775773080.171933:0:166116:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:3.0:1775773080.171941:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.171945:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=27 00000080:00200000:3.0:1775773080.171948:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.171952:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=267 00000080:00200000:3.0:1775773080.171955:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 44 00000080:00200008:3.0:1775773080.171960:0:166116:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 304000 00000002:00010000:3.0:1775773080.171985:0:166116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2b:0x0]) in obj [0x200027cd1:0x7:0x0], intent: open flags 0100240304001 00010000:00010000:3.0:1775773080.172037:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.172045:0:166116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.172057:0:166116:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.172068:0:166116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612299904/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.172078:0:166116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.172098:0:166116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612299904:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773080.172269:0:166116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.181113:0:166116:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612299904:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773080.181136:0:166116:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181149:0:166116:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181156:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181162:0:166116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181172:0:166116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181178:0:166116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773080.181182:0:166116:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181189:0:166116:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181196:0:166116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181202:0:166116:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773080.181208:0:166116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181214:0:166116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445eac2 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.181239:0:166116:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0e76d80 x1862023612299904/t30064771115(30064771115) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.181252:0:166116:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76d80 x1862023612299904/t30064771115(30064771115) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.181268:0:166116:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0x7:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773080.181297:0:166116:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x2b:0x0], updating i_size 4096 00000002:00100000:3.0:1775773080.181326:0:166116:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76d80 x1862023612299904/t30064771115(30064771115) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.181433:0:166116:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.181450:0:166116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.181464:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:3.0:1775773080.181476:0:166116:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:3.0:1775773080.181483:0:166116:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.181488:0:166116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.181492:0:166116:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.181497:0:166116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c180fbf8 00010000:00010000:3.0:1775773080.181500:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:3.0:1775773080.181506:0:166116:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200000:3.0:1775773080.181534:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.181541:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=25 00000080:00200000:3.0:1775773080.181547:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.181550:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773080.181553:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.181556:0:166116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=265 00000080:00200000:3.0:1775773080.181561:0:166116:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2d:0x0](ffff8de1c4084b08), inode mode 81a4 mask 44 00000080:00200008:3.0:1775773080.181567:0:166116:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x2d:0x0](ffff8de1c4084b08), flags 100400 00000002:00010000:3.0:1775773080.181582:0:166116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2d:0x0]) in obj [0x240002729:0x2b:0x0], intent: open flags 0240100401 00010000:00010000:3.0:1775773080.181627:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.181635:0:166116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.181646:0:166116:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.181652:0:166116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77800 x1862023612300160/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.181660:0:166116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.181680:0:166116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612300160:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773080.182230:0:166116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.186404:0:166116:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612300160:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773080.186431:0:166116:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186455:0:166116:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186464:0:166116:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186475:0:166116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186485:0:166116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186499:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186507:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186525:0:166116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.186536:0:166116:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0e77800 x1862023612300160/t30064771116(30064771116) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.186550:0:166116:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e77800 x1862023612300160/t30064771116(30064771116) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.186563:0:166116:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773080.186577:0:166116:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186590:0:166116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.186602:0:166116:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.186611:0:166116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186617:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186623:0:166116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.186648:0:166116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:3.0:1775773080.186656:0:166116:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x240002729:0x2b:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773080.186810:0:166116:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x2d:0x0]: layout version change: 0 -> 0 00000080:00010000:3.0:1775773080.186823:0:166116:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2d:0x0](ffff8de1c4084b08) for lock 0x8a9f4e958445ea3d 00000080:00010000:3.0:1775773080.186831:0:166116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea3d from it ffff9ba1c180fbf0 00010000:00010000:3.0:1775773080.186834:0:166116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.186842:0:166116:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:3.0:1775773080.186871:0:166116:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e77800 x1862023612300160/t30064771116(30064771116) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:3.0:1775773080.186948:0:166116:0:(file.c:4602:ll_file_ioctl()) VFS Op:inode=[0x240002729:0x2d:0x0](ffff8de1c4084b08) cmd=800466af arg=7ffeaee7a76c 00000080:00200008:3.0:1775773080.186982:0:166116:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x2d:0x0](ffff8de1c4084b08), flags 100000 00000002:00100000:3.0:1775773080.187022:0:166116:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e77800 x1862023612300160/t30064771116(30064771116) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.187033:0:166116:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.187038:0:166116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76a00 x1862023612300416/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.187060:0:166116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612300416:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775773080.187124:0:166116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd780 going to sleep for 11 seconds 00010000:00010000:2.0:1775773080.187365:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773080.187372:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187381:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3385600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773080.187386:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187395:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187404:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187421:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773080.187453:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 2/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187460:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.187489:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187496:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445eac9 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa740 expref: -99 pid: 166116 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.187508:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773080.187519:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773080.187521:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773080.187529:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775773080.187541:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612300544:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773080.191133:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612300544:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773080.196029:0:166116:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612300416:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773080.196070:0:166116:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e77800 x1862023612300160/t30064771116(30064771116) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1775773080.196240:0:166116:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 304000 00000002:00100000:3.0:1775773080.196298:0:166116:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e76d80 x1862023612299904/t30064771115(30064771115) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.196308:0:166116:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.196325:0:166116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76a00 x1862023612300800/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.196346:0:166116:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612300800:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775773080.196427:0:166116:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd780 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.199101:0:166116:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166116:1862023612300800:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773080.199133:0:166116:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e76d80 x1862023612299904/t30064771115(30064771115) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.206077:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.206106:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.206124:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:3.0:1775773080.206141:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200000:3.0:1775773080.206154:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.206161:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.206165:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.206172:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bb58 00010000:00010000:3.0:1775773080.206175:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:3.0:1775773080.206184:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:3.0:1775773080.206199:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.206206:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=8 00000080:00200008:3.0:1775773080.206215:0:166117:0:(file.c:6226:ll_getattr_dentry()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775773080.206220:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88),name=d80c.replay-single 00000002:00010000:3.0:1775773080.206230:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.206238:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.206246:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.206252:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.206256:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00000080:00010000:3.0:1775773080.206258:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445ea21 00000080:00010000:3.0:1775773080.206262:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea21 from it ffff9ba1c1c7bcb8 00010000:00010000:3.0:1775773080.206264:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.206271:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773080.206294:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.206300:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.206305:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:3.0:1775773080.206392:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:3.0:1775773080.206398:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.206402:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.206404:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.206407:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bbf8 00010000:00010000:3.0:1775773080.206409:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:3.0:1775773080.206416:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00000080:00200000:3.0:1775773080.206423:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773080.206427:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=266 00000080:00200000:3.0:1775773080.206430:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 44 00000080:00200008:3.0:1775773080.206436:0:166117:0:(file.c:1057:ll_file_open()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags 704400 00000002:00010000:3.0:1775773080.206449:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:3.0:1775773080.206497:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.206504:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773080.206515:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773080.206526:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76a00 x1862023612301056/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773080.206535:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773080.206557:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301056:192.168.201.137@tcp:101:rm.0 00000100:00100000:3.0:1775773080.206716:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.213295:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301056:192.168.201.137@tcp:101:rm.0 00010000:00010000:3.0:1775773080.213319:0:166117:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213332:0:166117:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213339:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213346:0:166117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213355:0:166117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213364:0:166117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773080.213369:0:166117:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213375:0:166117:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213383:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213390:0:166117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773080.213409:0:166117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.213416:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384800/0x8a9f4e958445ead0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.213435:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0e76a00 x1862023612301056/t356482285572(356482285572) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773080.213447:0:166117:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76a00 x1862023612301056/t356482285572(356482285572) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773080.213462:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773080.213488:0:166117:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x7:0x0], updating i_size 4096 00000002:00100000:3.0:1775773080.213506:0:166117:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76a00 x1862023612301056/t356482285572(356482285572) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1775773080.213586:0:166117:0:(file.c:6226:ll_getattr_dentry()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775773080.213593:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88),name=d80c.replay-single 00000002:00010000:3.0:1775773080.213613:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.213627:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773080.213638:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773080.213645:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.213651:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00000080:00010000:3.0:1775773080.213654:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445ea21 00000080:00010000:3.0:1775773080.213659:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea21 from it ffff9ba1c1c7bcd8 00010000:00010000:3.0:1775773080.213662:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773080.213671:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773080.213925:0:166117:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) pos/size0/4096 32bit_api 0 00000002:00010000:3.0:1775773080.213938:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200027cd1:0x7:0x0], intent: readdir flags 0 00010000:00010000:3.0:1775773080.213946:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773080.213955:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1775773080.215086:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301184:192.168.201.137@tcp:37:rm.0 00000100:00100000:3.0:1775773080.215180:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.223540:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301184:192.168.201.137@tcp:37:rm.0 00010000:00010000:3.0:1775773080.224269:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773080.224286:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:2.0:1775773080.224517:0:166117:0:(file.c:447:ll_file_release()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags 704000 00000002:00100000:2.0:1775773080.224591:0:166117:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e76a00 x1862023612301056/t356482285572(356482285572) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773080.224603:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773080.224608:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99180 x1862023612301440/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773080.224632:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301440:192.168.201.137@tcp:35:rm.0 00000100:00100000:2.0:1775773080.224712:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.228399:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301440:192.168.201.137@tcp:35:rm.0 00000002:00100000:2.0:1775773080.228435:0:166117:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e76a00 x1862023612301056/t356482285572(356482285572) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773080.228667:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773080.228687:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.228715:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00010000:00010000:2.0:1775773080.228777:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00000080:00200000:2.0:1775773080.228787:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773080.228793:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773080.228797:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773080.228806:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bbf8 00010000:00010000:2.0:1775773080.228810:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00010000:00010000:2.0:1775773080.228819:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00000080:00200000:2.0:1775773080.228834:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.228842:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80c.replay-single, flags=266 00000080:00200000:2.0:1775773080.228851:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 44 00000080:00200008:2.0:1775773080.228859:0:166117:0:(file.c:1057:ll_file_open()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags 704400 00000002:00010000:2.0:1775773080.228875:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1775773080.228918:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.228927:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773080.228937:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773080.228944:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99180 x1862023612301696/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773080.228953:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773080.228985:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301696:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773080.229147:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.233428:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301696:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773080.233474:0:166117:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.233486:0:166117:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.233498:0:166117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.233509:0:166117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773080.233524:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8de1d0f99180 x1862023612301696/t356482285574(356482285574) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773080.233542:0:166117:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99180 x1862023612301696/t356482285574(356482285574) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773080.233556:0:166117:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.233566:0:166117:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 16 res 8590097617/7 (0 0) 00000080:00200000:2.0:1775773080.233572:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773080.233598:0:166117:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x7:0x0], updating i_size 4096 00000080:00010000:2.0:1775773080.233606:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445ead7 00000080:00010000:2.0:1775773080.233613:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ead7 from it ffff9ba1c1c7bbd0 00010000:00010000:2.0:1775773080.233617:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.233626:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1775773080.233649:0:166117:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99180 x1862023612301696/t356482285574(356482285574) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773080.233756:0:166117:0:(file.c:6226:ll_getattr_dentry()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773080.233763:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88),name=d80c.replay-single 00000002:00010000:2.0:1775773080.233783:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.233793:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773080.233803:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773080.233811:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773080.233815:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00000080:00010000:2.0:1775773080.233819:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445ea21 00000080:00010000:2.0:1775773080.233823:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea21 from it ffff9ba1c1c7bcd8 00010000:00010000:2.0:1775773080.233826:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773080.233833:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773080.233903:0:166117:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1775773080.233927:0:166117:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1775773080.233946:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.233952:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=0 00000080:00200008:2.0:1775773080.233959:0:166117:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773080.236813:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8),name=remote_dir 00000002:00010000:2.0:1775773080.236844:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2b:0x0]) in obj [0x200027cd1:0x7:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.236903:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.236913:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.236924:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773080.236948:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301824:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773080.237052:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.240875:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612301824:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773080.240901:0:166117:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.240934:0:166117:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.240943:0:166117:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.240955:0:166117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.240967:0:166117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.240992:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.241000:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.241006:0:166117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773080.241016:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f9bb80 x1862023612301824/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773080.241031:0:166117:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.241042:0:166117:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/43 (0 0) 00000080:00200000:2.0:1775773080.241048:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x7:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773080.241077:0:166117:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x2b:0x0], updating i_size 4096 00000080:00010000:2.0:1775773080.241085:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for lock 0x8a9f4e958445eade 00000080:00010000:2.0:1775773080.241092:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00010000:2.0:1775773080.241096:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eade from it ffff9ba1c1c7bcb8 00010000:00010000:2.0:1775773080.241099:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.241109:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.241173:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.241182:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=258 00000080:00200000:2.0:1775773080.241207:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 44 00000080:00200008:2.0:1775773080.241215:0:166117:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 704400 00000002:00010000:2.0:1775773080.241238:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2b:0x0]) in obj [0x200027cd1:0x7:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1775773080.241281:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.241288:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773080.241298:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773080.241304:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9bb80 x1862023612302080/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773080.241314:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773080.241335:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302080:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773080.241512:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.247539:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302080:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773080.247584:0:166117:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.247595:0:166117:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.247607:0:166117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 4/1,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.247617:0:166117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 4/1,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773080.247633:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8de1d0f9bb80 x1862023612302080/t30064771119(30064771119) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773080.247645:0:166117:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9bb80 x1862023612302080/t30064771119(30064771119) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773080.247660:0:166117:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.247671:0:166117:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 16 res 9663686441/43 (0 0) 00000080:00200000:2.0:1775773080.247679:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0x7:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773080.247706:0:166117:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x2b:0x0], updating i_size 4096 00000080:00010000:2.0:1775773080.247712:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for lock 0x8a9f4e958445eae5 00000080:00010000:2.0:1775773080.247720:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eae5 from it ffff9ba1c1c7bbd0 00010000:00010000:2.0:1775773080.247769:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.247779:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1775773080.247821:0:166117:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9bb80 x1862023612302080/t30064771119(30064771119) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773080.247890:0:166117:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773080.247897:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8),name=remote_dir 00000002:00010000:2.0:1775773080.247920:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2b:0x0]) in obj [0x200027cd1:0x7:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.247932:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.247944:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.247951:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x7:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773080.247956:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00010000:2.0:1775773080.247958:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for lock 0x8a9f4e958445eade 00000080:00010000:2.0:1775773080.247963:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eade from it ffff9ba1c1c7bcd8 00010000:00010000:2.0:1775773080.247965:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.247987:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773080.248013:0:166117:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1775773080.248027:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2b:0x0]) in obj [0x240002729:0x2b:0x0], intent: readdir flags 0 00010000:00010000:2.0:1775773080.248033:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773080.248042:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1775773080.248653:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302208:192.168.201.137@tcp:37:rm.0 00000100:00100000:2.0:1775773080.248763:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.258096:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302208:192.168.201.137@tcp:37:rm.0 00010000:00010000:2.0:1775773080.258865:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773080.258882:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1775773080.258945:0:166117:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 704000 00010000:00010000:2.0:1775773080.258983:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773080.259029:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.259038:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=258 00000080:00200000:2.0:1775773080.259050:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 44 00000080:00200008:2.0:1775773080.259057:0:166117:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 704400 00000080:00200008:2.0:1775773080.259075:0:166117:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773080.259080:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8),name=remote_dir 00000002:00010000:2.0:1775773080.259098:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x2b:0x0]) in obj [0x200027cd1:0x7:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.259108:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773080.259116:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773080.259122:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x7:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773080.259126:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00010000:2.0:1775773080.259129:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for lock 0x8a9f4e958445eade 00000080:00010000:2.0:1775773080.259135:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eade from it ffff9ba1c1c7bcd8 00010000:00010000:2.0:1775773080.259137:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773080.259143:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773080.259169:0:166117:0:(llite_lib.c:2726:ll_statfs()) VFS Op:sb=lustre (ffff8de1e006a000) remote_dir proj=0 00000080:00000004:2.0:1775773080.259173:0:166117:0:(obd_class.h:1092:obd_statfs()) lustre-clilmv-ffff8de1e006a000: age 8936, max_age 9056 00800000:00000004:2.0:1775773080.259184:0:166117:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9056, max_age 9056 00800000:00000004:2.0:1775773080.259187:0:166117:0:(obd_class.h:1132:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: use ffff8de1c5511e10 cache blocks 317240/353529 objects 1023641/1024000 00800000:00000004:2.0:1775773080.259190:0:166117:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9056, max_age 9056 00800000:00000004:2.0:1775773080.259191:0:166117:0:(obd_class.h:1132:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: use ffff8de1c5515190 cache blocks 317331/353529 objects 1023719/1024000 00000080:00000004:2.0:1775773080.259196:0:166117:0:(obd_class.h:1118:obd_statfs()) lustre-clilmv-ffff8de1e006a000: update ffff8de1c55137d0 cache blocks 634571/707058 objects 2047360/2048000 00000080:00000004:2.0:1775773080.259199:0:166117:0:(llite_lib.c:2589:ll_statfs_internal()) MDC blocks 634571/707058 objects 2047360/2048000 00000080:00000004:2.0:1775773080.259202:0:166117:0:(obd_class.h:1092:obd_statfs()) lustre-clilov-ffff8de1e006a000: age 8936, max_age 9056 00020000:00000004:2.0:1775773080.259217:0:166117:0:(obd_class.h:1058:obd_statfs_async()) lustre-OST0000-osc-ffff8de1e006a000: age 9056, max_age 9056 00000008:00000004:2.0:1775773080.259220:0:166117:0:(osc_request.c:3416:osc_statfs_async()) lustre-OST0000-osc-ffff8de1e006a000: use ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00020000:00000004:2.0:1775773080.259225:0:166117:0:(obd_class.h:1058:obd_statfs_async()) lustre-OST0001-osc-ffff8de1e006a000: age 9056, max_age 9056 00000008:00000004:2.0:1775773080.259227:0:166117:0:(osc_request.c:3416:osc_statfs_async()) lustre-OST0001-osc-ffff8de1e006a000: use ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00000004:2.0:1775773080.259236:0:166117:0:(obd_class.h:1118:obd_statfs()) lustre-clilov-ffff8de1e006a000: update ffff8de1c5510450 cache blocks 1802716/1916558 objects 523439/524288 00000080:00000004:2.0:1775773080.259238:0:166117:0:(llite_lib.c:2600:ll_statfs_internal()) OSC blocks 1802716/1916558 objects 523439/524288 00000080:00200000:2.0:1775773080.259253:0:166117:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1775773080.259324:0:166117:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1775773080.259339:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.259345:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-12, flags=0 00000080:00200000:2.0:1775773080.259351:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.259355:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-12, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.259438:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773080.259520:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.259544:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x38:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.259590:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 1/0,0 mode: --/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.259598:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773080.259604:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775773080.259606:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ea8a lrc: 0/0,0 mode: --/PR res: [0x240002729:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa628 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.259623:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eade lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa778 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000020:00100000:2.0:1775773080.259641:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.259651:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99c00 x1862023612302464/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.259672:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302464:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.259795:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.265002:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302464:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.265087:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x38:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.265100:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.265154:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x38:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.265170:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x38:0x0](ffff8de1c4079988) 00000080:00200000:2.0:1775773080.265268:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.265279:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-2, flags=0 00000080:00200000:2.0:1775773080.265284:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.265288:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-2, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.265337:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.265365:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x2e:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.265411:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.265418:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.265422:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ea44 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa4ca expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.265446:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.265455:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98e00 x1862023612302720/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.265477:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302720:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.265574:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.271630:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302720:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.271719:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x2e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.271765:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.272135:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x2e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.272154:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x2e:0x0](ffff8de1c407b248) 00000080:00200000:0.0:1775773080.272262:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.272276:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-3, flags=0 00000080:00200000:0.0:1775773080.272280:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.272285:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-3, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.272353:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.272382:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x2f:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.272433:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.272441:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.272443:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ea4b lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa4ed expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.272466:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.272474:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d7b80 x1862023612302976/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.272497:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302976:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.272647:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.279290:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612302976:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.279463:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x2f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.279475:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.279718:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x2f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.279994:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x2f:0x0](ffff8de1c4038908) 00000080:00200000:0.0:1775773080.280090:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.280102:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-8, flags=0 00000080:00200000:0.0:1775773080.280107:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.280113:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-8, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.280169:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.280199:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x34:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.280253:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 1/0,0 mode: --/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.280261:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.280265:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ea6e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa59c expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.280289:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.280299:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d7480 x1862023612303232/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.280323:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612303232:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.280455:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.290000:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612303232:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.290095:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x34:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.290107:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.290159:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x34:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.290174:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x34:0x0](ffff8de1c407a1c8) 00000080:00200000:0.0:1775773080.290269:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.290282:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-7, flags=0 00000080:00200000:0.0:1775773080.290288:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.290293:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-7, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.290359:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.290390:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x33:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.290437:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.290443:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.290446:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ea67 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa579 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.290469:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.290477:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d4700 x1862023612303488/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.290503:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612303488:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.290593:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.305911:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d4700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612303488:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.306007:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x33:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.306022:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.306078:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x33:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.306092:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x33:0x0](ffff8de1c407ec08) 00000080:00200000:0.0:1775773080.306178:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.306189:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-19, flags=0 00000080:00200000:0.0:1775773080.306194:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.306198:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-19, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.306248:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.306275:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3f:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.306701:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.306712:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.306715:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445eabb lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa71d expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.307032:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.307043:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d5500 x1862023612303744/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773080.307158:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612303744:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773080.307239:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7bafa80 going to sleep for 11 seconds 00010000:00010000:0.0:1775773080.320190:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773080.323651:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612303744:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.323786:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x3f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.323799:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.323855:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x3f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.323869:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x3f:0x0](ffff8de1c4083248) 00000080:00200000:0.0:1775773080.323961:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.323985:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-10, flags=0 00000080:00200000:0.0:1775773080.323990:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.323995:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-10, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.324050:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.324078:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x36:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.324126:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 1/0,0 mode: --/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.324132:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.324135:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ea7c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa5e2 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.324156:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.324163:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d7100 x1862023612304000/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.324184:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304000:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.324241:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.329906:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d7100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304000:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.330005:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x36:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.330018:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.330075:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x36:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.330088:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x36:0x0](ffff8de1c407ba88) 00000080:00200000:0.0:1775773080.330177:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.330188:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-14, flags=0 00000080:00200000:0.0:1775773080.330193:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.330198:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-14, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.330249:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.330275:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3a:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.330322:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.330329:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.330331:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ea98 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa66e expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.330355:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.330363:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d5880 x1862023612304256/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.330384:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304256:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.330442:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.340890:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304256:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.341002:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x3a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.341014:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.341068:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x3a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.341084:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x3a:0x0](ffff8de1c407e3c8) 00000080:00200000:2.0:1775773080.341174:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.341186:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-6, flags=0 00000080:00200000:2.0:1775773080.341192:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.341196:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-6, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.341251:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.341280:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x32:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.341335:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.341347:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.341350:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445ea60 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa556 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.341375:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.341385:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98700 x1862023612304512/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.341411:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304512:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.341497:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.346446:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304512:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.346562:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x32:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.346574:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.346626:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x32:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.346639:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x32:0x0](ffff8de1c4081148) 00000080:00200000:2.0:1775773080.347275:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.347289:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-11, flags=0 00000080:00200000:2.0:1775773080.347294:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.347299:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-11, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.347359:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.347388:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x37:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.347441:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.347449:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.347453:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ea83 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa605 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.347477:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.347487:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9a300 x1862023612304768/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.347524:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304768:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.347646:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.368871:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612304768:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.369128:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x37:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.369142:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.369200:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x37:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.369215:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x37:0x0](ffff8de1c407d348) 00000080:00200000:2.0:1775773080.369311:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.369323:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-4, flags=0 00000080:00200000:2.0:1775773080.369329:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.369334:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-4, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.369388:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.369415:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x30:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.369470:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.369479:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.369483:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9600/0x8a9f4e958445ea52 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa510 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.369614:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.369623:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9a680 x1862023612305024/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.369646:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305024:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.369773:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.375813:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305024:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.375901:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x30:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.375914:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.375963:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x30:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.375986:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x30:0x0](ffff8de1c4077448) 00000080:00200000:2.0:1775773080.376079:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.376090:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-18, flags=0 00000080:00200000:2.0:1775773080.376094:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.376099:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-18, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.376147:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.376174:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3e:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.376221:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.376229:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.376231:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445eab4 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa6fa expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.376255:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.376264:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9ad80 x1862023612305280/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.376286:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305280:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.376359:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.383198:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305280:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.383279:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x3e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.383290:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.383340:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x3e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.383353:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x3e:0x0](ffff8de1c40742c8) 00000080:00200000:2.0:1775773080.383488:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.383499:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-17, flags=0 00000080:00200000:2.0:1775773080.383504:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.383508:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-17, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.383554:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.383578:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3d:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.383622:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.383629:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.383632:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445eaad lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa6d7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.383653:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.383659:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681880 x1862023612305536/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.383686:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305536:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.383772:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.394021:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305536:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.394108:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x3d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.394119:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.394170:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x3d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.394183:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x3d:0x0](ffff8de1c4073248) 00000080:00200000:2.0:1775773080.394277:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.394288:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-0, flags=0 00000080:00200000:2.0:1775773080.394293:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.394298:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-0, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.394347:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.394374:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x2c:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.394425:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.394433:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.394436:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ea36 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa484 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.394459:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.394467:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682a00 x1862023612305792/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.394490:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305792:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.394571:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.400143:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612305792:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.400228:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x2c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773080.400240:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773080.400296:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x2c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773080.400310:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x2c:0x0](ffff8de1c40821c8) 00000080:00200000:2.0:1775773080.400401:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.400412:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-15, flags=0 00000080:00200000:2.0:1775773080.400417:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773080.400423:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-15, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:2.0:1775773080.400478:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773080.400521:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3b:0x0]: losing layout lock 00010000:00010000:2.0:1775773080.400572:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.400580:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.400583:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445ea9f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa691 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773080.400618:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.400628:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680000 x1862023612306048/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.400651:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306048:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.400762:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.404892:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306048:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.405277:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x3b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.405291:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.405348:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x3b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.405363:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x3b:0x0](ffff8de1c407db88) 00000080:00200000:0.0:1775773080.405460:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.405470:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-5, flags=0 00000080:00200000:0.0:1775773080.405475:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.405480:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-5, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.405529:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.405555:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x31:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.405606:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.405614:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.405617:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ea59 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa533 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.405638:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.405647:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d5f80 x1862023612306304/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.405670:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306304:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.405791:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.412829:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306304:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.412915:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x31:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.412927:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.413188:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x31:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.413204:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x31:0x0](ffff8de1c4087448) 00000080:00200000:0.0:1775773080.413303:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.413317:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-16, flags=0 00000080:00200000:0.0:1775773080.413324:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.413329:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-16, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.413384:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.413415:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x3c:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.413467:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.413477:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.413480:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eaa6 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa6b4 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.413507:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.413516:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d5180 x1862023612306560/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.413541:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306560:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.413611:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.422720:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306560:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773080.423208:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x3c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773080.423222:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773080.423287:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x3c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773080.423302:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x3c:0x0](ffff8de1c40780c8) 00000080:00200000:1.0:1775773080.423644:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773080.423659:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-9, flags=0 00000080:00200000:1.0:1775773080.423664:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773080.423669:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-9, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:1.0:1775773080.424174:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773080.424210:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x35:0x0]: losing layout lock 00010000:00010000:1.0:1775773080.424266:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773080.424273:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773080.424276:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ea75 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa5bf expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773080.424303:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773080.424501:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31880 x1862023612306816/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773080.424631:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306816:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773080.425128:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7bafa80 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.430799:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612306816:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.430888:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x35:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.430901:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.430954:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x35:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.430980:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x35:0x0](ffff8de1c407c2c8) 00000080:00200000:0.0:1775773080.431074:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.431085:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=0 00000080:00200000:0.0:1775773080.431090:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.431096:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-1, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.431149:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775773080.431176:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x2d:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.431227:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775773080.431234:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.431237:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ea3d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa4a7 expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1775773080.431261:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.431270:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6d80 x1862023612307072/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.431293:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307072:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.431359:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.435695:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307072:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.435822:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x2d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.435835:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.435888:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x2d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.435902:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x2d:0x0](ffff8de1c4084b08) 00000080:00200000:0.0:1775773080.436002:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.436015:0:166117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-13, flags=0 00000080:00200000:0.0:1775773080.436021:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.436025:0:166117:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-13, dir=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00010000:00010000:0.0:1775773080.436076:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.436105:0:166117:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x39:0x0]: losing layout lock 00010000:00010000:0.0:1775773080.436157:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.436165:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773080.436168:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ea91 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daa64b expref: -99 pid: 166110 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1775773080.436191:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773080.436199:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d6680 x1862023612307328/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773080.436233:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307328:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773080.436296:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.444361:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307328:192.168.201.137@tcp:36:rm.0 00000080:00200000:0.0:1775773080.444450:0:166117:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x39:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1775773080.444463:0:166117:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1775773080.444625:0:166117:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x39:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1775773080.444643:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x39:0x0](ffff8de1c4078908) 00000080:00200008:0.0:1775773080.444908:0:166117:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x2b:0x0](ffff8de1c40763c8), flags 704000 00010000:00010000:0.0:1775773080.444936:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775773080.444984:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 1 00000080:00200000:0.0:1775773080.444999:0:166117:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags=0 00000080:00200000:0.0:1775773080.445003:0:166117:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), intent=getattr 00000002:00010000:0.0:1775773080.445612:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773080.445664:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.445674:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.445684:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773080.445709:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307456:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775773080.446232:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775773080.450200:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307456:192.168.201.137@tcp:101:rm.0 00010000:00010000:0.0:1775773080.450226:0:166117:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450244:0:166117:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450252:0:166117:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450264:0:166117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450275:0:166117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450288:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450297:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450304:0:166117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773080.450316:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d5c00 x1862023612307456/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773080.450328:0:166117:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450340:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.450352:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.450360:0:166117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450367:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450375:0:166117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450404:0:166117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:0.0:1775773080.450422:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240002729:0x2b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773080.450471:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450479:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.450488:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773080.450507:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307584:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775773080.450588:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1b40 going to sleep for 11 seconds 00010000:00010000:2.0:1775773080.450652:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773080.450659:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450668:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e34600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773080.450672:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450681:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450688:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450704:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.450772:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 2/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450780:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.450810:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450818:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eaec lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa9d9 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.450831:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773080.450833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773080.450835:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773080.450843:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773080.450856:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612307712:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773080.456132:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612307712:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1775773080.459018:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612307584:192.168.201.137@tcp:101:rm.0 00010000:00010000:0.0:1775773080.459046:0:166117:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459060:0:166117:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459073:0:166117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459086:0:166117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459098:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459107:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459113:0:166117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773080.459124:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c67d6300 x1862023612307584/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773080.459148:0:166117:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459162:0:166117:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/43 (0 0) 00000080:00200000:0.0:1775773080.459183:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0x7:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773080.459212:0:166117:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x2b:0x0], updating i_size 4096 00000080:00200000:0.0:1775773080.459215:0:166117:0:(namei.c:147:ll_iget()) got inode: [0x240002729:0x2b:0x0](ffff8de1c40763c8): rc = 0 00000080:00010000:0.0:1775773080.459221:0:166117:0:(llite_internal.h:1976:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for remote lock 0x8a9f4e958445eaf3 00000080:00010000:0.0:1775773080.459226:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) for lock 0x8a9f4e958445ea28 00000080:00010000:0.0:1775773080.459237:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00010000:0.0:1775773080.459241:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea28 from it ffff9ba1c1c7be00 00010000:00010000:0.0:1775773080.459244:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.459253:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1775773080.459265:0:166117:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x8a9f4e958445eaf3 from it ffff9ba1c1c7be00 00010000:00010000:0.0:1775773080.459267:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773080.459273:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773080.459291:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88), inode mode 41ed mask 3 00000080:00200000:0.0:1775773080.459300:0:166117:0:(namei.c:2305:ll_rmdir()) VFS Op:name=remote_dir, dir=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00010000:00010000:0.0:1775773080.459325:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773080.459365:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773080.459371:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1775773080.459448:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612307840:192.168.201.137@tcp:103:rm.0 00010000:00010000:0.0:1775773080.459558:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ea28 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa44c expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773080.459586:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773080.459601:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:0.0:1775773080.459635:0:166117:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9bb80 x1862023612302080/t30064771119(30064771119) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773080.459645:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773080.459650:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c67d5c00 x1862023612308096/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773080.459666:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308096:192.168.201.137@tcp:35:rm.0 00000100:00100000:0.0:1775773080.459690:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773080.463869:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308096:192.168.201.137@tcp:35:rm.0 00000002:00100000:2.0:1775773080.463905:0:166117:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9bb80 x1862023612302080/t30064771119(30064771119) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1775773080.464003:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.464013:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 1/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773080.464019:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775773080.464022:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445eaf3 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa9e7 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773080.464034:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eae5 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x2b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa786 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1775773080.464054:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773080.464061:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5683b80 x1862023612308352/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773080.464086:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308352:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773080.464161:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773080.467440:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612307840:192.168.201.137@tcp:103:rm.0 00000100:00100000:0.0:1775773080.468420:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775773080.468506:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625190912 00000100:00100000:1.0:1775773080.468522:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625190912 00000100:00100000:1.0:1775773080.468611:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 10 00000100:00100000:1.0:1775773080.468622:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c67d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:190959:x1862023625190912:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775773080.468640:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773080.468719:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775773080.468762:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c67d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:190959:x1862023625190912:12345-192.168.201.137@tcp:104: Request processed in 143us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1775773080.468771:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 10 00010000:00010000:2.0:1775773080.468835:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773080.468841:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.468850:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e35800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773080.468855:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.468864:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.468873:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.468897:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773080.468939:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.468946:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773080.468981:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.468988:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35800/0x8a9f4e958445ea21 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daa430 expref: -99 pid: 166104 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773080.469000:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773080.469002:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773080.469003:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773080.469053:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775773080.469069:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612308480:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773080.477857:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612308480:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773080.505061:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308352:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773080.505119:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x2b:0x0](ffff8de1c40763c8) 00000080:00200008:2.0:1775773080.505181:0:166117:0:(file.c:447:ll_file_release()) START file d80c.replay-single:[0x200027cd1:0x7:0x0](ffff8de1c4083a88), flags 704000 00010000:00010000:2.0:1775773080.505222:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773080.505264:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773080.505280:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.505295:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00010000:00010000:2.0:1775773080.505321:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00000080:00200000:2.0:1775773080.505328:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773080.505334:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773080.505337:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:2.0:1775773080.505343:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bc10 00010000:00010000:2.0:1775773080.505346:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00010000:00010000:2.0:1775773080.505354:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00000080:00200000:2.0:1775773080.505367:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773080.505383:0:166117:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=0 00000080:00200000:2.0:1775773080.505386:0:166117:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:2.0:1775773080.505399:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80c.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773080.505438:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.505445:0:166117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773080.505455:0:166117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773080.505475:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308608:192.168.201.137@tcp:101:rm.0 00000100:00100000:3.0:1775773080.509058:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c79ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.518336:0:166117:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285574 gen 1 00000100:00100000:3.0:1775773080.518354:0:166117:0:(client.c:3131:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8de1d0f99180 x1862023612301696/t356482285574(356482285574) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1775773080.518369:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308608:192.168.201.137@tcp:101:rm.0 00010000:00010000:3.0:1775773080.518390:0:166117:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518405:0:166117:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518412:0:166117:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518423:0:166117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518434:0:166117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518446:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518454:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518461:0:166117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773080.518471:0:166117:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c5683800 x1862023612308608/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773080.518484:0:166117:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518491:0:166117:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/7 (0 0) 00000080:00200000:3.0:1775773080.518496:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773080.518522:0:166117:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0x7:0x0], updating i_size 4096 00000080:00200000:3.0:1775773080.518525:0:166117:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0x7:0x0](ffff8de1c4083a88): rc = 0 00000080:00010000:3.0:1775773080.518530:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445eafa 00000080:00010000:3.0:1775773080.518541:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00000080:00010000:3.0:1775773080.518544:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eafa from it ffff9ba1c1c7be00 00010000:00010000:3.0:1775773080.518547:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773080.518560:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773080.518588:0:166117:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773080.518602:0:166117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773080.518610:0:166117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00010000:00010000:3.0:1775773080.518617:0:166117:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00000080:00200000:3.0:1775773080.518621:0:166117:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773080.518624:0:166117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773080.518626:0:166117:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ea13 00000080:00010000:3.0:1775773080.518628:0:166117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ea13 from it ffff9ba1c1c7bd88 00010000:00010000:3.0:1775773080.518630:0:166117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00010000:00010000:3.0:1775773080.518634:0:166117:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00000080:00200000:3.0:1775773080.518639:0:166117:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:3.0:1775773080.518644:0:166117:0:(namei.c:2305:ll_rmdir()) VFS Op:name=d80c.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:3.0:1775773080.518658:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00010000:00010000:3.0:1775773080.518673:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.518680:0:166117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:3.0:1775773080.518709:0:166117:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f99180 x1862023612301696/t356482285574(356482285574) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773080.518717:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773080.518720:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612308864/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773080.518805:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308864:192.168.201.137@tcp:35:rm.0 00000100:00100000:3.0:1775773080.518867:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.522200:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612308864:192.168.201.137@tcp:35:rm.0 00000002:00100000:3.0:1775773080.522236:0:166117:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f99180 x1862023612301696/t356482285574(356482285574) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773096 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1775773080.522306:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.522317:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773080.522323:0:166117:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00010000:00010000:3.0:1775773080.522329:0:166117:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1775773080.522332:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445eafa lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daaa34 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773080.522348:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445ead7 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa763 expref: -99 pid: 166117 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773080.522363:0:166117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ea13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daa190 expref: -99 pid: 164850 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00000020:00100000:3.0:1775773080.522382:0:166117:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775773080.522388:0:166117:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612309120/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773080.522408:0:166117:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612309120:192.168.201.137@tcp:36:rm.0 00000100:00100000:3.0:1775773080.522507:0:166117:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773080.530706:0:166117:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166117:1862023612309120:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775773080.530801:0:166117:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0x7:0x0](ffff8de1c4083a88) 00010000:00010000:3.0:1775773081.349491:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773082.368174:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773083.393079:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773083.969169:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612309248:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773083.969343:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309504:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773083.969378:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309760:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773083.969413:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1775773083.969420:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309376:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773083.969447:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309632:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773083.990228:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309376:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773083.990253:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309632:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773083.990267:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612309248:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773083.990280:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309504:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773083.990293:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612309760:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773084.415996:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773085.440186:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773086.465948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773087.487875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1775773088.305813:0:166683:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80d: DNE: create remote dir, drop update rep from MDT1, fail 2 MDTs ========================================================== 18:18:06 (1775773086) 00000080:00200000:2.0:1775773088.436680:0:166686:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773088.436767:0:166686:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773088.436990:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773088.437005:0:166686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773088.437021:0:166686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773088.437056:0:166686:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166686:1862023612309888:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773088.441050:0:166686:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773088.465274:0:166686:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285579 gen 1 00000100:00100000:3.0:1775773088.465315:0:166686:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166686:1862023612309888:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773088.465344:0:166686:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465359:0:166686:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465373:0:166686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465387:0:166686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465404:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465413:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465421:0:166686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773088.465433:0:166686:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c5680e00 x1862023612309888/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773104 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773088.465449:0:166686:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465464:0:166686:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775773088.465473:0:166686:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773088.465510:0:166686:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:3.0:1775773088.465518:0:166686:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb01 00000080:00010000:3.0:1775773088.465525:0:166686:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773088.465528:0:166686:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb01 from it ffff9ba1c1d0bb58 00010000:00010000:3.0:1775773088.465531:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465541:0:166686:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773088.465573:0:166686:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773088.465615:0:166686:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=13 00000080:00200000:3.0:1775773088.465621:0:166686:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:3.0:1775773088.465756:0:166686:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80d.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773088.465811:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465820:0:166686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.465839:0:166686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773088.465866:0:166686:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166686:1862023612310016:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773088.465963:0:166686:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773088.475401:0:166686:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166686:1862023612310016:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773088.475431:0:166686:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475450:0:166686:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475458:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475466:0:166686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475476:0:166686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475484:0:166686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3385800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773088.475500:0:166686:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475508:0:166686:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475516:0:166686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475523:0:166686:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773088.475530:0:166686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773088.475536:0:166686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166686 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773088.475562:0:166686:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d0e76d80 x1862023612310016/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/584 e 0 to 0 dl 1775773104 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773088.475580:0:166686:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1775773088.475625:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773088.475640:0:166686:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1775773088.475651:0:166686:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb01 from it ffff9ba1c1d0b930 00010000:00010000:3.0:1775773088.475665:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773088.475674:0:166686:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773088.475820:0:166686:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773088.475851:0:166686:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773088.475859:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773088.475869:0:166686:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773088.476090:0:166686:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773088.476097:0:166686:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773088.476101:0:166686:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb01 00000080:00010000:3.0:1775773088.476107:0:166686:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb01 from it ffff9ba1c1d0bbe8 00010000:00010000:3.0:1775773088.476110:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773088.476117:0:166686:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773088.476128:0:166686:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773088.476138:0:166686:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=16392 00000080:00200008:3.0:1775773088.476171:0:166686:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1775773088.476176:0:166686:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773088.476184:0:166686:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773088.476191:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773088.476200:0:166686:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773088.476207:0:166686:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773088.476211:0:166686:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773088.476213:0:166686:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb01 00000080:00010000:3.0:1775773088.476218:0:166686:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb01 from it ffff9ba1c1d0bcb8 00010000:00010000:3.0:1775773088.476221:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773088.476228:0:166686:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:3.0:1775773088.478424:0:166686:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1775773088.478443:0:166686:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773088.478476:0:166686:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773088.478507:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775773088.478526:0:166686:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1775773088.478534:0:166686:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773088.478542:0:166686:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773088.478545:0:166686:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb01 00000080:00010000:3.0:1775773088.478552:0:166686:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb01 from it ffff9ba1c1d0bcb8 00010000:00010000:3.0:1775773088.478556:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1775773088.478564:0:166686:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1775773088.478865:0:166686:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773088.479056:0:166686:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773088.479065:0:166686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773088.479076:0:166686:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1775773088.479088:0:166686:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773088.479093:0:166686:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773088.479095:0:166686:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb01 00000080:00010000:3.0:1775773088.479099:0:166686:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb01 from it ffff9ba1c1d0bbb0 00010000:00010000:3.0:1775773088.479102:0:166686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773088.479109:0:166686:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:3.0:1775773088.479119:0:166686:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:3.0:1775773088.479130:0:166686:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 300000 00000080:00200080:3.0:1775773088.479158:0:166686:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c03066f0 arg=7ffe7a083aa0 00000080:00200000:3.0:1775773088.479179:0:166686:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) name=d80d.replay-single stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:3.0:1775773088.479213:0:166686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1775773088.479291:0:166686:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1775773088.479299:0:166686:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775773088.479302:0:166686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eb01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daaae3 expref: -99 pid: 166686 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:3.0:1775773088.479338:0:166686:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1775773088.479354:0:166686:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612310272/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 568/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773088.479390:0:166686:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166686:1862023612310272:192.168.201.137@tcp:36:lfs.0 00000100:00100000:3.0:1775773088.479526:0:166686:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773088.484187:0:166686:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166686:1862023612310272:192.168.201.137@tcp:36:lfs.0 00000080:00200000:3.0:1775773088.484249:0:166686:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00200000:3.0:1775773088.484259:0:166686:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000080:00200008:3.0:1775773088.484303:0:166686:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 300000 00010000:00010000:3.0:1775773088.514622:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773089.092986:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612310400:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773089.093146:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612310656:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773089.093190:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1775773089.093200:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612310528:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773089.093227:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612310784:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773089.105945:0:2403:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 30064771141 gen 1 00000100:00100000:0.0:1775773089.106177:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612310528:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773089.106194:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612310784:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773089.106207:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612310656:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773089.109822:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c67d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612310400:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773089.536032:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1775773089.586321:0:166704:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773089.586363:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773089.586450:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773089.586464:0:166704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773089.586477:0:166704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773089.586512:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612310912:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773089.586838:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773089.592504:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612310912:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773089.592539:0:166704:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592553:0:166704:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592579:0:166704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592592:0:166704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592607:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592617:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592631:0:166704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773089.592654:0:166704:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0a32300 x1862023612310912/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773105 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773089.592669:0:166704:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592684:0:166704:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775773089.592693:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773089.592759:0:166704:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:3.0:1775773089.592767:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:3.0:1775773089.592773:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773089.592777:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c0d1fb58 00010000:00010000:3.0:1775773089.592780:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592790:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773089.592831:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773089.592855:0:166704:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=29 00000080:00200000:3.0:1775773089.592861:0:166704:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=0 00000002:00010000:3.0:1775773089.592889:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80d.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1775773089.592940:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592950:0:166704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.592960:0:166704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773089.592986:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311040:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773089.593076:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd300 going to sleep for 11 seconds 00000100:00100000:3.0:1775773089.608889:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311040:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773089.608942:0:166704:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.608978:0:166704:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.608988:0:166704:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609008:0:166704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609022:0:166704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609037:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609053:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609061:0:166704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773089.609074:0:166704:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8de1d0e74700 x1862023612311040/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773105 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773089.609091:0:166704:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609104:0:166704:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/10 (0 0) 00000080:00200000:3.0:1775773089.609113:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773089.609152:0:166704:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000080:00200000:3.0:1775773089.609156:0:166704:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xa:0x0](ffff8de1c407f448): rc = 0 00000080:00010000:3.0:1775773089.609162:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445eb16 00000080:00010000:3.0:1775773089.609182:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:3.0:1775773089.609185:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb16 from it ffff9ba1c0d1fa28 00010000:00010000:3.0:1775773089.609189:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609198:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773089.609241:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773089.609266:0:166704:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags=13 00000080:00200000:3.0:1775773089.609271:0:166704:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), intent=getattr 00000002:00010000:3.0:1775773089.609298:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773089.609346:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609353:0:166704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.609364:0:166704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773089.609388:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311168:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773089.611409:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd300 going to sleep for 11 seconds 00000100:00100000:3.0:1775773089.626029:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311168:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773089.626058:0:166704:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626075:0:166704:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626082:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626090:0:166704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626100:0:166704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626106:0:166704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773089.626112:0:166704:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626120:0:166704:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626129:0:166704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626137:0:166704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773089.626144:0:166704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.626151:0:166704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445eb1d lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773089.626172:0:166704:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d0e74700 x1862023612311168/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773105 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773089.626188:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xa:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1775773089.626225:0:166704:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/10 (0 0) 00000080:00200000:3.0:1775773089.626323:0:166704:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773089.626342:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773089.626353:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.626367:0:166704:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773089.626373:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773089.626380:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773089.626384:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:3.0:1775773089.626389:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c0d1fbe8 00010000:00010000:3.0:1775773089.626393:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.626400:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773089.626416:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773089.626425:0:166704:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=16408 00000080:00200000:3.0:1775773089.626431:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773089.626446:0:166704:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags=16392 00000080:00200000:3.0:1775773089.626450:0:166704:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), intent=getattr 00000002:00010000:3.0:1775773089.626465:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773089.627476:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.627491:0:166704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.627506:0:166704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773089.627540:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311296:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773089.627649:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd300 going to sleep for 11 seconds 00000100:00100000:3.0:1775773089.632495:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311296:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773089.632586:0:166704:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632606:0:166704:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632614:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632704:0:166704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632715:0:166704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632822:0:166704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384a00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773089.632828:0:166704:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632836:0:166704:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632844:0:166704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632851:0:166704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773089.632859:0:166704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773089.632866:0:166704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384a00/0x8a9f4e958445eb24 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773089.632888:0:166704:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d0e74700 x1862023612311296/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773105 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773089.632910:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xa:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1775773089.633256:0:166704:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/10 (0 0) 00000080:00200000:0.0:1775773089.633363:0:166704:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773089.633383:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773089.633394:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773089.633408:0:166704:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775773089.633415:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773089.633421:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773089.633426:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773089.633432:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c0d1fb58 00010000:00010000:0.0:1775773089.633435:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773089.633443:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775773089.633460:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773089.633469:0:166704:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=13 00000080:00200008:0.0:1775773089.633480:0:166704:0:(file.c:6226:ll_getattr_dentry()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775773089.633484:0:166704:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448),name=d80d.replay-single 00000002:00010000:0.0:1775773089.633497:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773089.633502:0:166704:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/10 (0 0) 00010000:00010000:2.0:1775773089.635252:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.635273:0:166704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.635286:0:166704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773089.635325:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311424:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773089.637204:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773089.645655:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311424:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773089.645697:0:166704:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646360:0:166704:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646375:0:166704:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646392:0:166704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646409:0:166704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646427:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646438:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646446:0:166704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773089.646462:0:166704:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c7024000 x1862023612311424/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773105 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773089.646479:0:166704:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.646493:0:166704:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/10 (0 0) 00000080:00200000:2.0:1775773089.646501:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773089.647044:0:166704:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000080:00010000:2.0:1775773089.647056:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445eb2b 00000080:00010000:2.0:1775773089.647067:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:2.0:1775773089.647070:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb2b from it ffff9ba1c0d1fcb8 00010000:00010000:2.0:1775773089.647074:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.647092:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775773089.651152:0:166704:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773089.651167:0:166704:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773089.651215:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773089.651241:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773089.651262:0:166704:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773089.651273:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773089.651285:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773089.651290:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:2.0:1775773089.651299:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c0d1fcb8 00010000:00010000:2.0:1775773089.651304:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773089.651315:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773089.651564:0:166704:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773089.651574:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773089.651582:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773089.651597:0:166704:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773089.651604:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773089.651608:0:166704:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773089.651611:0:166704:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:2.0:1775773089.651615:0:166704:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c0d1fbf8 00010000:00010000:2.0:1775773089.651618:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773089.651625:0:166704:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773089.651635:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773089.651644:0:166704:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=267 00000080:00200000:2.0:1775773089.651652:0:166704:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 44 00000080:00200008:2.0:1775773089.651662:0:166704:0:(file.c:1057:ll_file_open()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags 300000 00000002:00010000:2.0:1775773089.651683:0:166704:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0240300001 00010000:00010000:2.0:1775773089.651833:0:166704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.651841:0:166704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773089.651855:0:166704:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773089.651871:0:166704:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681180 x1862023612311680/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773089.651889:0:166704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773089.651919:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311680:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773089.652170:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773089.660353:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311680:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773089.660386:0:166704:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.660403:0:166704:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.660411:0:166704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.660430:0:166704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.660440:0:166704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.661152:0:166704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c512fa00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773089.661159:0:166704:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.661295:0:166704:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.661305:0:166704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.661314:0:166704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775773089.661322:0:166704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773089.661329:0:166704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 166704 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773089.661360:0:166704:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1c5681180 x1862023612311680/t356482285581(356482285581) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773105 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773089.661377:0:166704:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681180 x1862023612311680/t356482285581(356482285581) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773105 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773089.661400:0:166704:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773089.661448:0:166704:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000002:00100000:2.0:1775773089.661472:0:166704:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681180 x1862023612311680/t356482285581(356482285581) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773105 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:2.0:1775773089.661587:0:166704:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) cmd=c03066f0 arg=7ffd9258d510 00000080:00200000:2.0:1775773089.661611:0:166704:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) name=remote_dir stripe_offset=1 stripe_count=0, hash_type=0 00000020:00100000:2.0:1775773089.662511:0:166704:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773089.662523:0:166704:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682680 x1862023612311936/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773089.662552:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311936:192.168.201.137@tcp:36:lfs.0 00000100:00100000:2.0:1775773089.662661:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1775773089.675076:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775773089.679588:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625200768 00000100:00100000:1.0:1775773089.679607:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625200768 00000100:00100000:1.0:1775773089.679708:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 11 00000100:00100000:1.0:1775773089.680402:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c7025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182027:x1862023625200768:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775773089.680431:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773089.680548:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775773089.680557:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c7025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:182027:x1862023625200768:12345-192.168.201.137@tcp:104: Request processed in 169us (5497us total) trans 0 rc 0/0 00000100:00100000:1.0:1775773089.680567:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 11 00010000:00010000:3.0:1775773089.680599:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775773089.680610:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.680621:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c512ee00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773089.680628:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.681119:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.681131:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.681241:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773089.681350:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.681359:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1775773089.681450:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612312064:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775773089.681555:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.681565:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb2b lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daab6f expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773089.681592:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773089.681594:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773089.681597:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773089.688398:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612312064:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775773090.560027:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773091.583989:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773092.608212:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773093.632199:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:0.0:1775773093.676503:0:166715:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775773093.676677:0:166715:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773093.676712:0:166715:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773093.677254:0:166715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775773093.677361:0:166715:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775773093.677369:0:166715:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773093.677379:0:166715:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773093.677383:0:166715:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773093.677393:0:166715:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c1877cb8 00010000:00010000:0.0:1775773093.677398:0:166715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775773093.677407:0:166715:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200008:0.0:1775773093.678251:0:166715:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775773093.678257:0:166715:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773093.678271:0:166715:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773093.678281:0:166715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1775773093.678290:0:166715:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1775773093.678296:0:166715:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773093.678300:0:166715:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773093.678302:0:166715:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773093.678306:0:166715:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c1877cb8 00010000:00010000:0.0:1775773093.678309:0:166715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1775773093.678313:0:166715:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:0.0:1775773093.678421:0:166715:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773093.678429:0:166715:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773093.678436:0:166715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:0.0:1775773093.678445:0:166715:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:0.0:1775773093.678450:0:166715:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773093.678453:0:166715:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773093.678455:0:166715:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773093.678457:0:166715:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c1877bb0 00010000:00010000:0.0:1775773093.678459:0:166715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:0.0:1775773093.678464:0:166715:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:0.0:1775773093.678470:0:166715:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775773093.678475:0:166715:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775773093.678577:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:0.0:1775773093.678597:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d1bacc00 uarg=0000000000000000 00800000:00000004:0.0:1775773093.678605:0:166715:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9056, max_age 9069 00000100:00100000:0.0:1775773093.678665:0:166715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312192:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775773093.678792:0:166715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c67ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773093.685511:0:166715:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285581 gen 1 00000100:00100000:1.0:1775773093.685899:0:166715:0:(client.c:3131:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8de1c5681180 x1862023612311680/t356482285581(356482285581) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773105 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1775773093.685915:0:166715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312192:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773093.685940:0:166715:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317231/353529 objects 1023639/1024000 00000080:00200080:1.0:1775773093.686115:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.686141:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00800000:00000004:1.0:1775773093.686150:0:166715:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9056, max_age 9069 00000100:00100000:1.0:1775773093.686199:0:166715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312320:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773093.686308:0:166715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1775773093.688862:0:166715:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 30064771142 gen 1 00000100:00100000:1.0:1775773093.688883:0:166715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312320:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773093.688916:0:166715:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317319/353529 objects 1023718/1024000 00000080:00200080:1.0:1775773093.688997:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689017:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689027:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689032:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689038:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689042:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689046:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689050:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689053:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689056:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689060:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689063:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689067:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689071:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689075:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689078:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689083:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689086:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689089:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689092:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689096:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689099:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689103:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689106:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689109:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689112:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689116:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689119:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689123:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689127:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689131:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689134:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689138:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689141:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689144:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689148:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689151:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689155:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689159:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689162:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689166:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689169:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689172:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689176:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689180:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689183:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689187:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689191:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689195:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689198:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689202:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689206:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689209:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689213:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689223:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689227:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689230:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689234:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689238:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689241:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.689245:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.689249:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690538:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690565:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690572:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690575:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690579:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690582:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690586:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690589:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690593:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690596:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690601:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690604:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690619:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690624:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690629:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690632:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690636:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690640:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690644:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690647:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690651:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690654:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690658:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690661:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690665:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690669:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690673:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690676:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690680:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690684:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690688:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690691:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690695:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690699:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690703:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690706:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690710:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690714:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690717:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690719:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690752:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690758:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690764:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690767:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690771:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690775:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690779:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690782:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690786:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690790:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690794:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690797:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690801:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690805:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690815:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690819:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690823:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690826:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690829:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690833:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690836:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690839:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690843:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00800000:00000080:1.0:1775773093.690847:0:166715:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.690852:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.690859:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00020000:00000004:1.0:1775773093.690869:0:166715:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9056, max_age 9069 00000100:00100000:1.0:1775773093.690927:0:166715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312448:192.168.201.137@tcp:13:lfs.0 00000100:00100000:1.0:1775773093.691483:0:166715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1775773093.696328:0:166715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312448:192.168.201.137@tcp:13:lfs.0 00020000:00000004:1.0:1775773093.696373:0:166715:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:1.0:1775773093.696477:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.696509:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00020000:00000004:1.0:1775773093.696518:0:166715:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9056, max_age 9069 00000100:00100000:1.0:1775773093.697027:0:166715:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312576:192.168.201.137@tcp:13:lfs.0 00000100:00100000:1.0:1775773093.697126:0:166715:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1775773093.701850:0:166715:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166715:1862023612312576:192.168.201.137@tcp:13:lfs.0 00020000:00000004:1.0:1775773093.701895:0:166715:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:1.0:1775773093.701985:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702008:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702015:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702018:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702021:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702023:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702200:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702205:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702207:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702209:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702212:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702214:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702216:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702219:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702221:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702223:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702225:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702227:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702229:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702231:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702233:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702234:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702236:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702238:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702240:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702241:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702243:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702245:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702247:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702248:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702250:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702252:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702255:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702259:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702262:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702265:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702269:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702273:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702277:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702280:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702283:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702287:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702291:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702294:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702298:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702301:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702305:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702308:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702311:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702314:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702318:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702322:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702326:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702330:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702335:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702337:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702340:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702342:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702344:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702346:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702348:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702349:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702351:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702354:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702356:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702358:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702361:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702362:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702364:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702366:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702368:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702369:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702438:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702444:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702450:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702453:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702456:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702459:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702462:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702465:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702467:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702471:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702474:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702477:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702480:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702484:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702487:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702491:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702496:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702499:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702503:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702507:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702511:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702515:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702519:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702523:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702527:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702530:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702533:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702536:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702540:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702543:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702547:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702550:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702554:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702558:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702562:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702566:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702569:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702573:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702577:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702580:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702584:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702588:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702591:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702595:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702598:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702602:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702606:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702695:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702705:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702711:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702715:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702719:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200080:1.0:1775773093.702880:0:166715:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fff2639d780 00020000:00000080:1.0:1775773093.702889:0:166715:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93000 uarg=0000000000000000 00000080:00200008:1.0:1775773093.702906:0:166715:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:0.0:1775773093.759191:0:166722:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773093.759233:0:166722:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773093.759257:0:166722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:0.0:1775773093.759276:0:166722:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:0.0:1775773093.759286:0:166722:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773093.759296:0:166722:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773093.759299:0:166722:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773093.759308:0:166722:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c1bebbd0 00010000:00010000:0.0:1775773093.759312:0:166722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:0.0:1775773093.759321:0:166722:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:0.0:1775773093.759340:0:166722:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773093.759361:0:166722:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=1536 00000080:00200000:0.0:1775773093.759365:0:166722:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773093.760469:0:166722:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773093.760490:0:166722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:0.0:1775773093.760505:0:166722:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:0.0:1775773093.760514:0:166722:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773093.760522:0:166722:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773093.760526:0:166722:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773093.760533:0:166722:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c1bebcd0 00010000:00010000:0.0:1775773093.760536:0:166722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:0.0:1775773093.760550:0:166722:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:0.0:1775773093.760685:0:166722:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:0.0:1775773093.760698:0:166722:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773093.760713:0:166722:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773093.760720:0:166722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:0.0:1775773093.760835:0:166722:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:0.0:1775773093.760842:0:166722:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773093.760846:0:166722:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773093.760849:0:166722:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb0f 00000080:00010000:0.0:1775773093.760853:0:166722:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb0f from it ffff9ba1c1bebdb0 00010000:00010000:0.0:1775773093.760856:0:166722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:0.0:1775773093.760864:0:166722:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:0.0:1775773093.760871:0:166722:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:0.0:1775773093.760876:0:166722:0:(namei.c:2106:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=33188, excl=1 00000080:00200000:0.0:1775773093.760880:0:166722:0:(namei.c:2061:ll_mknod()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) mode 100644 dev 0 00010000:00010000:0.0:1775773093.760911:0:166722:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1775773093.760972:0:166722:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1775773093.760977:0:166722:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773093.760979:0:166722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445eb0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daab1b expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000020:00100000:0.0:1775773093.761009:0:166722:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773093.761022:0:166722:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027800 x1862023612312832/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773093.761046:0:166722:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166722:1862023612312832:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:0.0:1775773093.761174:0:166722:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c67eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773093.774611:0:166722:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166722:1862023612312832:192.168.201.137@tcp:36:mcreate.0 00000080:00200000:3.0:1775773093.774672:0:166722:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0xb:0x0](ffff8de1c407cb08) 00000080:00200000:3.0:1775773093.774843:0:166722:0:(namei.c:2114:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, unhashed 1 00000080:00200000:1.0:1775773093.814454:0:166725:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773093.814492:0:166725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773093.814580:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.814592:0:166725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.814604:0:166725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773093.814648:0:166725:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166725:1862023612312960:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775773093.814784:0:166725:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1775773093.822720:0:166725:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166725:1862023612312960:192.168.201.137@tcp:101:rm.0 00010000:00010000:1.0:1775773093.822889:0:166725:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.822904:0:166725:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.822918:0:166725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.822932:0:166725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.822946:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.822954:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.822962:0:166725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773093.822975:0:166725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0a31180 x1862023612312960/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773109 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773093.822990:0:166725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.823006:0:166725:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1775773093.823015:0:166725:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775773093.823055:0:166725:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:1.0:1775773093.823064:0:166725:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb39 00000080:00010000:1.0:1775773093.823072:0:166725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773093.823076:0:166725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb39 from it ffff9ba1c1c23b58 00010000:00010000:1.0:1775773093.823079:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.823090:0:166725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773093.823124:0:166725:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773093.823150:0:166725:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=8 00000080:00200000:1.0:1775773093.823155:0:166725:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:1.0:1775773093.823186:0:166725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: fsa-oleg137-client.virtnet,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773093.823236:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.823244:0:166725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.823255:0:166725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773093.823297:0:166725:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166725:1862023612313088:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775773093.823406:0:166725:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1775773093.825688:0:166725:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166725:1862023612313088:192.168.201.137@tcp:101:rm.0 00010000:00010000:1.0:1775773093.825720:0:166725:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825812:0:166725:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825821:0:166725:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825836:0:166725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825848:0:166725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825861:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825870:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825877:0:166725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773093.825889:0:166725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0a31180 x1862023612313088/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 600/584 e 0 to 0 dl 1775773109 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773093.825904:0:166725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.825916:0:166725:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/11 (0 0) 00000080:00200000:1.0:1775773093.825924:0:166725:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775773093.825949:0:166725:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xb:0x0], updating i_size 0 00000080:00200000:1.0:1775773093.825952:0:166725:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xb:0x0](ffff8de1c407cb08): rc = 0 00000080:00200000:1.0:1775773093.826006:0:166725:0:(file.c:6766:ll_layout_conf()) [0x200027cd1:0xb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1775773093.826034:0:166725:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xb:0x0](ffff8de1c407cb08) for lock 0x8a9f4e958445eb40 00000080:00010000:1.0:1775773093.826049:0:166725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xb:0x0](ffff8de1c407cb08) 00000080:00010000:1.0:1775773093.826053:0:166725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb40 from it ffff9ba1c1c23b20 00010000:00010000:1.0:1775773093.826056:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773093.826065:0:166725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1775773093.826122:0:166725:0:(file.c:6226:ll_getattr_dentry()) START file fsa-oleg137-client.virtnet:[0x200027cd1:0xb:0x0](ffff8de1c407cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775773093.826130:0:166725:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xb:0x0](ffff8de1c407cb08),name=fsa-oleg137-client.virtnet 00000002:00010000:1.0:1775773093.826155:0:166725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xb:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773093.826166:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773093.826178:0:166725:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773093.826185:0:166725:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773093.826194:0:166725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xb:0x0](ffff8de1c407cb08) 00000080:00010000:1.0:1775773093.826198:0:166725:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xb:0x0](ffff8de1c407cb08) for lock 0x8a9f4e958445eb40 00000080:00010000:1.0:1775773093.826202:0:166725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb40 from it ffff9ba1c1c23cb8 00010000:00010000:1.0:1775773093.826204:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773093.826212:0:166725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773093.827157:0:166725:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773093.827175:0:166725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773093.827187:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773093.827200:0:166725:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773093.827207:0:166725:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773093.827212:0:166725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773093.827215:0:166725:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb39 00000080:00010000:1.0:1775773093.827219:0:166725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb39 from it ffff9ba1c1c23c10 00010000:00010000:1.0:1775773093.827222:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773093.827230:0:166725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773093.827241:0:166725:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773093.827252:0:166725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=fsa-oleg137-client.virtnet, flags=0 00000080:00200000:1.0:1775773093.827258:0:166725:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773093.827264:0:166725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773093.827270:0:166725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775773093.827278:0:166725:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773093.827284:0:166725:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773093.827288:0:166725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773093.827290:0:166725:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb39 00000080:00010000:1.0:1775773093.827294:0:166725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb39 from it ffff9ba1c1c23d68 00010000:00010000:1.0:1775773093.827297:0:166725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775773093.827304:0:166725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775773093.827313:0:166725:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775773093.827319:0:166725:0:(namei.c:2395:ll_unlink()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:1.0:1775773093.827448:0:166725:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773093.827479:0:166725:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773093.827498:0:166725:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0xb:0x0]: losing layout lock 00010000:00010000:1.0:1775773093.827899:0:166725:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775773093.827908:0:166725:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773093.827918:0:166725:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1775773093.827920:0:166725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9e00/0x8a9f4e958445eb40 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daabd1 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775773093.827940:0:166725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9000/0x8a9f4e958445eb39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daabb5 expref: -99 pid: 166725 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:1.0:1775773093.827959:0:166725:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773093.827972:0:166725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31180 x1862023612313344/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773093.828002:0:166725:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166725:1862023612313344:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773093.828266:0:166725:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773093.841198:0:166725:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166725:1862023612313344:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775773093.841339:0:166725:0:(vvp_io.c:1817:vvp_io_init()) [0x200027cd1:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1775773093.841352:0:166725:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1775773093.841712:0:166725:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0xb:0x0](ffff8de1c407cb08) 00000100:00100000:1.0:1775773094.209511:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313600:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773094.209621:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313856:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773094.209651:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1775773094.209656:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612313472:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773094.209683:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313728:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773094.209701:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313984:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773094.219275:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313856:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773094.219321:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313984:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773094.221073:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313728:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773094.224290:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612313600:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773094.224332:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612313472:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773094.656397:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773095.680664:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773096.703899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773097.731534:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773098.752550:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773099.328060:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314240:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.328181:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314496:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.328214:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1775773099.328219:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612314112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.328245:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.328262:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314624:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.333792:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314624:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.333817:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314496:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.334050:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612314112:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.334063:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314368:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773099.334076:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612314240:192.168.201.137@tcp:400:kworker.0 00000001:02000400:0.0:1775773099.751775:0:166797:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1775773099.781843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775773100.486359:0:166806:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775773100.486375:0:166806:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.486406:0:166806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.486692:0:166806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.486704:0:166806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.486717:0:166806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773100.486773:0:166806:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612314752:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773100.486894:0:166806:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6735c00 going to sleep for 50 seconds 00000100:00100000:1.0:1775773100.497545:0:166806:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612314752:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775773100.497582:0:166806:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497598:0:166806:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497621:0:166806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497636:0:166806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497653:0:166806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497661:0:166806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497670:0:166806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773100.497683:0:166806:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0a33480 x1862023612314752/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773155 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773100.497699:0:166806:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497715:0:166806:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1775773100.497764:0:166806:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775773100.497803:0:166806:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:1.0:1775773100.497811:0:166806:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb47 00000080:00010000:1.0:1775773100.497818:0:166806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773100.497823:0:166806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb47 from it ffff9ba1c1d73cb8 00010000:00010000:1.0:1775773100.497826:0:166806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.497836:0:166806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1775773100.498785:0:166806:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775773100.498794:0:166806:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.498816:0:166806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.498831:0:166806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773100.498850:0:166806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773100.498858:0:166806:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773100.498863:0:166806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773100.498866:0:166806:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb47 00000080:00010000:1.0:1775773100.498871:0:166806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb47 from it ffff9ba1c1d73cb8 00010000:00010000:1.0:1775773100.498875:0:166806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773100.498883:0:166806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773100.499031:0:166806:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.499041:0:166806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.499048:0:166806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775773100.499058:0:166806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773100.499063:0:166806:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773100.499067:0:166806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773100.499070:0:166806:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb47 00000080:00010000:1.0:1775773100.499073:0:166806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb47 from it ffff9ba1c1d73bb0 00010000:00010000:1.0:1775773100.499075:0:166806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1775773100.499083:0:166806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775773100.499092:0:166806:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:1.0:1775773100.499099:0:166806:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:1.0:1775773100.499220:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:1.0:1775773100.499238:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92000 uarg=0000000000000000 00800000:00000004:1.0:1775773100.499247:0:166806:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9070, max_age 9076 00000100:00100000:1.0:1775773100.499300:0:166806:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612314880:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773100.499419:0:166806:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6735c00 going to sleep for 50 seconds 00000100:00100000:3.0:1775773100.502570:0:166806:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612314880:192.168.201.137@tcp:41:lfs.0 00800000:00000004:3.0:1775773100.502605:0:166806:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317231/353529 objects 1023639/1024000 00000080:00200080:3.0:1775773100.502707:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.502751:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00800000:00000004:3.0:1775773100.502760:0:166806:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9070, max_age 9076 00000100:00100000:3.0:1775773100.502805:0:166806:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612315008:192.168.201.137@tcp:41:lfs.0 00000100:00100000:3.0:1775773100.502886:0:166806:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd180 going to sleep for 50 seconds 00000100:00100000:3.0:1775773100.504884:0:166806:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612315008:192.168.201.137@tcp:41:lfs.0 00800000:00000004:3.0:1775773100.504912:0:166806:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317337/353529 objects 1023720/1024000 00000080:00200080:3.0:1775773100.505029:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505047:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505053:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505056:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505059:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505061:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505064:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505066:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505068:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505069:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505071:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505073:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505075:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505077:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505079:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505081:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505083:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505084:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505086:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505088:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505090:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505092:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505094:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505095:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505098:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505100:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505103:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505105:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505107:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505108:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505111:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505112:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505114:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505116:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505118:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505119:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505121:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505123:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505125:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505127:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505129:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505130:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505132:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505134:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505136:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505137:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505140:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505141:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505143:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505146:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505148:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505150:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505152:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505155:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505156:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505158:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505160:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505161:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505163:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505165:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505167:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505168:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505170:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505172:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505174:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505175:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505177:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505179:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505181:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505182:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505184:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505186:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505187:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505189:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505192:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505194:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505196:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505210:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505215:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505220:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505224:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505227:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505231:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505235:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505239:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505243:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505247:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505250:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505254:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505258:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505263:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505266:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505270:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505279:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505284:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505287:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505291:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505294:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505297:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505301:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505304:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505307:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505311:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505314:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505317:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505320:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505323:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505326:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505329:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505343:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505347:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505351:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505355:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505358:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505362:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505365:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505369:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505372:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505376:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505379:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505383:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505474:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505483:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505487:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505490:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00800000:00000080:3.0:1775773100.505493:0:166806:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.505497:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.505504:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00020000:00000004:3.0:1775773100.505514:0:166806:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9070, max_age 9076 00000100:00100000:3.0:1775773100.505559:0:166806:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612315136:192.168.201.137@tcp:13:lfs.0 00000100:00100000:3.0:1775773100.505714:0:166806:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773100.508242:0:166806:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612315136:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775773100.508280:0:166806:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:3.0:1775773100.508548:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.508569:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00020000:00000004:3.0:1775773100.508578:0:166806:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9070, max_age 9076 00000100:00100000:3.0:1775773100.508636:0:166806:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612315264:192.168.201.137@tcp:13:lfs.0 00000100:00100000:3.0:1775773100.508764:0:166806:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773100.511222:0:166806:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166806:1862023612315264:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775773100.511255:0:166806:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:3.0:1775773100.511666:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511689:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511699:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511703:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511708:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511712:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511716:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511719:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511749:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511754:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511759:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511763:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511767:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511770:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511775:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511779:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511783:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511786:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511791:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511794:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511798:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511802:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511806:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511809:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511813:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511817:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511821:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511825:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511830:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511833:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511837:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511841:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511845:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511850:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511854:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511857:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511861:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511865:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511868:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511872:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511876:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511879:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511882:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511886:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511889:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511892:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511896:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511900:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511903:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511907:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511911:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511914:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511917:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511921:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511924:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511928:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511931:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511934:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511938:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511942:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511945:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511949:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511953:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511956:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511960:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511963:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511967:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511970:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511975:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511978:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511982:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511986:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511990:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.511994:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.511998:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512002:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512006:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512009:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512012:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512016:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512020:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512023:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512027:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512032:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512035:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512039:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512043:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512047:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512051:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512054:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512059:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512062:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512066:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512070:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512074:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512077:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512081:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512085:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512089:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512092:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512095:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512098:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512102:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512104:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512108:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512111:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512114:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512118:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512123:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512127:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512131:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512134:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512138:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512141:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512145:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512148:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512152:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512155:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512159:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512162:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512165:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512168:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512173:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512176:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200080:3.0:1775773100.512180:0:166806:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffd0e1ce6c0 00020000:00000080:3.0:1775773100.512183:0:166806:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee1c00 uarg=0000000000000000 00000080:00200008:3.0:1775773100.512219:0:166806:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:1.0:1775773100.581947:0:166813:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.581992:0:166813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.582017:0:166813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773100.582036:0:166813:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775773100.582045:0:166813:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773100.582055:0:166813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773100.582058:0:166813:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb47 00000080:00010000:1.0:1775773100.582067:0:166813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb47 from it ffff9ba1c1d8bbd0 00010000:00010000:1.0:1775773100.582071:0:166813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773100.582081:0:166813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1775773100.582099:0:166813:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773100.582118:0:166813:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=1536 00000080:00200000:1.0:1775773100.582122:0:166813:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.582127:0:166813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.582132:0:166813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775773100.582139:0:166813:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1775773100.582145:0:166813:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773100.582149:0:166813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773100.582151:0:166813:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb47 00000080:00010000:1.0:1775773100.582154:0:166813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb47 from it ffff9ba1c1d8bcd0 00010000:00010000:1.0:1775773100.582157:0:166813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775773100.582164:0:166813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775773100.582171:0:166813:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775773100.582176:0:166813:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.582181:0:166813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.582185:0:166813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773100.582197:0:166813:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775773100.582203:0:166813:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773100.582207:0:166813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773100.582209:0:166813:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb47 00000080:00010000:1.0:1775773100.582212:0:166813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb47 from it ffff9ba1c1d8bdb0 00010000:00010000:1.0:1775773100.582215:0:166813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773100.582221:0:166813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775773100.582228:0:166813:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775773100.582234:0:166813:0:(namei.c:2106:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=33188, excl=1 00000080:00200000:1.0:1775773100.582238:0:166813:0:(namei.c:2061:ll_mknod()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) mode 100644 dev 0 00010000:00010000:1.0:1775773100.582268:0:166813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773100.582334:0:166813:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773100.582341:0:166813:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773100.582344:0:166813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daabfb expref: -99 pid: 166806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:1.0:1775773100.582375:0:166813:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773100.582391:0:166813:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32680 x1862023612315520/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773100.582423:0:166813:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166813:1862023612315520:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:1.0:1775773100.582542:0:166813:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6735d80 going to sleep for 50 seconds 00000100:00100000:2.0:1775773100.585959:0:166813:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166813:1862023612315520:192.168.201.137@tcp:36:mcreate.0 00000080:00200000:2.0:1775773100.586034:0:166813:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0xc:0x0](ffff8de1c40821c8) 00000080:00200000:2.0:1775773100.586141:0:166813:0:(namei.c:2114:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, unhashed 1 00000080:00200000:1.0:1775773100.604376:0:166816:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773100.604415:0:166816:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773100.604503:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 166816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.604517:0:166816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773100.604531:0:166816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 166816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773100.604566:0:166816:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166816:1862023612315648:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775773100.604691:0:166816:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c6735540 going to sleep for 50 seconds 00000100:00100000:2.0:1775773100.607228:0:166816:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166816:1862023612315648:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773100.607260:0:166816:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607277:0:166816:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607291:0:166816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607303:0:166816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607317:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607325:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607345:0:166816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773100.607358:0:166816:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0a31f80 x1862023612315648/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773155 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773100.607375:0:166816:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607556:0:166816:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1775773100.607566:0:166816:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773100.607602:0:166816:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:2.0:1775773100.607610:0:166816:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb4e 00000080:00010000:2.0:1775773100.607626:0:166816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773100.607629:0:166816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb4e from it ffff9ba1c0da3b58 00010000:00010000:2.0:1775773100.607633:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607642:0:166816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773100.607677:0:166816:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773100.607704:0:166816:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=8 00000080:00200000:2.0:1775773100.607710:0:166816:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:2.0:1775773100.607773:0:166816:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: fsa-oleg137-client.virtnet,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773100.607825:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 166816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607833:0:166816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.607842:0:166816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 166816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773100.607867:0:166816:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166816:1862023612315776:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773100.607955:0:166816:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6780 going to sleep for 50 seconds 00000100:00100000:2.0:1775773100.614157:0:166816:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166816:1862023612315776:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773100.614197:0:166816:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614233:0:166816:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614242:0:166816:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614256:0:166816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614269:0:166816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614284:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614292:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614300:0:166816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773100.614313:0:166816:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c5680380 x1862023612315776/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 600/584 e 0 to 0 dl 1775773155 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773100.614328:0:166816:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614352:0:166816:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/12 (0 0) 00000080:00200000:2.0:1775773100.614362:0:166816:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773100.614488:0:166816:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xc:0x0], updating i_size 0 00000080:00200000:2.0:1775773100.614493:0:166816:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xc:0x0](ffff8de1c40821c8): rc = 0 00000080:00200000:2.0:1775773100.614550:0:166816:0:(file.c:6766:ll_layout_conf()) [0x200027cd1:0xc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1775773100.614580:0:166816:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xc:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445eb55 00000080:00010000:2.0:1775773100.614595:0:166816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xc:0x0](ffff8de1c40821c8) 00000080:00010000:2.0:1775773100.614599:0:166816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb55 from it ffff9ba1c0da3b20 00010000:00010000:2.0:1775773100.614603:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773100.614625:0:166816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775773100.614676:0:166816:0:(file.c:6226:ll_getattr_dentry()) START file fsa-oleg137-client.virtnet:[0x200027cd1:0xc:0x0](ffff8de1c40821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773100.614684:0:166816:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xc:0x0](ffff8de1c40821c8),name=fsa-oleg137-client.virtnet 00000002:00010000:2.0:1775773100.614712:0:166816:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773100.614894:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773100.614909:0:166816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773100.614917:0:166816:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773100.614923:0:166816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xc:0x0](ffff8de1c40821c8) 00000080:00010000:2.0:1775773100.614927:0:166816:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xc:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445eb55 00000080:00010000:2.0:1775773100.614931:0:166816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb55 from it ffff9ba1c0da3cb8 00010000:00010000:2.0:1775773100.614934:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773100.614942:0:166816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773100.615019:0:166816:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773100.615028:0:166816:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773100.615036:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773100.615045:0:166816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773100.615051:0:166816:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773100.615055:0:166816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773100.615058:0:166816:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb4e 00000080:00010000:2.0:1775773100.615061:0:166816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb4e from it ffff9ba1c0da3c10 00010000:00010000:2.0:1775773100.615063:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773100.615070:0:166816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773100.615078:0:166816:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773100.615088:0:166816:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=fsa-oleg137-client.virtnet, flags=0 00000080:00200000:2.0:1775773100.615093:0:166816:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773100.615098:0:166816:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773100.615103:0:166816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773100.615111:0:166816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773100.615116:0:166816:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773100.615119:0:166816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773100.615121:0:166816:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb4e 00000080:00010000:2.0:1775773100.615124:0:166816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb4e from it ffff9ba1c0da3d68 00010000:00010000:2.0:1775773100.615127:0:166816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773100.615133:0:166816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773100.615139:0:166816:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:2.0:1775773100.615144:0:166816:0:(namei.c:2395:ll_unlink()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:2.0:1775773100.615187:0:166816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773100.615215:0:166816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773100.615232:0:166816:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0xc:0x0]: losing layout lock 00010000:00010000:2.0:1775773100.615282:0:166816:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773100.615290:0:166816:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773100.615302:0:166816:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775773100.615305:0:166816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445eb55 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daac33 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773100.615325:0:166816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eb4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daac17 expref: -99 pid: 166816 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1775773100.616649:0:166816:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773100.616665:0:166816:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680380 x1862023612316032/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773100.616705:0:166816:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166816:1862023612316032:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773100.617081:0:166816:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6780 going to sleep for 50 seconds 00000100:00100000:2.0:1775773100.622716:0:166816:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166816:1862023612316032:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773100.622873:0:166816:0:(vvp_io.c:1817:vvp_io_init()) [0x200027cd1:0xc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1775773100.622887:0:166816:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0xc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773100.622917:0:166816:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0xc:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773100.800021:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773100.863905:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 25 seconds 00010000:00010000:2.0:1775773101.823942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773102.850254:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773103.873588:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773104.450046:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316288:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.450128:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316544:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.450162:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775773104.450168:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612316160:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.450204:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316416:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.450227:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316672:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.458259:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316544:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.458289:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612316160:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.458299:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316416:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.458309:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316672:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773104.458320:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612316288:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773104.895973:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773105.921495:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773106.086650:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612311936:192.168.201.137@tcp:36:lfs.0 00000080:00200000:2.0:1775773106.086697:0:166704:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00200000:2.0:1775773106.086705:0:166704:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x40:0x0], updating i_size 4096 00000080:00200008:2.0:1775773106.086770:0:166704:0:(file.c:447:ll_file_release()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags 300000 00000002:00100000:2.0:1775773106.086834:0:166704:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5681180 x1862023612311680/t356482285581(356482285581) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773105 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773106.086845:0:166704:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773106.086850:0:166704:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680700 x1862023612316928/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773106.086873:0:166704:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612316928:192.168.201.137@tcp:35:lfs.0 00000100:00100000:2.0:1775773106.086935:0:166704:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773106.093003:0:166704:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:166704:1862023612316928:192.168.201.137@tcp:35:lfs.0 00000002:00100000:2.0:1775773106.093044:0:166704:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5681180 x1862023612311680/t356482285581(356482285581) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773105 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000001:02000400:1.0:1775773106.934057:0:166892:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0001 00010000:00010000:0.0:1775773106.948221:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773107.970427:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773108.992033:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773109.569081:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612317056:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.569224:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317312:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.569255:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317568:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.569519:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1775773109.569529:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317184:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.569565:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317440:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.583196:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317568:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775773109.583400:0:2403:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff8de1e006a000 of lustre-MDT0000_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1775773109.583407:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1775773109.583412:0:2403:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection to lustre-MDT0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1775773109.583420:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773109.583425:0:2403:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 8999 00000100:00080000:1.0:1775773109.583441:0:2403:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773109.583465:0:2403:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773109.583507:0:2403:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a30e00 x1862023612317696/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773109.583963:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612317696:192.168.201.137@tcp:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1775773109.584201:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317184:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.584236:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317440:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773109.584252:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612317312:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773109.594144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773109.594165:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775773109.594172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612317696:192.168.201.137@tcp:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1775773110.019147:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773111.040323:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773112.066515:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773113.092173:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773114.112779:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773114.690241:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773114.690249:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773114.690254:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773114.690267:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9086 00000100:00080000:2.0:1775773114.690282:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1775773114.690289:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773114.690302:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773114.690323:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681180 x1862023612317952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773114.690486:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612317824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773114.690616:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318208:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773114.690657:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775773114.690664:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318080:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773114.690689:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318336:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773114.690809:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612317952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773114.697464:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318208:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773114.708683:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318336:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773115.136019:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773116.160397:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773117.184262:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773118.208421:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773119.231965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773119.808074:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773119.808081:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1775773119.808126:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612318464:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773119.808454:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612318592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773119.808635:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318720:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773119.815396:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612318848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773119.838982:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612318848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773119.839081:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318720:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773120.255972:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773121.280775:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773122.304563:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773123.328418:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773124.352503:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773124.928059:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773124.928065:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1775773124.928083:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1775773124.928088:0:139607:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8de1e006a000: disconnect after 24s idle 00000100:00080000:3.0:1775773124.928104:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1775773124.928107:0:139607:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8de1e006a000: disconnect after 24s idle 00000100:00100000:2.0:1775773124.928173:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612318976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773124.928280:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773124.928287:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612319104:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773124.928650:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612319232:192.168.201.137@tcp:9:kworker.0 00000100:00100000:0.0:1775773124.928695:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612319360:192.168.201.137@tcp:9:kworker.0 00000100:00080000:0.0:1775773124.945458:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1d0e75c00 x1862023612319232/t0(0) o9->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773134 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773124.945472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:0.0:1775773124.945478:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612319232:192.168.201.137@tcp:9:kworker.0 00000100:00080000:0.0:1775773124.945497:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1d0e75880 x1862023612319360/t0(0) o9->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773134 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773124.945505:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:0.0:1775773124.945508:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612319360:192.168.201.137@tcp:9:kworker.0 00010000:00010000:3.0:1775773125.377234:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1775773125.951989:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773109/real 1775773109] req@ffff8de1c7024380 x1862023612317056/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773125.952033:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7024380 x1862023612317056/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773125.952045:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1775773125.952049:0:2403:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.137@tcp: Connection to MGS (at 192.168.201.137@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1775773125.952054:0:2403:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.201.137@tcp for MGC192.168.201.137@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1775773125.952056:0:2403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1775773125.952061:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c7024380 x1862023612317056/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773125.952072:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c5680700 x1862023612317824/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773130 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773125.952091:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c5682300 x1862023612318464/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773125.952100:0:2403:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0e77100 x1862023612318976/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773140 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1775773125.952110:0:2403:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1775773125.952113:0:2403:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1775773125.952115:0:2403:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1775773125.952117:0:2403:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1775773125.952155:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612317056:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773125.952951:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773125.952958:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773125.952963:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773125.952971:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 8992 00000100:00080000:3.0:1775773125.952989:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773125.953039:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e74000 x1862023612319488/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773125.953071:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773125.953075:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1775773125.953307:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612319616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773125.953434:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612318976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773125.953445:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612318464:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773125.953453:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612317824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773125.954036:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612319488:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775773126.405786:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773127.423973:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773128.450204:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773129.027888:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773114/real 1775773114] req@ffff8de1c5681180 x1862023612317952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773129.028037:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681180 x1862023612317952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773129.028059:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773129.028077:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773129.028080:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612317952:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775773129.028130:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773129.028136:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773129.028139:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773129.028143:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773129.028146:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773129.028152:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9091 00000100:00080000:1.0:1775773129.028166:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1775773129.028173:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773129.028184:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773129.028215:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a31c00 x1862023612319744/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773129.028264:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612319872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773129.028486:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612319744:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775773129.472671:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773130.050470:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773130.050479:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773130.050482:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773130.050485:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1775773130.050545:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612320000:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773130.496049:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773131.072324:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773131.072334:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773131.072338:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773131.072341:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1775773131.072429:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775773131.072461:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612320128:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773131.521518:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773132.547033:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773133.570146:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773134.083310:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773134.083324:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773134.083326:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773134.083329:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1775773134.083430:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775773134.083458:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612320256:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773134.593079:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773135.167887:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773125/real 1775773125] req@ffff8de1d0e74000 x1862023612319488/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773135 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773135.167931:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0e74000 x1862023612319488/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773135 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773135.167955:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773135.168045:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773135.168051:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612319488:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773135.168137:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773135.168143:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773135.168147:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773135.168153:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9102 00000100:00080000:0.0:1775773135.168167:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1775773135.168174:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773135.168215:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7024e00 x1862023612320384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773135.168400:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612320384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773135.168520:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773135.168525:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1775773135.168572:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775773135.168583:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612320512:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773135.616931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773136.641287:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773137.667848:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773138.689906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773139.712560:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773140.288231:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773140.288245:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1775773140.288248:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773140.288252:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1775773140.288362:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612320640:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773140.735960:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773141.761135:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773142.783993:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773143.812331:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1775773144.383954:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773114/real 1775773114] req@ffff8de1c5683100 x1862023612318080/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773144.383982:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5683100 x1862023612318080/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773144.383991:0:2405:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1775773144.383995:0:2405:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection to lustre-MDT0001 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1775773144.384000:0:2405:0:(import.c:416:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1775773144.384033:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612318080:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775773144.384103:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773144.384107:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773144.384117:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773144.384120:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773144.384122:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773144.384124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773144.384126:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773144.384130:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9040 00000100:00080000:0.0:1775773144.384141:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773144.384149:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773144.384174:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7026a00 x1862023612320768/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773144.384215:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612320768:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775773144.832104:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773145.859575:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773146.880059:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773147.904495:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773148.928055:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1775773149.442363:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773119/real 1775773119] req@ffff8de1c5682d80 x1862023612318592/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773149 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773149.442408:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5682d80 x1862023612318592/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773149 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773149.442418:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 13, was 12): CONNECTING 00000100:00100000:2.0:1775773149.442441:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612318592:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773149.503910:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773129/real 1775773129] req@ffff8de1d0a31c00 x1862023612319744/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773149 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773149.503954:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0a31c00 x1862023612319744/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773149 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773149.503986:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773149.504013:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773149.504017:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612319744:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775773149.504153:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773149.504160:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773149.504162:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773149.504166:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773149.504169:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773149.504177:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9105 00000100:00080000:0.0:1775773149.504190:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1775773149.504198:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773149.504214:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773149.504251:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7026d80 x1862023612320896/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773149.504279:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773149.504284:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1775773149.504412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612320896:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775773149.952026:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773150.527931:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773135/real 1775773135] req@ffff8de1c7024e00 x1862023612320384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773150.527973:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7024e00 x1862023612320384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773150.527999:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773150.528038:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773150.528043:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612320384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773150.528181:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773150.528188:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773150.528192:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773150.528198:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9112 00000100:00080000:1.0:1775773150.528211:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1775773150.528219:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773150.528267:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a31500 x1862023612321024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773150.528285:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773150.528289:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773150.528292:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773150.528295:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1775773150.528381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612321024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773150.531039:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.137@tcp: connect to target with instance 0 10000000:01000000:2.0:1775773150.531659:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:02000400:2.0:1775773150.531672:0:2401:0:(import.c:1282:ptlrpc_connect_interpret()) Evicted from MGS (at 192.168.201.137@tcp) after server handle changed from 0x3797d62297da9cea to 0x3797d62297daac87 00000100:00080000:2.0:1775773150.531678:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1775773150.531685:0:2401:0:(import.c:1667:ptlrpc_import_recovery_state_machine()) evicted from MGS@192.168.201.137@tcp; invalidating 00000100:00100000:2.0:1775773150.532188:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612321024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773150.532271:0:167324:0:(import.c:1591:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.201.137@tcp to MGS@192.168.201.137@tcp 00000100:00100000:1.0:1775773150.532277:0:167324:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1775773150.532280:0:167324:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1775773150.532309:0:167324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773150.532321:0:167324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773150.532330:0:167324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1775773150.532350:0:167324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773150.532361:0:167324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35000/0x8a9f4e958445e9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da9cf8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773150.532377:0:167324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773150.532384:0:167324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773150.532389:0:167324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1775773150.532393:0:167324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773150.532396:0:167324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34200/0x8a9f4e958445ea05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da9d06 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773150.532412:0:167324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773150.532418:0:167324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773150.532423:0:167324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1775773150.532427:0:167324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773150.532430:0:167324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d3384600/0x8a9f4e958445ea1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297daa2a8 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773150.532441:0:167324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1775773150.532447:0:167324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773150.532453:0:167324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1775773150.532456:0:167324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773150.532459:0:167324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e34e00/0x8a9f4e958445e9fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297da9cff expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775773150.532474:0:167324:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1775773150.532479:0:167324:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1775773150.532481:0:167324:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1775773150.532486:0:167324:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1775773150.532490:0:167324:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) MGC192.168.201.137@tcp: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00010000:00010000:3.0:1775773150.978772:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1775773151.938847:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:3.0:1775773151.938858:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 346 10000000:01000000:3.0:1775773151.938866:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:3.0:1775773151.938947:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.938961:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.938977:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773151.939014:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321152:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1775773151.939149:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773151.944940:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321152:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1775773151.944978:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.944993:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773151.945106:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321280:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1775773151.945215:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773151.951440:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321280:192.168.201.137@tcp:256:ll_cfg_requeue.0 10000000:01000000:3.0:1775773151.951505:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' failed (-2). 00010000:00010000:3.0:1775773151.951519:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.951776:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000400:3.0:1775773151.951786:0:160428:0:(mgc_request.c:1917:mgc_process_log()) MGC192.168.201.137@tcp: IR log lustre-cliir failed, not fatal: rc = -2 10000000:01000000:3.0:1775773151.971491:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1775773151.971498:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-client-ffff8de1e006a000 from 52 10000000:01000000:3.0:1775773151.971503:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1775773151.971712:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.971767:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.971778:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773151.971809:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321408:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1775773151.971898:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773151.977563:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321408:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1775773151.977588:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773151.977597:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773151.977669:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321536:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1775773151.977751:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0c00 going to sleep for 11 seconds 00010000:00010000:0.0:1775773152.000110:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773152.000259:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321536:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1775773152.000347:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321664:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1775773152.000478:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773152.011251:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321664:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:3.0:1775773152.016010:0:167325:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1775773152.016995:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1775773152.017020:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1775773152.017031:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773152.017043:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1775773152.017303:0:160428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1775773152.017306:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log params-ffff8de1e006a000 from 7 10000000:01000000:2.0:1775773152.017318:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1775773152.017369:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773152.017378:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773152.017388:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773152.017414:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321792:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1775773152.018120:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c563ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773152.026787:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321792:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1775773152.026816:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773152.026828:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773152.026909:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321920:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773152.026993:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c563ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773152.036052:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612321920:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773152.036143:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322048:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1775773152.038978:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c563ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773152.044162:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322048:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:2.0:1775773152.045826:0:167326:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1775773152.045922:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1775773152.045944:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1775773152.045958:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773152.045971:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1775773152.045982:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1775773152.045985:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-sptlrpc-ffff8de1e005cd40 from 1 10000000:01000000:0.0:1775773152.045989:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1775773152.046038:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773152.046047:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773152.046059:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773152.046104:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322176:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775773152.046220:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6780 going to sleep for 11 seconds 00000100:00100000:2.0:1775773152.051687:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322176:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1775773152.051752:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773152.051770:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773152.052941:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322304:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1775773152.053048:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c563e180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773152.066454:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322304:192.168.201.137@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1775773152.066515:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1775773152.066545:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773152.066558:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773153.024015:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773154.049082:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773154.560022:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773154.560030:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773154.560033:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773154.560036:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1775773154.560084:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612322432:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773154.565318:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612322432:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773154.627951:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773144/real 1775773144] req@ffff8de1c7026a00 x1862023612320768/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773154 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773154.628049:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7026a00 x1862023612320768/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773154 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773154.628076:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773154.628109:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773154.628114:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612320768:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775773154.629116:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773154.629124:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1775773154.629128:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773154.629132:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773154.629136:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773154.629145:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9121 00000100:00080000:1.0:1775773154.629169:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775773154.629177:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773154.629190:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773154.629234:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a33100 x1862023612322560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773154.629463:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612322560:192.168.201.137@tcp:38:kworker.0 00000100:00000400:2.0:1775773154.633379:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773124/real 1775773124] req@ffff8de1d0e77480 x1862023612319104/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773154 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773154.633423:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e77480 x1862023612319104/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773154 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773154.633434:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:2.0:1775773154.633456:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612319104:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773155.074593:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1775773155.647865:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773125/real 1775773125] req@ffff8de1d0e74a80 x1862023612319616/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773155 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773155.647902:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e74a80 x1862023612319616/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773155 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773155.647912:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:2.0:1775773155.647933:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612319616:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773156.099200:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773157.122779:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773158.144017:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773158.340046:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:0.0:1775773158.340243:0:160415:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625221120 00000100:00100000:0.0:1775773158.340256:0:160415:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625221120 00000100:00100000:0.0:1775773158.340368:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 12 00000100:00100000:0.0:1775773158.340380:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1d0a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:198906:x1862023625221120:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775773158.340401:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773158.340502:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775773158.340509:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1d0a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:198906:x1862023625221120:12345-192.168.201.137@tcp:104: Request processed in 132us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1775773158.340527:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 12 00010000:00010000:3.0:1775773158.340569:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775773158.340578:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773158.340587:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384400 already unused, calling callback (ffffffffc1197c20) 10000000:00010000:3.0:1775773158.340592:0:160426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773158.340619:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1775773158.340628:0:160426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1775773158.340635:0:160426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1775773158.340694:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773158.340701:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775773158.340778:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773158.340786:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d3384400/0x8a9f4e958445eb5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297daac8e expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773158.340808:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773158.340810:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773158.340812:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773158.340831:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612322688:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773158.357434:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612322688:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775773159.169022:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1775773159.231922:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773129/real 1775773129] req@ffff8de1d0a30e00 x1862023612319872/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773159 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773159.231969:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0a30e00 x1862023612319872/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773159 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773159.231979:0:2402:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:1.0:1775773159.232003:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612319872:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773159.744927:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773159.744943:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1775773159.744947:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773159.744951:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1775773159.745027:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775773159.745056:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612322816:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773159.762606:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612322816:192.168.201.137@tcp:400:kworker.0 10000000:01000000:0.0:1775773160.192688:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:0.0:1775773160.192697:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 346 10000000:01000000:0.0:1775773160.192705:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:0.0:1775773160.192798:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773160.192812:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773160.192826:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773160.192977:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322944:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1775773160.193098:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773160.197500:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612322944:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1775773160.197538:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773160.197553:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773160.197669:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612323072:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:2.0:1775773160.197849:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c563e180 going to sleep for 11 seconds 00010000:00010000:3.0:1775773160.199367:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773160.216651:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612323072:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:2.0:1775773160.216759:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:2.0:1775773160.217130:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:2.0:1775773160.217178:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:2.0:1775773160.217221:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:2.0:1775773160.217286:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:2.0:1775773160.217300:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773160.217312:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1775773160.287508:0:167425:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 0): CONNECTING 00000100:00080000:2.0:1775773160.287975:0:167423:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 21, was 0): CONNECTING 00010000:00080000:0.0:1775773160.288010:0:167425:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c7278800@lustre-MDT0001-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00010000:00080000:2.0:1775773160.288010:0:167423:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c3008000@lustre-MDT0000-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00000100:00000400:1.0:1775773160.703931:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773130/real 1775773130] req@ffff8de1d0a31f80 x1862023612320000/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773160 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773160.703979:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0a31f80 x1862023612320000/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773160 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773160.703989:0:2403:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:1.0:1775773160.704012:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612320000:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773161.216240:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1775773161.728127:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773131/real 1775773131] req@ffff8de1d0a33480 x1862023612320128/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773161 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773161.728173:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0a33480 x1862023612320128/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773161 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773161.728184:0:2403:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:1.0:1775773161.728208:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612320128:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773162.240659:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773163.265655:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773164.293582:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1775773164.357097:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773134/real 1775773134] req@ffff8de1c7027100 x1862023612320256/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773164.357140:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7027100 x1862023612320256/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773164.357149:0:2402:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:0.0:1775773164.357173:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612320256:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773164.865086:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773164.865094:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1775773164.865097:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773164.865100:0:139607:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1775773164.865131:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612323200:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773164.877841:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612323200:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773165.313120:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1775773165.825418:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773135/real 1775773135] req@ffff8de1c7026680 x1862023612320512/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773165.825465:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7026680 x1862023612320512/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773165.825486:0:2403:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 14, was 12): CONNECTING 00000100:00100000:1.0:1775773165.825507:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612320512:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773166.343980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:3.0:1775773166.880198:0:167505:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775773166.880210:0:167505:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773166.880290:0:167505:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773166.880352:0:167505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 167505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773166.880365:0:167505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 167505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773166.880380:0:167505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 167505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775773166.880406:0:167505:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1d0e77100 x1862023612323328/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/1152 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1775773166.880417:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1775773167.359965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773167.935953:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1775773168.383968:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773168.960896:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1775773169.408025:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773169.983887:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00000100:00100000:3.0:1775773169.984029:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773154/real 1775773154] req@ffff8de1d0a33100 x1862023612322560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773169 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773169.984057:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0a33100 x1862023612322560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773169 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773169.984075:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773169.984083:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773169.984088:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612322560:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775773169.986065:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773169.986071:0:123972:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773169.986073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773169.986076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773169.986080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773169.986089:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:0.0:1775773169.986102:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773169.986112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773169.986128:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7025500 x1862023612323584/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773169.986226:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612323584:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773169.986503:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612323456:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773169.997022:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612323456:192.168.201.137@tcp:400:kworker.0 00010000:00080000:3.0:1775773169.997106:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c7025500 x1862023612323584/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775773179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773169.997127:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to target with instance 8 00000100:00080000:3.0:1775773169.997148:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1775773169.997156:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00100000:3.0:1775773169.997159:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 30064771142 gen 1 00000100:00080000:3.0:1775773169.997171:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c7278800 from lustre-MDT0001_UUID committed 30064771142 last 0 00000100:00080000:3.0:1775773169.997175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1775773169.997653:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612323584:192.168.201.137@tcp:38:kworker.0 00010000:00080000:1.0:1775773169.997709:0:167520:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-mdc-ffff8de1e006a000 to lustre-MDT0001_UUID@192.168.201.137@tcp 00010000:00010000:1.0:1775773169.997715:0:167520:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-mdc-ffff8de1e006a000 (0) 00010000:00010000:1.0:1775773169.997721:0:167520:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-mdc-ffff8de1e006a000 00000100:00080000:1.0:1775773169.998180:0:167520:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1775773169.998462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612323712:192.168.201.137@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1775773170.074787:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0a33480 x1862023612323712/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773199 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773170.074809:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1775773170.074816:0:2401:0:(client.c:3204:ptlrpc_resend_req()) @@@ going to resend req@ffff8de1d0a33480 x1862023612323712/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773199 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773170.074825:0:2401:0:(client.c:3213:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8de1d0a33480 x1862023612323712/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773199 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773170.074831:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1775773170.079903:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00100000:3.0:1775773170.079919:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612323712:192.168.201.137@tcp:400:ldlm_lock_repla.0 00010000:00010000:3.0:1775773170.445014:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1775773170.625588:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773140/real 1775773140] req@ffff8de1c5680700 x1862023612320640/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773170 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773170.625622:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5680700 x1862023612320640/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773170 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773170.625641:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612320640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773171.007899:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1775773171.456420:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773172.033416:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1775773172.481396:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773173.055871:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00010000:00010000:3.0:1775773173.504415:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773174.079916:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 0 seconds 00000100:00100000:3.0:1775773174.079998:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773149/real 1775773149] req@ffff8de1c7026d80 x1862023612320896/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773174 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773174.080029:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7026d80 x1862023612320896/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773174 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.080046:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773174.080072:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773174.080076:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612320896:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773174.080209:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612323840:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775773174.080260:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773174.080265:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773174.080267:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773174.080273:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:0.0:1775773174.080283:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773174.080294:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773174.080311:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7026d80 x1862023612323968/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773174.080372:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612324096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773174.080483:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612323968:192.168.201.137@tcp:38:kworker.0 00010000:00080000:0.0:1775773174.085419:0:2402:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c7025500 x1862023612324096/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773174.085436:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612324096:192.168.201.137@tcp:400:kworker.0 00010000:00080000:3.0:1775773174.085783:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c7026d80 x1862023612323968/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775773184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.085801:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to target with instance 84 00000100:00080000:3.0:1775773174.088560:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1775773174.088571:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1775773174.088574:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285581 gen 1 00000100:00100000:3.0:1775773174.088588:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773109 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.088598:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 356482285581 last 0 00000100:00080000:3.0:1775773174.088606:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773109 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773174.088621:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612323968:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773174.088671:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612312832:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:1.0:1775773174.089527:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612323840:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773174.119229:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773204 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.119242:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1775773174.119244:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285581 gen 1 00000100:00100000:3.0:1775773174.119250:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773204 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.119257:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 356482285581 last 356482285583 00000100:00080000:3.0:1775773174.119264:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0a31180 x1862023612313344/t356482285584(356482285584) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773109 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773174.119275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612312832:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:3.0:1775773174.119295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612313344:192.168.201.137@tcp:36:rm.0 00000100:00080000:3.0:1775773174.125720:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0a31180 x1862023612313344/t356482285584(356482285584) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773204 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.125775:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1775773174.125777:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285581 gen 1 00000100:00100000:3.0:1775773174.125783:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773204 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.125790:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 356482285581 last 356482285584 00000100:00080000:3.0:1775773174.125796:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0a32680 x1862023612315520/t356482285585(356482285585) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773155 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773174.125808:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612313344:192.168.201.137@tcp:36:rm.0 00000100:00100000:3.0:1775773174.125826:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612315520:192.168.201.137@tcp:36:mcreate.0 00000100:00080000:3.0:1775773174.131711:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0a32680 x1862023612315520/t356482285585(356482285585) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773204 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.131755:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1775773174.131942:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285581 gen 1 00000100:00100000:3.0:1775773174.131950:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773204 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773174.131958:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 356482285581 last 356482285585 00000100:00080000:3.0:1775773174.131966:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1c5680380 x1862023612316032/t356482285586(356482285586) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773155 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773174.131975:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612315520:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:2.0:1775773174.132060:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612316032:192.168.201.137@tcp:36:rm.0 00000100:00080000:2.0:1775773174.135795:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1c5680380 x1862023612316032/t356482285586(356482285586) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773204 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773174.135807:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1775773174.135810:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285581 gen 1 00000100:00100000:2.0:1775773174.135815:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1c7027800 x1862023612312832/t356482285583(356482285583) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773204 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773174.135822:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 356482285581 last 356482285586 00000100:00080000:2.0:1775773174.135826:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1775773174.136358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612316032:192.168.201.137@tcp:36:rm.0 00010000:00080000:2.0:1775773174.136436:0:167523:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-mdc-ffff8de1e006a000 to lustre-MDT0000_UUID@192.168.201.137@tcp 00010000:00010000:2.0:1775773174.136441:0:167523:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-mdc-ffff8de1e006a000 (1) 00010000:00010000:2.0:1775773174.136495:0:167523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445eb16 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x3797d62297daab37 expref: -99 pid: 166704 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773174.136558:0:167523:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-mdc-ffff8de1e006a000 00000100:00080000:2.0:1775773174.137128:0:167523:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1775773174.137214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612324224:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000100:00100000:2.0:1775773174.160121:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 356482285586 gen 1 00000100:00080000:2.0:1775773174.160175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1775773174.160188:0:2401:0:(client.c:3204:ptlrpc_resend_req()) @@@ going to resend req@ffff8de1c5682d80 x1862023612324224/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773204 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773174.160198:0:2401:0:(client.c:3213:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8de1c5682d80 x1862023612324224/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773204 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773174.160206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1775773174.160661:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00080000:0.0:1775773174.160667:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 000000007e2facf3): req@ffff8de1d0e77100 x1862023612323328/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/1152 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1775773174.160683:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612324224:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000100:00100000:3.0:1775773174.160830:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773174.170984:0:167505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612323328:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773174.171010:0:167505:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171021:0:167505:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171032:0:167505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171043:0:167505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171060:0:167505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171068:0:167505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171075:0:167505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773174.171085:0:167505:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0e77100 x1862023612323328/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773190 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773174.171098:0:167505:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171108:0:167505:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775773174.171114:0:167505:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773174.171577:0:167505:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:3.0:1775773174.171588:0:167505:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:3.0:1775773174.171594:0:167505:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773174.171597:0:167505:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c0dd3cb8 00010000:00010000:3.0:1775773174.171600:0:167505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773174.171610:0:167505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1775773174.181673:0:167505:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775773174.181684:0:167505:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773174.181707:0:167505:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773174.181957:0:167505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773174.181976:0:167505:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773174.181991:0:167505:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773174.181999:0:167505:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773174.182002:0:167505:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773174.182010:0:167505:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c0dd3cb8 00010000:00010000:0.0:1775773174.182013:0:167505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773174.182022:0:167505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775773174.182550:0:167505:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773174.182562:0:167505:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773174.182571:0:167505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773174.182580:0:167505:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775773174.182586:0:167505:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773174.182590:0:167505:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773174.182593:0:167505:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773174.182596:0:167505:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c0dd3bb0 00010000:00010000:0.0:1775773174.182599:0:167505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773174.182606:0:167505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775773174.182616:0:167505:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775773174.182624:0:167505:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775773174.182995:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:0.0:1775773174.183012:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660d400 uarg=0000000000000000 00800000:00000004:0.0:1775773174.183018:0:167505:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9077, max_age 9150 00000100:00100000:0.0:1775773174.183061:0:167505:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612324352:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775773174.183239:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c31f6840 going to sleep for 25 seconds 00000100:00100000:2.0:1775773174.192636:0:167505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612324352:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773174.192664:0:167505:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317249/353529 objects 1023640/1024000 00000080:00200080:2.0:1775773174.193042:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.193061:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00800000:00000004:2.0:1775773174.193068:0:167505:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9077, max_age 9150 00000100:00100000:2.0:1775773174.193107:0:167505:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612324480:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773174.193201:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 25 seconds 00010000:00080000:2.0:1775773174.197997:0:167505:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c5680380 x1862023612324480/t0(0) o41->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 1775773204 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773174.198018:0:167505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612324480:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773174.198044:0:167505:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317340/353529 objects 1023720/1024000 00000080:00200080:2.0:1775773174.198108:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201791:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201831:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201837:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201843:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201846:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201850:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201853:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201857:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201861:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201864:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201868:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201872:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201875:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201879:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201883:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201887:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201890:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201894:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201897:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201901:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201905:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201908:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201912:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201917:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201920:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201924:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201928:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201932:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201935:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201940:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201943:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201947:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201950:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201954:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201958:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201962:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201965:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201970:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201973:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201977:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201981:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201984:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201988:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.201992:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.201996:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202000:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202003:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202007:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202011:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202015:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202019:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202024:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202028:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202032:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202036:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202039:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202043:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202047:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202050:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202054:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202058:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202062:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202066:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202069:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202073:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202077:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202080:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202084:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202088:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202092:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202095:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202099:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202103:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202107:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202111:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202115:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202119:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202123:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202126:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202130:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202134:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202138:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202141:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202145:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202149:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202164:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202168:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202174:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202177:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202181:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202185:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202189:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202192:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202197:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202200:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202204:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202208:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202212:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202216:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202220:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202223:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202227:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202231:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202235:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202239:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202243:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202245:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202249:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202252:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202256:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202259:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202262:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202265:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202268:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202271:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202274:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202277:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202281:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202284:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202288:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202292:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202296:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202299:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202303:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00800000:00000080:2.0:1775773174.202307:0:167505:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.202311:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.202317:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00020000:00000004:2.0:1775773174.202334:0:167505:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9077, max_age 9150 00000100:00080000:2.0:1775773174.202353:0:167505:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9048 00000100:00080000:2.0:1775773174.202368:0:167505:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773174.202380:0:167505:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:2.0:1775773174.202407:0:167505:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612324608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773174.202460:0:167505:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c5680380 x1862023612324736/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773174.202470:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 0 seconds 00000100:00100000:1.0:1775773174.203068:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612324608:192.168.201.137@tcp:8:lfs.0 00000100:00100000:0.0:1775773174.212168:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 38654705666 gen 6 00000100:00080000:0.0:1775773174.212185:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8de1e006a000: connect to target with instance 9 00000100:00080000:0.0:1775773174.212195:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:0.0:1775773174.212206:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:0.0:1775773174.212212:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:0.0:1775773174.212217:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1775773174.212221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000080:00000004:0.0:1775773174.212227:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:0.0:1775773174.212229:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:0.0:1775773174.212241:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 000000002a977ad8): req@ffff8de1c5680380 x1862023612324736/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773174.212267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612324608:192.168.201.137@tcp:8:lfs.0 00000100:00100000:2.0:1775773174.212868:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773174.222224:0:167505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612324736:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773174.222254:0:167505:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:2.0:1775773174.222337:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.222354:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00020000:00000004:2.0:1775773174.222360:0:167505:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9077, max_age 9150 00000100:00080000:2.0:1775773174.222372:0:167505:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9048 00000100:00080000:2.0:1775773174.222383:0:167505:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773174.222394:0:167505:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:2.0:1775773174.222419:0:167505:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612324864/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773174.222465:0:167505:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c5680380 x1862023612324992/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773174.222474:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 0 seconds 00000100:00100000:0.0:1775773174.222775:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612324864:192.168.201.137@tcp:8:lfs.0 00000100:00100000:0.0:1775773174.228405:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1e006a000: committing for last_committed 0 gen 6 00000100:00080000:0.0:1775773174.228420:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8de1e006a000: connect to target with instance 1 00000100:00080000:0.0:1775773174.228429:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:0.0:1775773174.228441:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:0.0:1775773174.228446:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:0.0:1775773174.228451:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1775773174.228455:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000080:00000004:0.0:1775773174.228462:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:0.0:1775773174.228464:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:0.0:1775773174.228475:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 000000002a977ad8): req@ffff8de1c5680380 x1862023612324992/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773174.228501:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612324864:192.168.201.137@tcp:8:lfs.0 00000100:00100000:2.0:1775773174.228668:0:167505:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773174.235837:0:167505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:167505:1862023612324992:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773174.236099:0:167505:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:2.0:1775773174.236167:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236184:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236191:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236195:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236199:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236203:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236207:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236211:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236215:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236218:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236223:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236226:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236230:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236234:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236237:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236241:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236244:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236247:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236251:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236254:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236258:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236261:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236265:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236268:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236272:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236275:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236278:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236281:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236284:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236287:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236291:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236294:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236297:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236301:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236304:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236308:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236312:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236316:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236319:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236334:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236341:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236344:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236348:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236352:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236356:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236360:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236364:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236367:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236370:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236373:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236376:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236379:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236383:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236385:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236388:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236391:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236394:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236397:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236400:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236403:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236406:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236409:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236412:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236415:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236418:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236421:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236424:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236427:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236431:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236434:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236437:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236440:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236444:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236446:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236450:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236452:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236456:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236459:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236462:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236465:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236468:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236471:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236475:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236478:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236481:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236484:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236488:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236491:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236495:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236499:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236502:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236506:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236509:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236513:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236517:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236521:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236524:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236528:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236531:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236535:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236539:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236542:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236545:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236549:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236552:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236555:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236559:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236562:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236566:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236569:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236572:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236575:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236578:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236581:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236585:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236587:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236591:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236594:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236598:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236601:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236605:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236607:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236611:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236615:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200080:2.0:1775773174.236619:0:167505:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc709fa8d0 00020000:00000080:2.0:1775773174.236622:0:167505:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0ac00 uarg=0000000000000000 00000080:00200008:2.0:1775773174.236635:0:167505:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00010000:00010000:2.0:1775773174.532026:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773175.554527:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773176.576883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773177.604086:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775773178.376566:0:167773:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 00010000:00010000:3.0:1775773178.625306:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773179.206896:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612325120:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.206994:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325376:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.207022:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325632:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.207063:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1775773179.207070:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325248:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.207096:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325504:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.210062:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325504:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.210084:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612325120:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773179.210094:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325632:192.168.201.137@tcp:400:kworker.0 00010000:00080000:3.0:1775773179.211491:0:2404:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c5683b80 x1862023612325376/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773179.211508:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325376:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773179.211758:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612325248:192.168.201.137@tcp:400:kworker.0 00010000:00010000:0.0:1775773179.649038:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775773180.171612:0:167929:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1775773180.672007:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773181.698342:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1775773181.735357:0:168073:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1775773182.722038:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:0.0:1775773183.630771:0:168111:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775773183.631169:0:168111:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773183.631197:0:168111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773183.631216:0:168111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775773183.631231:0:168111:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1775773183.631240:0:168111:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773183.631247:0:168111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773183.631250:0:168111:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773183.631258:0:168111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c0dd3cb8 00010000:00010000:0.0:1775773183.631262:0:168111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775773183.631270:0:168111:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1775773183.634312:0:168111:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1775773183.634321:0:168111:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773183.634343:0:168111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773183.634358:0:168111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775773183.634372:0:168111:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1775773183.634380:0:168111:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773183.634387:0:168111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773183.634390:0:168111:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773183.634396:0:168111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c0dd3cb8 00010000:00010000:0.0:1775773183.634400:0:168111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1775773183.634408:0:168111:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775773183.634530:0:168111:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773183.634539:0:168111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773183.634547:0:168111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775773183.634556:0:168111:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1775773183.634562:0:168111:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773183.634566:0:168111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773183.634568:0:168111:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773183.634572:0:168111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c0dd3bb0 00010000:00010000:0.0:1775773183.634575:0:168111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775773183.634582:0:168111:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1775773183.634591:0:168111:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:0.0:1775773183.634599:0:168111:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:0.0:1775773183.634761:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:0.0:1775773183.634782:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660d800 uarg=0000000000000000 00800000:00000004:0.0:1775773183.634887:0:168111:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9151, max_age 9159 00000100:00100000:0.0:1775773183.634935:0:168111:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612325760:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775773183.635033:0:168111:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.639022:0:168111:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612325760:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773183.639048:0:168111:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317249/353529 objects 1023642/1024000 00000080:00200080:2.0:1775773183.639127:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.639145:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00800000:00000004:2.0:1775773183.639152:0:168111:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9151, max_age 9159 00000100:00100000:2.0:1775773183.639199:0:168111:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612325888:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773183.639282:0:168111:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d840 going to sleep for 11 seconds 00010000:00080000:2.0:1775773183.643505:0:168111:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1c5682a00 x1862023612325888/t0(0) o41->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/368 e 0 to 0 dl 1775773199 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773183.643532:0:168111:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612325888:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773183.643563:0:168111:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317340/353529 objects 1023720/1024000 00000080:00200080:2.0:1775773183.643665:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643684:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643702:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643707:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643711:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643714:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643718:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643757:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643763:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643766:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643772:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643775:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643779:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643782:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643787:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643790:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643794:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643797:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643801:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643804:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643808:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643811:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643814:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643817:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643821:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643824:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643827:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643830:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643833:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643836:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643839:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643842:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643845:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643847:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643850:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643852:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643855:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643858:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643862:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643866:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643870:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643873:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643877:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643880:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643883:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643886:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643889:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643892:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643895:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643898:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643901:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643904:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643906:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643909:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643912:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643915:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643919:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643921:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643924:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643927:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643930:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643932:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643936:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643939:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643943:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643946:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643950:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643953:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643956:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643958:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643961:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643964:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643967:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643969:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643972:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643975:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643978:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643980:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643983:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643986:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643989:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643991:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.643994:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.643997:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644000:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644002:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644005:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644008:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644011:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644015:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644018:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644022:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644025:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644027:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644031:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644033:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644036:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644039:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644042:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644044:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644047:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644050:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644053:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644056:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644059:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644062:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644065:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644068:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644071:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644074:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644077:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644080:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644083:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644086:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644090:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644093:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644097:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644100:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644103:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644105:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644108:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644111:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644115:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644117:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644120:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00800000:00000080:2.0:1775773183.644123:0:168111:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00000080:00200080:2.0:1775773183.644127:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:2.0:1775773183.644133:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00020000:00000004:2.0:1775773183.644141:0:168111:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9151, max_age 9159 00000100:00100000:2.0:1775773183.644201:0:168111:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612326016:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773183.644301:0:168111:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d840 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.647131:0:168111:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612326016:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773183.647183:0:168111:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00000080:00200080:2.0:1775773183.647250:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:2.0:1775773183.647269:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0e0b400 uarg=0000000000000000 00020000:00000004:2.0:1775773183.647277:0:168111:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9151, max_age 9159 00000100:00100000:2.0:1775773183.647316:0:168111:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612326144:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773183.647391:0:168111:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d840 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.653810:0:168111:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168111:1862023612326144:192.168.201.137@tcp:13:lfs.0 00020000:00000004:3.0:1775773183.653850:0:168111:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00200080:3.0:1775773183.653939:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.653960:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.653967:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.653971:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.653976:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.653980:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.653983:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.653987:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.653990:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.653994:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.653997:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654000:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654003:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654007:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654011:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654015:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654019:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654022:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654025:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654029:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654032:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654035:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654039:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654042:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654044:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654048:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654051:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654055:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654058:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654060:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654064:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654067:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654070:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654072:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654076:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654079:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654082:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654085:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654090:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654093:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654096:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654099:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654103:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654106:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654109:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654112:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654117:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654120:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654124:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654127:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654130:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654134:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654137:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654140:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654144:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654147:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654151:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654154:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654169:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654177:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654182:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654186:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654189:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654194:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654198:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654201:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654205:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654209:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654212:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654216:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654219:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654223:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654226:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654230:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654234:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654237:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654241:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654244:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654248:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654251:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654255:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654258:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654261:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654264:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654267:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654271:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654274:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654277:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654282:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654285:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654288:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654291:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654294:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654297:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654301:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654303:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654307:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654310:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654314:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654317:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654321:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654324:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654328:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654331:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654336:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654339:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654343:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654347:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654351:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654354:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654357:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654360:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654364:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654368:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654372:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654376:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654379:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654383:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654387:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654391:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654395:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654398:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654402:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654406:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200080:3.0:1775773183.654410:0:168111:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc50227360 00020000:00000080:3.0:1775773183.654412:0:168111:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee2c00 uarg=0000000000000000 00000080:00200008:3.0:1775773183.654431:0:168111:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:0.0:1775773183.706584:0:168128:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773183.706626:0:168128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773183.706652:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1775773183.706672:0:168128:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1775773183.706684:0:168128:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773183.706693:0:168128:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773183.706697:0:168128:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773183.706706:0:168128:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1877bf8 00010000:00010000:0.0:1775773183.706710:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1775773183.706720:0:168128:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:0.0:1775773183.706758:0:168128:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773183.706774:0:168128:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=27 00000080:00200000:0.0:1775773183.706781:0:168128:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=0 00000002:00010000:0.0:1775773183.706798:0:168128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80d.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1775773183.706859:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773183.706867:0:168128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773183.706878:0:168128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773183.706909:0:168128:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612326272:192.168.201.137@tcp:101:lfs.0 00000100:00100000:0.0:1775773183.707014:0:168128:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.719675:0:168128:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612326272:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773183.719708:0:168128:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719757:0:168128:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719766:0:168128:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719781:0:168128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719793:0:168128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719808:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719817:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719825:0:168128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.719837:0:168128:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8de1c7026680 x1862023612326272/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.719853:0:168128:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719867:0:168128:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/10 (0 0) 00000080:00200000:2.0:1775773183.719874:0:168128:0:(namei.c:943:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.719910:0:168128:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000080:00200000:2.0:1775773183.719913:0:168128:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xa:0x0](ffff8de1c407f448): rc = 0 00000080:00010000:2.0:1775773183.719920:0:168128:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445eb86 00000080:00010000:2.0:1775773183.719935:0:168128:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:2.0:1775773183.719939:0:168128:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb86 from it ffff9ba1c1877ac8 00010000:00010000:2.0:1775773183.719942:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.719951:0:168128:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.719988:0:168128:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.720020:0:168128:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), file ffff8de1c7d06f00, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1775773183.720027:0:168128:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), intent=open 00000002:00010000:2.0:1775773183.720056:0:168128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xa:0x0], intent: open flags 0304001 00010000:00010000:2.0:1775773183.720113:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.720121:0:168128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.720132:0:168128:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.720139:0:168128:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680380 x1862023612326528/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 656/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.720168:0:168128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.720201:0:168128:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612326528:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773183.721545:0:168128:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.730154:0:168128:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612326528:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773183.730201:0:168128:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730228:0:168128:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730236:0:168128:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730250:0:168128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730261:0:168128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730276:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730284:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730296:0:168128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.730308:0:168128:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=0 req@ffff8de1c5680380 x1862023612326528/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 656/608 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.730321:0:168128:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730332:0:168128:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 9663686441/64 (0 0) 00000002:00010000:2.0:1775773183.730353:0:168128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x240002729:0x40:0x0], intent: open flags 0304001 00010000:00010000:2.0:1775773183.730414:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.730422:0:168128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.730434:0:168128:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.730441:0:168128:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680000 x1862023612326784/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.730449:0:168128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.730472:0:168128:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612326784:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773183.730687:0:168128:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1775773183.744143:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773183.805615:0:168128:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612326784:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773183.805651:0:168128:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805670:0:168128:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805678:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805687:0:168128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 3/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805701:0:168128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 4/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805706:0:168128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c512ee00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773183.805711:0:168128:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 4/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805716:0:168128:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 4/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805747:0:168128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 5/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805756:0:168128:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773183.805764:0:168128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 3/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.805770:0:168128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445eb94 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 168128 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773183.805809:0:168128:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1c5680000 x1862023612326784/t34359738369(34359738369) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773183.805825:0:168128:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680000 x1862023612326784/t34359738369(34359738369) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773183.805900:0:168128:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xa:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773183.805938:0:168128:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x40:0x0], updating i_size 4096 00000080:00200000:3.0:1775773183.805941:0:168128:0:(namei.c:147:ll_iget()) got inode: [0x240002729:0x40:0x0](ffff8de1c40821c8): rc = 0 00000080:00010000:3.0:1775773183.805945:0:168128:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445eb8d 00000080:00010000:3.0:1775773183.805958:0:168128:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00200008:3.0:1775773183.805975:0:168128:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 304000 00000002:00100000:3.0:1775773183.805996:0:168128:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680000 x1862023612326784/t34359738369(34359738369) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773183.806030:0:168128:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb8d from it ffff8de1d2129ba0 00010000:00010000:3.0:1775773183.806034:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.806043:0:168128:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773183.806060:0:168128:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 44 00000080:00200000:3.0:1775773183.806128:0:168128:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773183.806144:0:168128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773183.806487:0:168128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1775773183.806541:0:168128:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1775773183.806550:0:168128:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773183.806557:0:168128:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773183.806561:0:168128:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:3.0:1775773183.806566:0:168128:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1877bf8 00010000:00010000:3.0:1775773183.806569:0:168128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1775773183.806577:0:168128:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:3.0:1775773183.806665:0:168128:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.806677:0:168128:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=24 00000080:00200000:3.0:1775773183.806683:0:168128:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.806687:0:168128:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=264 00000080:00200000:3.0:1775773183.806691:0:168128:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 44 00000080:00200008:3.0:1775773183.806695:0:168128:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 504000 00000080:00200008:3.0:1775773183.806802:0:168128:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 304000 00000080:00200080:3.0:1775773183.806845:0:168128:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8) cmd=800466af arg=7ffc205c08cc 00000080:00200008:3.0:1775773183.806950:0:168128:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 504000 00000002:00100000:3.0:1775773183.807003:0:168128:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5680000 x1862023612326784/t34359738369(34359738369) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773183.807015:0:168128:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773183.807021:0:168128:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77100 x1862023612327040/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773183.807047:0:168128:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612327040:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775773183.807311:0:168128:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1600 going to sleep for 11 seconds 00010000:00080000:3.0:1775773183.811838:0:168128:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0e77100 x1862023612327040/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/456 e 0 to 0 dl 1775773199 ref 2 fl Rpc:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1775773183.811866:0:168128:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168128:1862023612327040:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773183.811900:0:168128:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5680000 x1862023612326784/t34359738369(34359738369) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.844813:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.844857:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.844884:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1775773183.844904:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:2.0:1775773183.844914:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.844925:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.844929:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.844938:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.844943:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1775773183.844953:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:2.0:1775773183.845062:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.845073:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.845080:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.845084:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.845088:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.845105:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.845110:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-0, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.845119:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-0, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.845145:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-0,[0x240002729:0x41:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.845220:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.845235:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.845250:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.845264:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681880 x1862023612327296/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.845540:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.845572:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612327296:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.845792:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.874054:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612327296:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773183.874096:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874136:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874145:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874168:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874181:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874198:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874207:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874216:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773183.874229:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5681880 x1862023612327296/t34359738371(34359738371) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773183.874243:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681880 x1862023612327296/t34359738371(34359738371) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773183.874259:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773183.874274:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874285:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/65 (0 0) 00000080:00200000:3.0:1775773183.874293:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773183.874309:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-0, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:3.0:1775773183.874428:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x41:0x0](ffff8de1c407cb08) 00000080:00200000:3.0:1775773183.874590:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x41:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773183.874601:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x41:0x0](ffff8de1c407cb08) 00000080:00010000:3.0:1775773183.874605:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x41:0x0](ffff8de1c407cb08) for lock 0x8a9f4e958445eb9b 00000080:00010000:3.0:1775773183.874617:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x41:0x0](ffff8de1c407cb08) 00000080:00200008:3.0:1775773183.874638:0:168137:0:(file.c:1057:ll_file_open()) START file f-0:[0x240002729:0x41:0x0](ffff8de1c407cb08), flags 100102 00000002:00100000:3.0:1775773183.874663:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681880 x1862023612327296/t34359738371(34359738371) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773183.874765:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb9b from it ffff8de1d21297e0 00010000:00010000:3.0:1775773183.874771:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.874782:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773183.874808:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x41:0x0](ffff8de1c407cb08), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773183.874842:0:168137:0:(file.c:447:ll_file_release()) START file f-0:[0x240002729:0x41:0x0](ffff8de1c407cb08), flags 100002 00000002:00100000:3.0:1775773183.874890:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5681880 x1862023612327296/t34359738371(34359738371) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773183.874906:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773183.874912:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77100 x1862023612327552/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773183.874936:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612327552:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773183.875030:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1600 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.883204:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612327552:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773183.883254:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5681880 x1862023612327296/t34359738371(34359738371) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.883476:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.883501:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.883524:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:2.0:1775773183.883540:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:2.0:1775773183.883550:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.883556:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.883560:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.883569:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.883574:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:2.0:1775773183.883583:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:2.0:1775773183.883601:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.883609:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.883617:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.883621:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.883625:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.883640:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.883645:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-1, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.883655:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-1, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.883678:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-1,[0x240002729:0x42:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.883956:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.883966:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.883979:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.883987:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680e00 x1862023612327808/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.883998:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.884024:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612327808:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.884256:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.903415:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612327808:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773183.903451:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903488:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903496:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903509:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903520:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903534:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903542:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903549:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.903561:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5680e00 x1862023612327808/t34359738373(34359738373) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773183.903575:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680e00 x1862023612327808/t34359738373(34359738373) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.903591:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773183.903604:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.903615:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/66 (0 0) 00000080:00200000:2.0:1775773183.903623:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.903639:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-1, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773183.904426:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x42:0x0](ffff8de1c4081148) 00000080:00200000:2.0:1775773183.904595:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x42:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773183.904607:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x42:0x0](ffff8de1c4081148) 00000080:00010000:2.0:1775773183.904610:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x42:0x0](ffff8de1c4081148) for lock 0x8a9f4e958445eba2 00000080:00010000:2.0:1775773183.904622:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x42:0x0](ffff8de1c4081148) 00000080:00200008:2.0:1775773183.904639:0:168137:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x42:0x0](ffff8de1c4081148), flags 100102 00000002:00100000:2.0:1775773183.904673:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680e00 x1862023612327808/t34359738373(34359738373) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773183.904795:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eba2 from it ffff8de1d2129360 00010000:00010000:2.0:1775773183.904802:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.904815:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.904855:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x42:0x0](ffff8de1c4081148), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773183.904896:0:168137:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x42:0x0](ffff8de1c4081148), flags 100002 00000002:00100000:2.0:1775773183.904953:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5680e00 x1862023612327808/t34359738373(34359738373) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773183.904966:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773183.905584:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5683800 x1862023612328064/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773183.905623:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328064:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773183.905915:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.909886:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328064:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773183.909933:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5680e00 x1862023612327808/t34359738373(34359738373) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.910689:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.910719:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.910963:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:2.0:1775773183.911128:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:2.0:1775773183.911138:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.911148:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.911152:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.911172:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.911178:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:2.0:1775773183.911189:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00000080:00200000:2.0:1775773183.911210:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.911222:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.911230:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.911234:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.911238:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.911256:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.911260:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-2, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.911351:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-2, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.911381:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-2,[0x240002729:0x43:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.911453:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.911462:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.911477:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.911490:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681500 x1862023612328320/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.911501:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.911529:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328320:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.911830:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.916287:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328320:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773183.916324:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916363:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916372:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916386:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916398:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916415:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916424:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916432:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.916446:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5681500 x1862023612328320/t34359738375(34359738375) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773183.916460:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681500 x1862023612328320/t34359738375(34359738375) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.916475:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773183.916490:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916501:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/67 (0 0) 00000080:00200000:2.0:1775773183.916519:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.916537:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-2, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773183.916578:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x43:0x0](ffff8de1c4086c08) 00000080:00200000:2.0:1775773183.916770:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x43:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773183.916781:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x43:0x0](ffff8de1c4086c08) 00000080:00010000:2.0:1775773183.916784:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x43:0x0](ffff8de1c4086c08) for lock 0x8a9f4e958445eba9 00000080:00010000:2.0:1775773183.916796:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x43:0x0](ffff8de1c4086c08) 00000080:00200008:2.0:1775773183.916812:0:168137:0:(file.c:1057:ll_file_open()) START file f-2:[0x240002729:0x43:0x0](ffff8de1c4086c08), flags 100102 00000002:00100000:2.0:1775773183.916833:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681500 x1862023612328320/t34359738375(34359738375) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773183.916880:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eba9 from it ffff8de1d2129360 00010000:00010000:2.0:1775773183.916885:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.916895:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.916925:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x43:0x0](ffff8de1c4086c08), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773183.916960:0:168137:0:(file.c:447:ll_file_release()) START file f-2:[0x240002729:0x43:0x0](ffff8de1c4086c08), flags 100002 00000002:00100000:2.0:1775773183.917010:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5681500 x1862023612328320/t34359738375(34359738375) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773183.917021:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773183.917026:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5683480 x1862023612328576/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773183.917057:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328576:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773183.917140:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.922305:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328576:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773183.922352:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5681500 x1862023612328320/t34359738375(34359738375) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.922447:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.922468:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.922491:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00010000:00010000:2.0:1775773183.922508:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00000080:00200000:2.0:1775773183.922529:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.922536:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.922540:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.922548:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.922555:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00010000:00010000:2.0:1775773183.922565:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:2.0:1775773183.922584:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.922591:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.922597:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.922602:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.922605:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.922620:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.922625:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-3, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.922635:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-3, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.922659:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-3,[0x240002729:0x44:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.922768:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.922779:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.922792:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.922799:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680000 x1862023612328832/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.922810:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.922833:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328832:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.922988:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.928347:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612328832:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773183.928387:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928427:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928437:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928451:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928463:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928479:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928489:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928497:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.928525:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5680000 x1862023612328832/t34359738377(34359738377) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773183.928542:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680000 x1862023612328832/t34359738377(34359738377) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.928560:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773183.928575:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.928588:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/68 (0 0) 00000080:00200000:2.0:1775773183.928596:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.928614:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-3, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773183.928650:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x44:0x0](ffff8de1c4085b88) 00000080:00200000:2.0:1775773183.928951:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x44:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773183.928963:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x44:0x0](ffff8de1c4085b88) 00000080:00010000:2.0:1775773183.928967:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x44:0x0](ffff8de1c4085b88) for lock 0x8a9f4e958445ebb0 00000080:00010000:2.0:1775773183.928979:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x44:0x0](ffff8de1c4085b88) 00000080:00200008:2.0:1775773183.929007:0:168137:0:(file.c:1057:ll_file_open()) START file f-3:[0x240002729:0x44:0x0](ffff8de1c4085b88), flags 100102 00000002:00100000:2.0:1775773183.929033:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680000 x1862023612328832/t34359738377(34359738377) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773183.929091:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebb0 from it ffff8de1d2129360 00010000:00010000:2.0:1775773183.929097:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.929108:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.929138:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x44:0x0](ffff8de1c4085b88), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773183.929186:0:168137:0:(file.c:447:ll_file_release()) START file f-3:[0x240002729:0x44:0x0](ffff8de1c4085b88), flags 100002 00000002:00100000:2.0:1775773183.929240:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5680000 x1862023612328832/t34359738377(34359738377) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773183.929251:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773183.929257:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680380 x1862023612329088/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773183.929284:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329088:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773183.929394:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517db40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.933221:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329088:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773183.933282:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5680000 x1862023612328832/t34359738377(34359738377) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.933382:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.933405:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.933429:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:2.0:1775773183.933447:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:2.0:1775773183.933456:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.933462:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.933467:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.933475:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.933481:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:2.0:1775773183.933490:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:2.0:1775773183.933507:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.933516:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.933522:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.933526:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.933530:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.933546:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.933551:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-4, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.933560:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-4, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.933584:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-4,[0x240002729:0x45:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.933645:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.933655:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.933667:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.933673:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682a00 x1862023612329344/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.933684:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.933707:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329344:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.933909:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517db40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.939550:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329344:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773183.939588:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939625:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939633:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939647:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939659:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939674:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939683:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939690:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.939702:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5682a00 x1862023612329344/t34359738379(34359738379) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773183.939717:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5682a00 x1862023612329344/t34359738379(34359738379) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.939791:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773183.939805:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.939816:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/69 (0 0) 00000080:00200000:2.0:1775773183.939823:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.939839:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-4, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773183.939877:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x45:0x0](ffff8de1c40863c8) 00000080:00200000:2.0:1775773183.940250:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x45:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773183.940264:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x45:0x0](ffff8de1c40863c8) 00000080:00010000:2.0:1775773183.940268:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x45:0x0](ffff8de1c40863c8) for lock 0x8a9f4e958445ebb7 00000080:00010000:2.0:1775773183.940438:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x45:0x0](ffff8de1c40863c8) 00000080:00200008:2.0:1775773183.940456:0:168137:0:(file.c:1057:ll_file_open()) START file f-4:[0x240002729:0x45:0x0](ffff8de1c40863c8), flags 100102 00000002:00100000:2.0:1775773183.940484:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5682a00 x1862023612329344/t34359738379(34359738379) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773183.940708:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebb7 from it ffff8de1d2129360 00010000:00010000:2.0:1775773183.940714:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.940756:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.940789:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x45:0x0](ffff8de1c40863c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773183.940828:0:168137:0:(file.c:447:ll_file_release()) START file f-4:[0x240002729:0x45:0x0](ffff8de1c40863c8), flags 100002 00000002:00100000:2.0:1775773183.940889:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5682a00 x1862023612329344/t34359738379(34359738379) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773183.940901:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773183.940907:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681c00 x1862023612329600/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773183.940934:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329600:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773183.941468:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517da80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.945083:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329600:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773183.945130:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5682a00 x1862023612329344/t34359738379(34359738379) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.945239:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.945265:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.945299:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:2.0:1775773183.945317:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:2.0:1775773183.945327:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.945333:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.945338:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.945347:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.945352:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:2.0:1775773183.945362:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:2.0:1775773183.945381:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.945391:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.945399:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.945403:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.945407:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.945427:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.945432:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-5, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.945442:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-5, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.945471:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-5,[0x240002729:0x46:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.945538:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.945547:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.945560:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.945566:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5683b80 x1862023612329856/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.945576:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.945600:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329856:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.945833:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517da80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.951062:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612329856:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773183.951099:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951137:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 4/0,1 mode: --/PR res: [0x240002729:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951146:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 4/0,1 mode: --/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951170:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951183:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951199:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951208:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951215:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.951228:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5683b80 x1862023612329856/t34359738381(34359738381) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773183.951241:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5683b80 x1862023612329856/t34359738381(34359738381) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.951255:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773183.951372:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.951387:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/70 (0 0) 00000080:00200000:2.0:1775773183.951395:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.951414:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-5, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773183.951454:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x46:0x0](ffff8de1c4081988) 00000080:00200000:2.0:1775773183.951709:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x46:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773183.951721:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x46:0x0](ffff8de1c4081988) 00000080:00010000:2.0:1775773183.952014:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x46:0x0](ffff8de1c4081988) for lock 0x8a9f4e958445ebbe 00000080:00010000:2.0:1775773183.952027:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x46:0x0](ffff8de1c4081988) 00000080:00200008:2.0:1775773183.952045:0:168137:0:(file.c:1057:ll_file_open()) START file f-5:[0x240002729:0x46:0x0](ffff8de1c4081988), flags 100102 00000002:00100000:2.0:1775773183.952076:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5683b80 x1862023612329856/t34359738381(34359738381) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773183.952128:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebbe from it ffff8de1d2129360 00010000:00010000:2.0:1775773183.952134:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.952146:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.952192:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x46:0x0](ffff8de1c4081988), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773183.952233:0:168137:0:(file.c:447:ll_file_release()) START file f-5:[0x240002729:0x46:0x0](ffff8de1c4081988), flags 100002 00000002:00100000:2.0:1775773183.952370:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5683b80 x1862023612329856/t34359738381(34359738381) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773183.952383:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773183.952389:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681f80 x1862023612330112/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773183.952417:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330112:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773183.952536:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.957021:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330112:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773183.957069:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5683b80 x1862023612329856/t34359738381(34359738381) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773183.957182:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773183.957207:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773183.957230:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:2.0:1775773183.957248:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:2.0:1775773183.957258:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773183.957264:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773183.957269:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773183.957627:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773183.957632:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:2.0:1775773183.957643:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:2.0:1775773183.957660:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.957670:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773183.957677:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.957681:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773183.957684:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773183.957701:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773183.957706:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-6, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85980, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773183.957715:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-6, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773183.957775:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-6,[0x240002729:0x47:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773183.957844:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.957854:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773183.957866:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773183.957875:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682300 x1862023612330368/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773183.957885:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773183.957909:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330368:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773183.958931:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773183.964466:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330368:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773183.964502:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964672:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964681:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964695:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964708:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964747:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964758:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964766:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773183.964780:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5682300 x1862023612330368/t34359738383(34359738383) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773183.964796:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5682300 x1862023612330368/t34359738383(34359738383) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773183.964812:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773183.964828:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.964841:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/71 (0 0) 00000080:00200000:2.0:1775773183.964849:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773183.964868:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-6, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773183.964905:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x47:0x0](ffff8de1c4085348) 00000080:00200000:2.0:1775773183.965248:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x47:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773183.965261:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x47:0x0](ffff8de1c4085348) 00000080:00010000:2.0:1775773183.965265:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x47:0x0](ffff8de1c4085348) for lock 0x8a9f4e958445ebc5 00000080:00010000:2.0:1775773183.965375:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x47:0x0](ffff8de1c4085348) 00000080:00200008:2.0:1775773183.965395:0:168137:0:(file.c:1057:ll_file_open()) START file f-6:[0x240002729:0x47:0x0](ffff8de1c4085348), flags 100102 00000002:00100000:2.0:1775773183.965425:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5682300 x1862023612330368/t34359738383(34359738383) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773183.965479:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebc5 from it ffff8de1d2129360 00010000:00010000:2.0:1775773183.965485:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773183.965498:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773183.965632:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x47:0x0](ffff8de1c4085348), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773183.965671:0:168137:0:(file.c:447:ll_file_release()) START file f-6:[0x240002729:0x47:0x0](ffff8de1c4085348), flags 100002 00000002:00100000:2.0:1775773183.965844:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5682300 x1862023612330368/t34359738383(34359738383) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773183.965857:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773183.965863:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682d80 x1862023612330624/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773183.966070:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330624:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773183.966245:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052600 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.976444:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330624:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773183.976487:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5682300 x1862023612330368/t34359738383(34359738383) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773183.976643:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773183.976666:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773183.976690:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:3.0:1775773183.976707:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:3.0:1775773183.976717:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773183.976796:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773183.976801:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:3.0:1775773183.976810:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:3.0:1775773183.976815:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:3.0:1775773183.976826:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:3.0:1775773183.976845:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.976852:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:3.0:1775773183.976858:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.976862:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773183.976865:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.976882:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773183.976887:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-7, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1d8640480, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773183.976895:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-7, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:3.0:1775773183.976918:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-7,[0x240002729:0x48:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773183.977105:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.977114:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773183.977127:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773183.977134:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75880 x1862023612330880/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773183.977144:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773183.977182:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330880:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773183.977576:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.983117:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612330880:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773183.983150:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983202:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 4/0,1 mode: --/PR res: [0x240002729:0x48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983212:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 4/0,1 mode: --/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983225:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983237:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983253:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983263:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983280:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773183.983292:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e75880 x1862023612330880/t34359738385(34359738385) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773183.983307:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75880 x1862023612330880/t34359738385(34359738385) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773183.983322:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773183.983338:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983350:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/72 (0 0) 00000080:00200000:3.0:1775773183.983358:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773183.983376:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-7, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:3.0:1775773183.983410:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x48:0x0](ffff8de1c407aa08) 00000080:00200000:3.0:1775773183.983578:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x48:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773183.983589:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x48:0x0](ffff8de1c407aa08) 00000080:00010000:3.0:1775773183.983592:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x48:0x0](ffff8de1c407aa08) for lock 0x8a9f4e958445ebcc 00000080:00010000:3.0:1775773183.983604:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x48:0x0](ffff8de1c407aa08) 00000080:00200008:3.0:1775773183.983621:0:168137:0:(file.c:1057:ll_file_open()) START file f-7:[0x240002729:0x48:0x0](ffff8de1c407aa08), flags 100102 00000002:00100000:3.0:1775773183.983644:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75880 x1862023612330880/t34359738385(34359738385) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773183.983695:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebcc from it ffff8de1c9687b40 00010000:00010000:3.0:1775773183.983700:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.983710:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773183.983761:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x48:0x0](ffff8de1c407aa08), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773183.983800:0:168137:0:(file.c:447:ll_file_release()) START file f-7:[0x240002729:0x48:0x0](ffff8de1c407aa08), flags 100002 00000002:00100000:3.0:1775773183.983852:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e75880 x1862023612330880/t34359738385(34359738385) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773183.983868:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773183.983873:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75c00 x1862023612331136/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773183.983898:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331136:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773183.985365:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.988840:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331136:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773183.988886:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75880 x1862023612330880/t34359738385(34359738385) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773183.988995:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773183.989017:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773183.989039:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:3.0:1775773183.989055:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:3.0:1775773183.989064:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773183.989071:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773183.989074:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:3.0:1775773183.989082:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:3.0:1775773183.989086:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:3.0:1775773183.989095:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:3.0:1775773183.989113:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.989122:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:3.0:1775773183.989129:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.989133:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773183.989137:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.989167:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773183.989173:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-8, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1d8641e00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773183.989183:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-8, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:3.0:1775773183.989209:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-8,[0x240002729:0x49:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773183.989426:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.989436:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773183.989449:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773183.989457:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612331392/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773183.989467:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773183.989491:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331392:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773183.989660:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.994426:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331392:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773183.994461:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994499:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994508:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994677:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994690:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994705:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994714:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994753:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773183.994766:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e76d80 x1862023612331392/t34359738387(34359738387) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773183.994779:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76d80 x1862023612331392/t34359738387(34359738387) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773183.994797:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773183.994815:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.994828:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/73 (0 0) 00000080:00200000:3.0:1775773183.994836:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773183.994853:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-8, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:3.0:1775773183.994895:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x49:0x0](ffff8de1c4078908) 00000080:00200000:3.0:1775773183.995219:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x49:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773183.995232:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x49:0x0](ffff8de1c4078908) 00000080:00010000:3.0:1775773183.995236:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x49:0x0](ffff8de1c4078908) for lock 0x8a9f4e958445ebd3 00000080:00010000:3.0:1775773183.995249:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x49:0x0](ffff8de1c4078908) 00000080:00200008:3.0:1775773183.995266:0:168137:0:(file.c:1057:ll_file_open()) START file f-8:[0x240002729:0x49:0x0](ffff8de1c4078908), flags 100102 00000002:00100000:3.0:1775773183.995387:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76d80 x1862023612331392/t34359738387(34359738387) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773183.995439:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebd3 from it ffff8de1c9687b40 00010000:00010000:3.0:1775773183.995444:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.995455:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773183.995480:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x49:0x0](ffff8de1c4078908), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773183.995641:0:168137:0:(file.c:447:ll_file_release()) START file f-8:[0x240002729:0x49:0x0](ffff8de1c4078908), flags 100002 00000002:00100000:3.0:1775773183.995697:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e76d80 x1862023612331392/t34359738387(34359738387) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773183.995715:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773183.995720:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76680 x1862023612331648/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773183.995778:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331648:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773183.995952:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1775773183.999538:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331648:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773183.999582:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e76d80 x1862023612331392/t34359738387(34359738387) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773183.999668:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773183.999689:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773183.999711:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:3.0:1775773183.999753:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:3.0:1775773183.999762:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773183.999768:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773183.999772:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:3.0:1775773183.999779:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:3.0:1775773183.999783:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:3.0:1775773183.999793:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:3.0:1775773183.999810:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.999818:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:3.0:1775773183.999824:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.999828:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773183.999832:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773183.999848:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:3.0:1775773183.999854:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-9, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1d8640900, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773183.999862:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-9, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:3.0:1775773183.999885:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-9,[0x240002729:0x4a:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773183.999945:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773183.999953:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773183.999966:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773183.999982:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e74700 x1862023612331904/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773183.999992:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773184.000015:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331904:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773184.000186:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1775773184.004846:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612331904:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773184.004880:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004917:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004926:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004940:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004951:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004966:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004990:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.004997:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773184.005009:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e74700 x1862023612331904/t34359738389(34359738389) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773184.005023:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e74700 x1862023612331904/t34359738389(34359738389) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773184.005038:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773184.005053:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.005064:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/74 (0 0) 00000080:00200000:3.0:1775773184.005071:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773184.005087:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-9, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:3.0:1775773184.005128:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x4a:0x0](ffff8de1c407c2c8) 00000080:00200000:0.0:1775773184.005698:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x4a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773184.005719:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x4a:0x0](ffff8de1c407c2c8) 00000080:00010000:0.0:1775773184.005756:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x4a:0x0](ffff8de1c407c2c8) for lock 0x8a9f4e958445ebda 00000080:00010000:0.0:1775773184.005769:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x4a:0x0](ffff8de1c407c2c8) 00000080:00200008:0.0:1775773184.005787:0:168137:0:(file.c:1057:ll_file_open()) START file f-9:[0x240002729:0x4a:0x0](ffff8de1c407c2c8), flags 100102 00000002:00100000:0.0:1775773184.005816:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e74700 x1862023612331904/t34359738389(34359738389) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773184.005867:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebda from it ffff8de1c7cee240 00010000:00010000:0.0:1775773184.005873:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.005884:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773184.005911:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x4a:0x0](ffff8de1c407c2c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773184.005948:0:168137:0:(file.c:447:ll_file_release()) START file f-9:[0x240002729:0x4a:0x0](ffff8de1c407c2c8), flags 100002 00000002:00100000:0.0:1775773184.006015:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e74700 x1862023612331904/t34359738389(34359738389) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773184.006027:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773184.006032:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027480 x1862023612332160/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773184.006060:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332160:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773184.006603:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052e40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.009801:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332160:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.009848:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e74700 x1862023612331904/t34359738389(34359738389) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773199 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.009951:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.009976:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.010008:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:2.0:1775773184.010025:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:2.0:1775773184.010035:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.010042:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.010046:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.010055:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.010059:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:2.0:1775773184.010074:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:2.0:1775773184.010092:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.010100:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.010107:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.010112:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.010115:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.010130:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.010135:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-10, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.010144:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-10, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.010182:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-10,[0x240002729:0x4b:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.010247:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.010256:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.010480:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.010489:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680700 x1862023612332416/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.010501:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.010635:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332416:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.011305:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.016381:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332416:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.016415:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016454:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016464:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016477:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016489:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016504:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016573:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016580:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.016593:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5680700 x1862023612332416/t34359738391(34359738391) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.016607:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680700 x1862023612332416/t34359738391(34359738391) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.016624:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.016638:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.016650:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/75 (0 0) 00000080:00200000:2.0:1775773184.016659:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.016680:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-10, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.016816:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x4b:0x0](ffff8de1c4080908) 00000080:00200000:2.0:1775773184.017136:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x4b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.017160:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x4b:0x0](ffff8de1c4080908) 00000080:00010000:2.0:1775773184.017165:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x4b:0x0](ffff8de1c4080908) for lock 0x8a9f4e958445ebe1 00000080:00010000:2.0:1775773184.017177:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x4b:0x0](ffff8de1c4080908) 00000080:00200008:2.0:1775773184.017195:0:168137:0:(file.c:1057:ll_file_open()) START file f-10:[0x240002729:0x4b:0x0](ffff8de1c4080908), flags 100102 00000002:00100000:2.0:1775773184.017222:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680700 x1862023612332416/t34359738391(34359738391) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.017365:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebe1 from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.017371:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.017382:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.017409:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x4b:0x0](ffff8de1c4080908), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.017446:0:168137:0:(file.c:447:ll_file_release()) START file f-10:[0x240002729:0x4b:0x0](ffff8de1c4080908), flags 100002 00000002:00100000:2.0:1775773184.017501:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5680700 x1862023612332416/t34359738391(34359738391) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.017688:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.017695:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682680 x1862023612332672/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.017871:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332672:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.018185:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.022427:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332672:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.022476:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5680700 x1862023612332416/t34359738391(34359738391) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.022585:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.022608:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.022632:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1775773184.022649:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:2.0:1775773184.022657:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.022663:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.022668:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.022675:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.022679:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1775773184.022688:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00000080:00200000:2.0:1775773184.022705:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.022713:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.022720:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.022751:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.022756:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.022773:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.022778:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-11, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84480, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.022787:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-11, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.022810:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-11,[0x240002729:0x4c:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.022871:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.022880:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.022893:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.022900:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5683100 x1862023612332928/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.022910:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.022934:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332928:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.023299:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.027541:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612332928:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.027577:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027614:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027623:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027634:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027646:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027660:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027668:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027675:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.027686:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5683100 x1862023612332928/t34359738393(34359738393) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.027700:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5683100 x1862023612332928/t34359738393(34359738393) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.027715:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.027790:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.027801:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/76 (0 0) 00000080:00200000:2.0:1775773184.027809:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.027826:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-11, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.027867:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x4c:0x0](ffff8de1c4082a08) 00000080:00200000:2.0:1775773184.028349:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x4c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.028362:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x4c:0x0](ffff8de1c4082a08) 00000080:00010000:2.0:1775773184.028366:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x4c:0x0](ffff8de1c4082a08) for lock 0x8a9f4e958445ebe8 00000080:00010000:2.0:1775773184.028379:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x4c:0x0](ffff8de1c4082a08) 00000080:00200008:2.0:1775773184.028398:0:168137:0:(file.c:1057:ll_file_open()) START file f-11:[0x240002729:0x4c:0x0](ffff8de1c4082a08), flags 100102 00000002:00100000:2.0:1775773184.028427:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5683100 x1862023612332928/t34359738393(34359738393) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.028481:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebe8 from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.028486:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.028497:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.028757:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x4c:0x0](ffff8de1c4082a08), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.028798:0:168137:0:(file.c:447:ll_file_release()) START file f-11:[0x240002729:0x4c:0x0](ffff8de1c4082a08), flags 100002 00000002:00100000:2.0:1775773184.028854:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5683100 x1862023612332928/t34359738393(34359738393) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.028872:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.028878:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681180 x1862023612333184/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.028905:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333184:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.029348:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.032377:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333184:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.032426:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5683100 x1862023612332928/t34359738393(34359738393) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.032527:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.032550:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.032574:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00010000:00010000:2.0:1775773184.032592:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00000080:00200000:2.0:1775773184.032601:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.032608:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.032612:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.032619:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.032624:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00010000:00010000:2.0:1775773184.032632:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:2.0:1775773184.032650:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.032658:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.032664:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.032668:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.032672:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.032686:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.032691:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-12, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85b00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.032700:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-12, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.032781:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-12,[0x240002729:0x4d:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.032842:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.032852:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.032864:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.032871:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680a80 x1862023612333440/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.032882:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.032905:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333440:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.033086:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.038867:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333440:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.038902:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.038942:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.038952:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.038966:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.038994:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.039008:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.039017:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.039025:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.039038:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5680a80 x1862023612333440/t34359738395(34359738395) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.039053:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680a80 x1862023612333440/t34359738395(34359738395) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.039068:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.039084:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.039095:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/77 (0 0) 00000080:00200000:2.0:1775773184.039103:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.039120:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-12, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.039164:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x4d:0x0](ffff8de1c40800c8) 00000080:00200000:2.0:1775773184.039389:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x4d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.039401:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x4d:0x0](ffff8de1c40800c8) 00000080:00010000:2.0:1775773184.039404:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x4d:0x0](ffff8de1c40800c8) for lock 0x8a9f4e958445ebef 00000080:00010000:2.0:1775773184.039416:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x4d:0x0](ffff8de1c40800c8) 00000080:00200008:2.0:1775773184.039433:0:168137:0:(file.c:1057:ll_file_open()) START file f-12:[0x240002729:0x4d:0x0](ffff8de1c40800c8), flags 100102 00000002:00100000:2.0:1775773184.039459:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5680a80 x1862023612333440/t34359738395(34359738395) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.039510:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebef from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.039514:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.039525:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.039549:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x4d:0x0](ffff8de1c40800c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.039585:0:168137:0:(file.c:447:ll_file_release()) START file f-12:[0x240002729:0x4d:0x0](ffff8de1c40800c8), flags 100002 00000002:00100000:2.0:1775773184.039639:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5680a80 x1862023612333440/t34359738395(34359738395) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.039656:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.039661:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9ad80 x1862023612333696/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.039686:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333696:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.039837:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.043658:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9ad80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333696:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.043707:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5680a80 x1862023612333440/t34359738395(34359738395) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.043849:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.043874:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.043897:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:2.0:1775773184.043914:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:2.0:1775773184.043925:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.043931:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.043935:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.043945:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.043949:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:2.0:1775773184.043960:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:2.0:1775773184.043998:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.044006:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.044014:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.044019:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.044022:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.044041:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.044046:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-13, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84480, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.044055:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-13, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.044079:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-13,[0x240002729:0x4e:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.044145:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.044166:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.044178:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.044185:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9a680 x1862023612333952/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.044194:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.044219:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333952:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.044386:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.048710:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612333952:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.048801:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048845:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048856:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048871:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048882:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048898:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048907:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.048915:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.048928:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f9a680 x1862023612333952/t34359738397(34359738397) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.048942:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9a680 x1862023612333952/t34359738397(34359738397) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.048958:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.048989:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.049001:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/78 (0 0) 00000080:00200000:2.0:1775773184.049010:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.049027:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-13, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.049072:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x4e:0x0](ffff8de1c40842c8) 00000080:00200000:2.0:1775773184.049251:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x4e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.049262:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x4e:0x0](ffff8de1c40842c8) 00000080:00010000:2.0:1775773184.049266:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x4e:0x0](ffff8de1c40842c8) for lock 0x8a9f4e958445ebf6 00000080:00010000:2.0:1775773184.049277:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x4e:0x0](ffff8de1c40842c8) 00000080:00200008:2.0:1775773184.049294:0:168137:0:(file.c:1057:ll_file_open()) START file f-13:[0x240002729:0x4e:0x0](ffff8de1c40842c8), flags 100102 00000002:00100000:2.0:1775773184.049319:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9a680 x1862023612333952/t34359738397(34359738397) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.049372:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebf6 from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.049377:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.049388:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.049415:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x4e:0x0](ffff8de1c40842c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.049454:0:168137:0:(file.c:447:ll_file_release()) START file f-13:[0x240002729:0x4e:0x0](ffff8de1c40842c8), flags 100002 00000002:00100000:2.0:1775773184.049508:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9a680 x1862023612333952/t34359738397(34359738397) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.049525:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.049530:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9a300 x1862023612334208/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.049557:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334208:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.049649:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.053813:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9a300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334208:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.053862:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9a680 x1862023612333952/t34359738397(34359738397) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.053959:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.054125:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.054148:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:2.0:1775773184.054175:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:2.0:1775773184.054185:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.054192:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.054196:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.054205:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.054209:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:2.0:1775773184.054219:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:2.0:1775773184.054240:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.054250:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.054257:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.054261:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.054264:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.054279:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.054284:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-14, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85b00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.054294:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-14, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.054320:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-14,[0x240002729:0x4f:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.054388:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.054397:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.054410:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.054417:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98700 x1862023612334464/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.054428:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.054456:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334464:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.055394:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.059263:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334464:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.059299:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059337:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059348:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 4/0,1 mode: --/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059363:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059375:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059391:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059400:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059408:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.059422:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f98700 x1862023612334464/t34359738399(34359738399) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.059434:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98700 x1862023612334464/t34359738399(34359738399) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.059447:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.059459:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059468:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/79 (0 0) 00000080:00200000:2.0:1775773184.059474:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.059490:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-14, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.059530:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x4f:0x0](ffff8de1c4083a88) 00000080:00200000:2.0:1775773184.059692:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x4f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.059703:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x4f:0x0](ffff8de1c4083a88) 00000080:00010000:2.0:1775773184.059708:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x4f:0x0](ffff8de1c4083a88) for lock 0x8a9f4e958445ebfd 00000080:00010000:2.0:1775773184.059720:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x4f:0x0](ffff8de1c4083a88) 00000080:00200008:2.0:1775773184.059774:0:168137:0:(file.c:1057:ll_file_open()) START file f-14:[0x240002729:0x4f:0x0](ffff8de1c4083a88), flags 100102 00000002:00100000:2.0:1775773184.059795:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98700 x1862023612334464/t34359738399(34359738399) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.059839:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ebfd from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.059843:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.059850:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.059871:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x4f:0x0](ffff8de1c4083a88), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.059903:0:168137:0:(file.c:447:ll_file_release()) START file f-14:[0x240002729:0x4f:0x0](ffff8de1c4083a88), flags 100002 00000002:00100000:2.0:1775773184.059946:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f98700 x1862023612334464/t34359738399(34359738399) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.059959:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.059962:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98e00 x1862023612334720/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.059999:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334720:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.060091:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.062850:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334720:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.062894:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f98700 x1862023612334464/t34359738399(34359738399) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.062985:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.063012:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.063036:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:2.0:1775773184.063054:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:2.0:1775773184.063062:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.063069:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.063073:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.063080:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.063085:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:2.0:1775773184.063094:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:2.0:1775773184.063113:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.063121:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.063126:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.063129:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.063132:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.063145:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.063149:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-15, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.063178:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-15, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.063204:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-15,[0x240002729:0x50:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.063278:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.063287:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.063298:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.063304:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99c00 x1862023612334976/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.063314:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.063338:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334976:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.063559:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.069851:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612334976:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.069889:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069927:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069935:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069949:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069960:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069974:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069983:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.069990:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.070003:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f99c00 x1862023612334976/t34359738401(34359738401) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.070017:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99c00 x1862023612334976/t34359738401(34359738401) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.070031:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.070045:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.070057:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/80 (0 0) 00000080:00200000:2.0:1775773184.070065:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.070083:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-15, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.070119:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x50:0x0](ffff8de1c4084b08) 00000080:00200000:2.0:1775773184.070432:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x50:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.070442:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x50:0x0](ffff8de1c4084b08) 00000080:00010000:2.0:1775773184.070446:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x50:0x0](ffff8de1c4084b08) for lock 0x8a9f4e958445ec04 00000080:00010000:2.0:1775773184.070457:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x50:0x0](ffff8de1c4084b08) 00000080:00200008:2.0:1775773184.070471:0:168137:0:(file.c:1057:ll_file_open()) START file f-15:[0x240002729:0x50:0x0](ffff8de1c4084b08), flags 100102 00000002:00100000:2.0:1775773184.070494:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99c00 x1862023612334976/t34359738401(34359738401) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.070542:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec04 from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.070547:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.070556:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.070582:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x50:0x0](ffff8de1c4084b08), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.070604:0:168137:0:(file.c:447:ll_file_release()) START file f-15:[0x240002729:0x50:0x0](ffff8de1c4084b08), flags 100002 00000002:00100000:2.0:1775773184.070656:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f99c00 x1862023612334976/t34359738401(34359738401) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.070673:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.070679:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b800 x1862023612335232/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.070703:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612335232:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.070820:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.075418:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612335232:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.075468:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f99c00 x1862023612334976/t34359738401(34359738401) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.075570:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.075598:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.075623:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:2.0:1775773184.075641:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:2.0:1775773184.075651:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.075659:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.075663:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.075672:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.075676:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:2.0:1775773184.075685:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:2.0:1775773184.075705:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.075713:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.075720:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.075776:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.075781:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.075796:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.075800:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-16, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84480, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.075807:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-16, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.075829:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-16,[0x240002729:0x51:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.075886:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.075893:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.075902:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.075907:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98380 x1862023612335488/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.075915:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.075933:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612335488:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.076093:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.079691:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612335488:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.079751:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079789:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079799:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079813:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079825:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079839:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079848:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079856:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.079868:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f98380 x1862023612335488/t34359738403(34359738403) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.079882:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98380 x1862023612335488/t34359738403(34359738403) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.079897:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.079911:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.079922:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/81 (0 0) 00000080:00200000:2.0:1775773184.079930:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.079946:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-16, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.079983:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x51:0x0](ffff8de1c4087448) 00000080:00200000:2.0:1775773184.080138:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x51:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.080146:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x51:0x0](ffff8de1c4087448) 00000080:00010000:2.0:1775773184.080149:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x51:0x0](ffff8de1c4087448) for lock 0x8a9f4e958445ec0b 00000080:00010000:2.0:1775773184.080434:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x51:0x0](ffff8de1c4087448) 00000080:00200008:2.0:1775773184.080456:0:168137:0:(file.c:1057:ll_file_open()) START file f-16:[0x240002729:0x51:0x0](ffff8de1c4087448), flags 100102 00000002:00100000:2.0:1775773184.080483:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98380 x1862023612335488/t34359738403(34359738403) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.080535:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec0b from it ffff8de1d2129480 00010000:00010000:2.0:1775773184.080541:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.080552:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.080578:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x51:0x0](ffff8de1c4087448), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.080618:0:168137:0:(file.c:447:ll_file_release()) START file f-16:[0x240002729:0x51:0x0](ffff8de1c4087448), flags 100002 00000002:00100000:2.0:1775773184.080672:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f98380 x1862023612335488/t34359738403(34359738403) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.081009:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.081017:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99f80 x1862023612335744/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.081047:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612335744:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.081285:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.086440:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612335744:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.086490:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f98380 x1862023612335488/t34359738403(34359738403) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.086584:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.086606:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.086641:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:2.0:1775773184.086658:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:2.0:1775773184.086667:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.086673:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.086677:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.086685:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.086690:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:2.0:1775773184.086699:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:2.0:1775773184.086717:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.086748:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.086754:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.086758:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.086762:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.086774:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.086779:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-17, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.086788:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-17, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.086811:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-17,[0x240002729:0x52:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.086870:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.086879:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.086891:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.086897:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98a80 x1862023612336000/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.086907:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.086927:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336000:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.087581:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.091942:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336000:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.092118:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092293:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092305:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092320:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092334:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092350:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092359:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092369:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773184.092383:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f98a80 x1862023612336000/t34359738405(34359738405) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773184.092398:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98a80 x1862023612336000/t34359738405(34359738405) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773184.092415:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773184.092432:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092445:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/82 (0 0) 00000080:00200000:0.0:1775773184.092452:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773184.092470:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-17, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:0.0:1775773184.092588:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x52:0x0](ffff8de1c40721c8) 00000080:00200000:0.0:1775773184.092819:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x52:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773184.092831:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x52:0x0](ffff8de1c40721c8) 00000080:00010000:0.0:1775773184.092835:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x52:0x0](ffff8de1c40721c8) for lock 0x8a9f4e958445ec12 00000080:00010000:0.0:1775773184.092846:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x52:0x0](ffff8de1c40721c8) 00000080:00200008:0.0:1775773184.092862:0:168137:0:(file.c:1057:ll_file_open()) START file f-17:[0x240002729:0x52:0x0](ffff8de1c40721c8), flags 100102 00000002:00100000:0.0:1775773184.092888:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f98a80 x1862023612336000/t34359738405(34359738405) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773184.092941:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec12 from it ffff8de1d2129480 00010000:00010000:0.0:1775773184.092946:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.092957:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773184.093163:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x52:0x0](ffff8de1c40721c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773184.093249:0:168137:0:(file.c:447:ll_file_release()) START file f-17:[0x240002729:0x52:0x0](ffff8de1c40721c8), flags 100002 00000002:00100000:0.0:1775773184.093304:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f98a80 x1862023612336000/t34359738405(34359738405) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773184.093317:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773184.093323:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7026a00 x1862023612336256/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773184.093357:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336256:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773184.093462:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052600 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.104831:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336256:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.104877:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f98a80 x1862023612336000/t34359738405(34359738405) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.104980:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.105007:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.105032:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:2.0:1775773184.105050:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:2.0:1775773184.105057:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.105063:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.105066:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.105073:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.105076:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:2.0:1775773184.105084:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:2.0:1775773184.105097:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.105103:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.105108:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.105111:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.105114:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.105125:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.105129:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-18, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c84480, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.105136:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-18, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.105168:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-18,[0x240002729:0x53:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.105238:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.105248:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.105260:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.105266:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99880 x1862023612336512/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.105277:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.105302:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336512:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.105635:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c517d540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.108960:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336512:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.109007:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109041:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109051:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109065:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109076:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109091:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109100:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109108:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.109118:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f99880 x1862023612336512/t34359738407(34359738407) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.109131:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99880 x1862023612336512/t34359738407(34359738407) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.109146:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.109170:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109181:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/83 (0 0) 00000080:00200000:2.0:1775773184.109190:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.109207:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-18, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.109251:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x53:0x0](ffff8de1c4083248) 00000080:00200000:2.0:1775773184.109419:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x53:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.109431:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x53:0x0](ffff8de1c4083248) 00000080:00010000:2.0:1775773184.109436:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x53:0x0](ffff8de1c4083248) for lock 0x8a9f4e958445ec19 00000080:00010000:2.0:1775773184.109447:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x53:0x0](ffff8de1c4083248) 00000080:00200008:2.0:1775773184.109466:0:168137:0:(file.c:1057:ll_file_open()) START file f-18:[0x240002729:0x53:0x0](ffff8de1c4083248), flags 100102 00000002:00100000:2.0:1775773184.109489:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99880 x1862023612336512/t34359738407(34359738407) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.109549:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec19 from it ffff8de1d2129a80 00010000:00010000:2.0:1775773184.109553:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.109564:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.109587:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x53:0x0](ffff8de1c4083248), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.109620:0:168137:0:(file.c:447:ll_file_release()) START file f-18:[0x240002729:0x53:0x0](ffff8de1c4083248), flags 100002 00000002:00100000:2.0:1775773184.109663:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f99880 x1862023612336512/t34359738407(34359738407) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.109674:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.109679:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b100 x1862023612336768/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.109704:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336768:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.109817:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.113813:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612336768:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.113856:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f99880 x1862023612336512/t34359738407(34359738407) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.113952:0:168137:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.113975:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.113998:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:2.0:1775773184.114015:0:168137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:2.0:1775773184.114024:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.114030:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.114035:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.114042:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1bdbbf8 00010000:00010000:2.0:1775773184.114047:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:2.0:1775773184.114056:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:2.0:1775773184.114075:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.114083:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.114090:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.114094:0:168137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.114098:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.114113:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.114118:0:168137:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-19, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), file ffff8de1c3c85b00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773184.114127:0:168137:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-19, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000002:00010000:2.0:1775773184.114162:0:168137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-19,[0x240002729:0x54:0x0]) in obj [0x240002729:0x40:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773184.114485:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.114495:0:168137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.114507:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.114513:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9aa00 x1862023612337024/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.114524:0:168137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.114550:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9aa00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612337024:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773184.114815:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.118213:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9aa00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612337024:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773184.118251:0:168137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118292:0:168137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x54:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118304:0:168137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118316:0:168137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118329:0:168137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118344:0:168137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118353:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118360:0:168137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.118372:0:168137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f9aa00 x1862023612337024/t34359738409(34359738409) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.118387:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9aa00 x1862023612337024/t34359738409(34359738409) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.118404:0:168137:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773184.118419:0:168137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118432:0:168137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/84 (0 0) 00000080:00200000:2.0:1775773184.118440:0:168137:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x40:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.118458:0:168137:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-19, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8), intent=open|creat 00000080:00200000:2.0:1775773184.118498:0:168137:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x54:0x0](ffff8de1c37b42c8) 00000080:00200000:2.0:1775773184.118825:0:168137:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x54:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773184.118838:0:168137:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x54:0x0](ffff8de1c37b42c8) 00000080:00010000:2.0:1775773184.118842:0:168137:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x54:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ec20 00000080:00010000:2.0:1775773184.118855:0:168137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x54:0x0](ffff8de1c37b42c8) 00000080:00200008:2.0:1775773184.118872:0:168137:0:(file.c:1057:ll_file_open()) START file f-19:[0x240002729:0x54:0x0](ffff8de1c37b42c8), flags 100102 00000002:00100000:2.0:1775773184.118896:0:168137:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9aa00 x1862023612337024/t34359738409(34359738409) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773184.118947:0:168137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec20 from it ffff8de1d2129a80 00010000:00010000:2.0:1775773184.118951:0:168137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.118960:0:168137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.119149:0:168137:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x54:0x0](ffff8de1c37b42c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773184.119201:0:168137:0:(file.c:447:ll_file_release()) START file f-19:[0x240002729:0x54:0x0](ffff8de1c37b42c8), flags 100002 00000002:00100000:2.0:1775773184.119258:0:168137:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9aa00 x1862023612337024/t34359738409(34359738409) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.119270:0:168137:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.119276:0:168137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f98000 x1862023612337280/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.119302:0:168137:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f98000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612337280:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773184.119417:0:168137:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.122280:0:168137:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f98000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168137:1862023612337280:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773184.122323:0:168137:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9aa00 x1862023612337024/t34359738409(34359738409) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.136626:0:168139:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.136667:0:168139:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.136691:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:2.0:1775773184.136710:0:168139:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:2.0:1775773184.136718:0:168139:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.136871:0:168139:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.136876:0:168139:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.136884:0:168139:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1877bf8 00010000:00010000:2.0:1775773184.136889:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:2.0:1775773184.136900:0:168139:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:2.0:1775773184.136920:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.136930:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=27 00000080:00200000:2.0:1775773184.136937:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.136942:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=27 00000080:00200000:2.0:1775773184.136946:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.136950:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=267 00000080:00200000:2.0:1775773184.137059:0:168139:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.137069:0:168139:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.137076:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:2.0:1775773184.137086:0:168139:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:2.0:1775773184.137093:0:168139:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.137098:0:168139:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.137100:0:168139:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.137104:0:168139:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1877bf8 00010000:00010000:2.0:1775773184.137107:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:2.0:1775773184.137115:0:168139:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:2.0:1775773184.137123:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.137127:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=27 00000080:00200000:2.0:1775773184.137131:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.137134:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=267 00000080:00200000:2.0:1775773184.137137:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 44 00000080:00200008:2.0:1775773184.137145:0:168139:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 304000 00000002:00010000:2.0:1775773184.137175:0:168139:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x40:0x0]) in obj [0x200027cd1:0xa:0x0], intent: open flags 0100240304001 00010000:00010000:2.0:1775773184.137293:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.137303:0:168139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.137321:0:168139:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.137337:0:168139:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99500 x1862023612337536/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.137348:0:168139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.137377:0:168139:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612337536:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773184.137751:0:168139:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.140943:0:168139:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612337536:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773184.140974:0:168139:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.140999:0:168139:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141006:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141014:0:168139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141023:0:168139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141031:0:168139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d49600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773184.141037:0:168139:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141050:0:168139:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141057:0:168139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141064:0:168139:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775773184.141072:0:168139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141078:0:168139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ec27 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.141104:0:168139:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0f99500 x1862023612337536/t34359738411(34359738411) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.141116:0:168139:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99500 x1862023612337536/t34359738411(34359738411) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.141133:0:168139:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xa:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773184.141176:0:168139:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x40:0x0], updating i_size 4096 00000002:00100000:2.0:1775773184.141195:0:168139:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99500 x1862023612337536/t34359738411(34359738411) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.141304:0:168139:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.141321:0:168139:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.141337:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:2.0:1775773184.141350:0:168139:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:2.0:1775773184.141358:0:168139:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.141364:0:168139:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.141368:0:168139:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.141373:0:168139:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c1877bf8 00010000:00010000:2.0:1775773184.141377:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:2.0:1775773184.141386:0:168139:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:2.0:1775773184.141404:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.141411:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=25 00000080:00200000:2.0:1775773184.141415:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.141418:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773184.141419:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.141423:0:168139:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=265 00000080:00200000:2.0:1775773184.141427:0:168139:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x42:0x0](ffff8de1c4081148), inode mode 81a4 mask 44 00000080:00200008:2.0:1775773184.141434:0:168139:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x42:0x0](ffff8de1c4081148), flags 100400 00000002:00010000:2.0:1775773184.141447:0:168139:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x42:0x0]) in obj [0x240002729:0x40:0x0], intent: open flags 0240100401 00010000:00010000:2.0:1775773184.141495:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.141500:0:168139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.141508:0:168139:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.141524:0:168139:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b480 x1862023612337792/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.141532:0:168139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.141550:0:168139:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612337792:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773184.141868:0:168139:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.144914:0:168139:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612337792:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773184.144940:0:168139:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.144965:0:168139:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 4/1,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.144974:0:168139:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 4/1,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.145057:0:168139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.145071:0:168139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.145086:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.145095:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.145108:0:168139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.145119:0:168139:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0f9b480 x1862023612337792/t34359738412(34359738412) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.145133:0:168139:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9b480 x1862023612337792/t34359738412(34359738412) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.145157:0:168139:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773184.145246:0:168139:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.145259:0:168139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.145269:0:168139:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.145274:0:168139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.145279:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.145283:0:168139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.145322:0:168139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:0.0:1775773184.145329:0:168139:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x240002729:0x40:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775773184.145441:0:168139:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x42:0x0]: layout version change: 0 -> 0 00000080:00010000:0.0:1775773184.145449:0:168139:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x42:0x0](ffff8de1c4081148) for lock 0x8a9f4e958445eba2 00000080:00010000:0.0:1775773184.145454:0:168139:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eba2 from it ffff9ba1c1877bf0 00010000:00010000:0.0:1775773184.145456:0:168139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.145467:0:168139:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1775773184.145492:0:168139:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f9b480 x1862023612337792/t34359738412(34359738412) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1775773184.145686:0:168139:0:(file.c:4602:ll_file_ioctl()) VFS Op:inode=[0x240002729:0x42:0x0](ffff8de1c4081148) cmd=800466af arg=7ffc717c171c 00000080:00200008:0.0:1775773184.145715:0:168139:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x42:0x0](ffff8de1c4081148), flags 100000 00000002:00100000:0.0:1775773184.145786:0:168139:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f9b480 x1862023612337792/t34359738412(34359738412) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773184.145795:0:168139:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773184.145798:0:168139:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027b80 x1862023612338048/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773184.145819:0:168139:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612338048:192.168.201.137@tcp:35:lfs.0 00000100:00100000:0.0:1775773184.145933:0:168139:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052a80 going to sleep for 11 seconds 00010000:00010000:2.0:1775773184.146065:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775773184.146071:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146078:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d48600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773184.146082:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146088:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146095:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146111:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.146134:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 2/0,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146138:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.146179:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 1/0,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146187:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec2e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab5e8 expref: -99 pid: 168139 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.146202:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773184.146204:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773184.146206:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773184.146215:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775773184.146226:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612338176:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773184.150395:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612338176:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773184.150475:0:168139:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612338048:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773184.150515:0:168139:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f9b480 x1862023612337792/t34359738412(34359738412) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1775773184.150770:0:168139:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 304000 00000002:00100000:3.0:1775773184.150837:0:168139:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f99500 x1862023612337536/t34359738411(34359738411) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773184.150848:0:168139:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773184.150853:0:168139:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75180 x1862023612338432/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773184.150879:0:168139:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612338432:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775773184.151097:0:168139:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773184.153513:0:168139:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168139:1862023612338432:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773184.153556:0:168139:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f99500 x1862023612337536/t34359738411(34359738411) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773184.165440:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773184.165480:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773184.165502:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:0.0:1775773184.165520:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:0.0:1775773184.165530:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773184.165539:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773184.165543:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773184.165553:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c180fb58 00010000:00010000:0.0:1775773184.165558:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:0.0:1775773184.165568:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:0.0:1775773184.165587:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773184.165599:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=8 00000080:00200008:0.0:1775773184.165611:0:168140:0:(file.c:6226:ll_getattr_dentry()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775773184.165615:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448),name=d80d.replay-single 00000002:00010000:0.0:1775773184.165630:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773184.165639:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.165649:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773184.165656:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773184.165660:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:0.0:1775773184.165662:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445eb86 00000080:00010000:0.0:1775773184.165665:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb86 from it ffff9ba1c180fcb8 00010000:00010000:0.0:1775773184.165667:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.165672:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775773184.165705:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773184.165712:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773184.165718:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:0.0:1775773184.165845:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:0.0:1775773184.165852:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773184.165857:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773184.165860:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:0.0:1775773184.165864:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c180fbf8 00010000:00010000:0.0:1775773184.165867:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:0.0:1775773184.165875:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:0.0:1775773184.165883:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773184.165886:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=266 00000080:00200000:0.0:1775773184.165889:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 44 00000080:00200008:0.0:1775773184.165894:0:168140:0:(file.c:1057:ll_file_open()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags 704400 00000002:00010000:0.0:1775773184.165911:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1775773184.166121:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.166128:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773184.166141:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773184.166162:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024e00 x1862023612338688/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773184.166170:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773184.166200:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612338688:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775773184.166515:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.170062:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612338688:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773184.170093:0:168140:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170108:0:168140:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170116:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170128:0:168140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170138:0:168140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170143:0:168140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e35600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773184.170146:0:168140:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170163:0:168140:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170171:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170183:0:168140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775773184.170192:0:168140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.170197:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ec35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.170219:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1c7024e00 x1862023612338688/t360777252865(360777252865) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.170232:0:168140:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024e00 x1862023612338688/t360777252865(360777252865) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.170252:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773184.170286:0:168140:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000002:00100000:2.0:1775773184.170308:0:168140:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024e00 x1862023612338688/t360777252865(360777252865) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773184.172219:0:168140:0:(file.c:6226:ll_getattr_dentry()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773184.172236:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448),name=d80d.replay-single 00000002:00010000:2.0:1775773184.172277:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.172300:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773184.172317:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773184.172957:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.172971:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:2.0:1775773184.172975:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445eb86 00000080:00010000:2.0:1775773184.172986:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb86 from it ffff9ba1c180fcd8 00010000:00010000:2.0:1775773184.172991:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773184.173003:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773184.173115:0:168140:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1775773184.173135:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200027cd1:0xa:0x0], intent: readdir flags 0 00010000:00010000:2.0:1775773184.173145:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.173169:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1775773184.177592:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612338816:192.168.201.137@tcp:37:rm.0 00000100:00100000:2.0:1775773184.178012:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.187539:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612338816:192.168.201.137@tcp:37:rm.0 00010000:00010000:2.0:1775773184.189166:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.189240:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:2.0:1775773184.189432:0:168140:0:(file.c:447:ll_file_release()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags 704000 00000002:00100000:2.0:1775773184.189587:0:168140:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7024e00 x1862023612338688/t360777252865(360777252865) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.189602:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.189608:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99180 x1862023612339072/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.189636:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339072:192.168.201.137@tcp:35:rm.0 00000100:00100000:2.0:1775773184.189853:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.199131:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339072:192.168.201.137@tcp:35:rm.0 00000002:00100000:2.0:1775773184.199195:0:168140:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7024e00 x1862023612338688/t360777252865(360777252865) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773184.199298:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.199321:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.199345:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:2.0:1775773184.199363:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:2.0:1775773184.199371:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.199378:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.199382:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.199390:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c180fbf8 00010000:00010000:2.0:1775773184.199394:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:2.0:1775773184.199402:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:2.0:1775773184.199420:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.199429:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80d.replay-single, flags=266 00000080:00200000:2.0:1775773184.199438:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 44 00000080:00200008:2.0:1775773184.199450:0:168140:0:(file.c:1057:ll_file_open()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags 704400 00000002:00010000:2.0:1775773184.199468:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1775773184.200349:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.200366:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773184.200380:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773184.200391:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99180 x1862023612339328/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773184.200409:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.200440:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339328:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773184.200694:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c827c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.208123:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339328:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773184.208176:0:168140:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.208190:0:168140:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.208204:0:168140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.208218:0:168140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.208234:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8de1d0f99180 x1862023612339328/t360777252867(360777252867) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773184.208251:0:168140:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99180 x1862023612339328/t360777252867(360777252867) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.208276:0:168140:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.208287:0:168140:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 16 res 8590097617/10 (0 0) 00000080:00200000:2.0:1775773184.208298:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773184.208334:0:168140:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000080:00010000:2.0:1775773184.208340:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445ec3c 00000080:00010000:2.0:1775773184.208349:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec3c from it ffff9ba1c180fbd0 00010000:00010000:2.0:1775773184.208353:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.208364:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1775773184.208396:0:168140:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f99180 x1862023612339328/t360777252867(360777252867) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773184.208481:0:168140:0:(file.c:6226:ll_getattr_dentry()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773184.208488:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448),name=d80d.replay-single 00000002:00010000:2.0:1775773184.208521:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xa:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.208533:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773184.208544:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773184.208552:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.208558:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:2.0:1775773184.208562:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445eb86 00000080:00010000:2.0:1775773184.208566:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb86 from it ffff9ba1c180fcd8 00010000:00010000:2.0:1775773184.208569:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773184.208581:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773184.208683:0:168140:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1775773184.208710:0:168140:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1775773184.208796:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.208805:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=0 00000080:00200008:2.0:1775773184.208814:0:168140:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775773184.213002:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8),name=remote_dir 00000002:00010000:0.0:1775773184.213058:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x40:0x0]) in obj [0x200027cd1:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773184.213162:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.213176:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.213189:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773184.213223:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339456:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775773184.213495:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:0.0:1775773184.219042:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339456:192.168.201.137@tcp:101:rm.0 00010000:00010000:0.0:1775773184.219077:0:168140:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219115:0:168140:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219128:0:168140:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219141:0:168140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219164:0:168140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219179:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219189:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219198:0:168140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773184.219212:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c7024380 x1862023612339456/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773184.219229:0:168140:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219241:0:168140:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/64 (0 0) 00000080:00200000:0.0:1775773184.219249:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xa:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775773184.219293:0:168140:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x40:0x0], updating i_size 4096 00000080:00010000:0.0:1775773184.219303:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445ec43 00000080:00010000:0.0:1775773184.219308:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00010000:0.0:1775773184.219312:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec43 from it ffff9ba1c180fcb8 00010000:00010000:0.0:1775773184.219315:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.219325:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773184.219423:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:0.0:1775773184.219435:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=258 00000080:00200000:0.0:1775773184.220074:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 44 00000080:00200008:0.0:1775773184.220090:0:168140:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 704400 00000002:00010000:0.0:1775773184.220124:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x40:0x0]) in obj [0x200027cd1:0xa:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1775773184.220205:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.220214:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773184.220228:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773184.220238:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024380 x1862023612339712/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773184.220248:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773184.220358:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339712:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775773184.221240:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:0.0:1775773184.234502:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339712:192.168.201.137@tcp:101:rm.0 00010000:00010000:0.0:1775773184.234887:0:168140:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.234901:0:168140:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.234915:0:168140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 4/1,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.234927:0:168140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 4/1,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773184.234944:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8de1c7024380 x1862023612339712/t34359738415(34359738415) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773184.234958:0:168140:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024380 x1862023612339712/t34359738415(34359738415) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773184.234976:0:168140:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.234989:0:168140:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 16 res 9663686441/64 (0 0) 00000080:00200000:0.0:1775773184.234998:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xa:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1775773184.235040:0:168140:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x40:0x0], updating i_size 4096 00000080:00010000:0.0:1775773184.235048:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445ec4a 00000080:00010000:0.0:1775773184.235058:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec4a from it ffff9ba1c180fbd0 00010000:00010000:0.0:1775773184.235063:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.235077:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1775773184.235110:0:168140:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024380 x1862023612339712/t34359738415(34359738415) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1775773184.235201:0:168140:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1775773184.235209:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8),name=remote_dir 00000002:00010000:0.0:1775773184.235233:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x40:0x0]) in obj [0x200027cd1:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773184.235245:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.235257:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773184.236451:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xa:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773184.236469:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00010000:0.0:1775773184.236474:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445ec43 00000080:00010000:0.0:1775773184.236483:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec43 from it ffff9ba1c180fcd8 00010000:00010000:0.0:1775773184.236489:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.236502:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1775773184.236631:0:168140:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1775773184.236657:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x40:0x0]) in obj [0x240002729:0x40:0x0], intent: readdir flags 0 00010000:00010000:0.0:1775773184.236671:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773184.236684:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1775773184.239263:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339840:192.168.201.137@tcp:37:rm.0 00000100:00100000:0.0:1775773184.239797:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.247829:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612339840:192.168.201.137@tcp:37:rm.0 00010000:00010000:2.0:1775773184.249315:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773184.249411:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1775773184.249497:0:168140:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 704000 00010000:00010000:2.0:1775773184.249531:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773184.249595:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.249606:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=258 00000080:00200000:2.0:1775773184.249616:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 44 00000080:00200008:2.0:1775773184.249625:0:168140:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 704400 00000080:00200008:2.0:1775773184.249648:0:168140:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773184.249653:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8),name=remote_dir 00000002:00010000:2.0:1775773184.249678:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x40:0x0]) in obj [0x200027cd1:0xa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.249688:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.249697:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773184.249705:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xa:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.249712:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00010000:2.0:1775773184.249715:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445ec43 00000080:00010000:2.0:1775773184.249848:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec43 from it ffff9ba1c180fcd8 00010000:00010000:2.0:1775773184.249854:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.249863:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773184.249894:0:168140:0:(llite_lib.c:2726:ll_statfs()) VFS Op:sb=lustre (ffff8de1e006a000) remote_dir proj=0 00000080:00000004:2.0:1775773184.249900:0:168140:0:(obd_class.h:1092:obd_statfs()) lustre-clilmv-ffff8de1e006a000: age 9057, max_age 9160 00800000:00000004:2.0:1775773184.249914:0:168140:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9160, max_age 9160 00800000:00000004:2.0:1775773184.249917:0:168140:0:(obd_class.h:1132:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: use ffff8de1c5511e10 cache blocks 317249/353529 objects 1023642/1024000 00800000:00000004:2.0:1775773184.249920:0:168140:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9160, max_age 9160 00800000:00000004:2.0:1775773184.249922:0:168140:0:(obd_class.h:1132:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: use ffff8de1c5515190 cache blocks 317340/353529 objects 1023720/1024000 00000080:00000004:2.0:1775773184.249928:0:168140:0:(obd_class.h:1118:obd_statfs()) lustre-clilmv-ffff8de1e006a000: update ffff8de1c55137d0 cache blocks 634589/707058 objects 2047362/2048000 00000080:00000004:2.0:1775773184.249931:0:168140:0:(llite_lib.c:2589:ll_statfs_internal()) MDC blocks 634589/707058 objects 2047362/2048000 00000080:00000004:2.0:1775773184.249935:0:168140:0:(obd_class.h:1092:obd_statfs()) lustre-clilov-ffff8de1e006a000: age 9057, max_age 9160 00020000:00000004:2.0:1775773184.249958:0:168140:0:(obd_class.h:1058:obd_statfs_async()) lustre-OST0000-osc-ffff8de1e006a000: age 9160, max_age 9160 00000008:00000004:2.0:1775773184.249962:0:168140:0:(osc_request.c:3416:osc_statfs_async()) lustre-OST0000-osc-ffff8de1e006a000: use ffff8de1c5579e10 cache blocks 901355/958279 objects 261711/262144 00020000:00000004:2.0:1775773184.249985:0:168140:0:(obd_class.h:1058:obd_statfs_async()) lustre-OST0001-osc-ffff8de1e006a000: age 9160, max_age 9160 00000008:00000004:2.0:1775773184.249989:0:168140:0:(osc_request.c:3416:osc_statfs_async()) lustre-OST0001-osc-ffff8de1e006a000: use ffff8de1c557b7d0 cache blocks 901361/958279 objects 261728/262144 00000080:00000004:2.0:1775773184.250002:0:168140:0:(obd_class.h:1118:obd_statfs()) lustre-clilov-ffff8de1e006a000: update ffff8de1c5510450 cache blocks 1802716/1916558 objects 523439/524288 00000080:00000004:2.0:1775773184.250005:0:168140:0:(llite_lib.c:2600:ll_statfs_internal()) OSC blocks 1802716/1916558 objects 523439/524288 00000080:00200000:2.0:1775773184.250021:0:168140:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1775773184.250097:0:168140:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1775773184.250112:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.250121:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-12, flags=0 00000080:00200000:2.0:1775773184.250126:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.250131:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-12, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.250239:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773184.250325:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.250360:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4d:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.250413:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.250422:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773184.250429:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775773184.250432:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e200/0x8a9f4e958445ebef lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab4d0 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.250450:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ec43 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab620 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000020:00100000:2.0:1775773184.250475:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.250491:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9bb80 x1862023612340096/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.250519:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340096:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.250637:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.255613:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9bb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340096:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.255788:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.255805:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.255887:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.255904:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4d:0x0](ffff8de1c40800c8) 00000080:00200000:2.0:1775773184.256032:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.256048:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-2, flags=0 00000080:00200000:2.0:1775773184.256054:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.256058:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-2, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.256127:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.256171:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x43:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.256235:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.256243:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.256246:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fc00/0x8a9f4e958445eba9 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab372 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.256277:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.256288:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f99500 x1862023612340352/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.256315:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340352:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.256636:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.266707:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f99500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340352:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.266865:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x43:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.266880:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.266956:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x43:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.266972:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x43:0x0](ffff8de1c4086c08) 00000080:00200000:2.0:1775773184.267101:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.267116:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-3, flags=0 00000080:00200000:2.0:1775773184.267122:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.267128:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-3, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.267204:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.267239:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x44:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.267302:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.267310:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.267313:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f400/0x8a9f4e958445ebb0 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab395 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.267427:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.267439:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f9b480 x1862023612340608/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.267475:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340608:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.267575:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.272576:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f9b480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340608:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.272687:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x44:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.272703:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.272825:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x44:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.272842:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x44:0x0](ffff8de1c4085b88) 00000080:00200000:2.0:1775773184.272946:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.272959:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-8, flags=0 00000080:00200000:2.0:1775773184.272981:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.272987:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-8, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.273048:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.273079:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x49:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.273138:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.273146:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.273176:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385e00/0x8a9f4e958445ebd3 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab444 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.273209:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.273220:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2df80 x1862023612340864/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.273247:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340864:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.273348:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.278654:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612340864:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.278792:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x49:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.278809:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.278884:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x49:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.278902:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x49:0x0](ffff8de1c4078908) 00000080:00200000:2.0:1775773184.279031:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.279045:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-7, flags=0 00000080:00200000:2.0:1775773184.279050:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.279055:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-7, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.279114:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.279145:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x48:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.279217:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 1/0,0 mode: --/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.279226:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.279229:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ebcc lrc: 0/0,0 mode: --/PR res: [0x240002729:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab421 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.279257:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.279267:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2d500 x1862023612341120/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.279295:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341120:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.280231:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.286393:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341120:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.286537:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x48:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.286553:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.286629:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x48:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.286646:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x48:0x0](ffff8de1c407aa08) 00000080:00200000:2.0:1775773184.286792:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.286807:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-19, flags=0 00000080:00200000:2.0:1775773184.286814:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.286820:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-19, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.286887:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.286918:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x54:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.287388:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.287398:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.287402:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec20 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab5c5 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.287434:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.287446:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2e300 x1862023612341376/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.287473:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341376:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.287763:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.296930:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341376:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.297209:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x54:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.297226:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.297300:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x54:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.297317:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x54:0x0](ffff8de1c37b42c8) 00000080:00200000:2.0:1775773184.297508:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.297602:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-10, flags=0 00000080:00200000:2.0:1775773184.297610:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.297615:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-10, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.297681:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.297715:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4b:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.297906:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.297915:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.297918:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e800/0x8a9f4e958445ebe1 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab48a expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.297948:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.297960:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2f100 x1862023612341632/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.298005:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341632:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.298108:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.305065:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341632:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.305187:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.305204:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.305280:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.305298:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4b:0x0](ffff8de1c4080908) 00000080:00200000:2.0:1775773184.305423:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.305437:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-14, flags=0 00000080:00200000:2.0:1775773184.305443:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.305448:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-14, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.305518:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.305553:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4f:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.305617:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.305624:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.305627:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512e400/0x8a9f4e958445ebfd lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab516 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.305652:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.305661:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2c700 x1862023612341888/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.305688:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341888:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.305879:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.309077:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612341888:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.309204:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.309219:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.309285:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.309301:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4f:0x0](ffff8de1c4083a88) 00000080:00200000:2.0:1775773184.309609:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.309623:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-6, flags=0 00000080:00200000:2.0:1775773184.309630:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.309637:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-6, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.309701:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.310215:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x47:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.310284:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.310293:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.310296:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f800/0x8a9f4e958445ebc5 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab3fe expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.310465:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.310480:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ca80 x1862023612342144/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.310511:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612342144:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.310672:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.315653:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612342144:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.315808:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x47:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.315824:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.315891:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x47:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.315909:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x47:0x0](ffff8de1c4085348) 00000080:00200000:2.0:1775773184.316030:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.316043:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-11, flags=0 00000080:00200000:2.0:1775773184.316050:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.316055:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-11, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.316118:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.316164:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4c:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.316231:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.316240:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.316243:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ea00/0x8a9f4e958445ebe8 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab4ad expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.316274:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.316285:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ea00 x1862023612342400/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.316312:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ea00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612342400:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.316489:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142000 going to sleep for 11 seconds 00000100:00100000:3.0:1775773184.320010:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612342656:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773184.320182:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612342528:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773184.321915:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612342784:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773184.323652:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ea00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612342400:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.323786:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.323803:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.323878:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.323893:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4c:0x0](ffff8de1c4082a08) 00000080:00200000:2.0:1775773184.324322:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.324344:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-4, flags=0 00000080:00200000:2.0:1775773184.324381:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.324387:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-4, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.324458:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.324490:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x45:0x0]: losing layout lock 00000100:00100000:3.0:1775773184.327694:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612342656:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775773184.327894:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.327908:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.327911:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ec00/0x8a9f4e958445ebb7 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab3b8 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.327946:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.327957:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31f80 x1862023612343040/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.328135:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343040:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.328244:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.331799:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612342528:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773184.331831:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612342784:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773184.333203:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343040:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773184.333321:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x45:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773184.333337:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773184.333410:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x45:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773184.333426:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x45:0x0](ffff8de1c40863c8) 00000080:00200000:1.0:1775773184.333866:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773184.333882:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-18, flags=0 00000080:00200000:1.0:1775773184.333889:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773184.333894:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-18, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:1.0:1775773184.334122:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773184.334167:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x53:0x0]: losing layout lock 00010000:00010000:1.0:1775773184.334231:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.334241:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.334245:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec19 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab5a2 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.334275:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.334287:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30e00 x1862023612343296/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.334313:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343296:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.334469:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af180 going to sleep for 11 seconds 00000100:00100000:1.0:1775773184.339458:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343296:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773184.339600:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x53:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773184.339617:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773184.339694:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x53:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773184.339710:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x53:0x0](ffff8de1c4083248) 00000080:00200000:1.0:1775773184.339934:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773184.339949:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-17, flags=0 00000080:00200000:1.0:1775773184.339955:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773184.339959:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-17, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:1.0:1775773184.340326:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773184.340360:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x52:0x0]: losing layout lock 00010000:00010000:1.0:1775773184.340426:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.340434:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.340438:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec12 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab57f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.340471:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.340482:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32300 x1862023612343552/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.340591:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343552:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.340706:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af540 going to sleep for 11 seconds 00000100:00100000:1.0:1775773184.344670:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343552:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773184.344829:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x52:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773184.344846:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773184.344917:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x52:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773184.344933:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x52:0x0](ffff8de1c40721c8) 00000080:00200000:1.0:1775773184.345066:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773184.345080:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-0, flags=0 00000080:00200000:1.0:1775773184.345087:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773184.345092:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-0, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:1.0:1775773184.345161:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773184.345193:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x41:0x0]: losing layout lock 00010000:00010000:1.0:1775773184.345254:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 1/0,0 mode: --/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.345262:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.345265:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f200/0x8a9f4e958445eb9b lrc: 0/0,0 mode: --/PR res: [0x240002729:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab32c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.345297:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.345306:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31880 x1862023612343808/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.345333:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343808:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.345413:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af540 going to sleep for 11 seconds 00000100:00100000:1.0:1775773184.349602:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612343808:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773184.349717:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x41:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773184.349768:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773184.349842:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x41:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773184.349858:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x41:0x0](ffff8de1c407cb08) 00000080:00200000:1.0:1775773184.350210:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773184.350229:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-15, flags=0 00000080:00200000:1.0:1775773184.350236:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773184.350241:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-15, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:1.0:1775773184.350316:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773184.350351:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x50:0x0]: losing layout lock 00010000:00010000:1.0:1775773184.350417:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.350426:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.350429:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512ee00/0x8a9f4e958445ec04 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab539 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.350457:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.350468:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30700 x1862023612344064/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.350494:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344064:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.350656:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af540 going to sleep for 11 seconds 00000100:00100000:1.0:1775773184.356131:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344064:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773184.356261:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x50:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773184.356276:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773184.356346:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x50:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773184.356361:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x50:0x0](ffff8de1c4084b08) 00000080:00200000:1.0:1775773184.356478:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773184.356493:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-5, flags=0 00000080:00200000:1.0:1775773184.356499:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773184.356505:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-5, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:1.0:1775773184.356826:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773184.356862:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x46:0x0]: losing layout lock 00010000:00010000:1.0:1775773184.356925:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 1/0,0 mode: --/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.356933:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.356936:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f000/0x8a9f4e958445ebbe lrc: 0/0,0 mode: --/PR res: [0x240002729:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab3db expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.357120:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.357131:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30000 x1862023612344320/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.357176:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344320:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.357331:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af540 going to sleep for 11 seconds 00000100:00100000:1.0:1775773184.362218:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344320:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773184.362335:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x46:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773184.362350:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773184.362418:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x46:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773184.362434:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x46:0x0](ffff8de1c4081988) 00000080:00200000:1.0:1775773184.362632:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773184.362647:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-16, flags=0 00000080:00200000:1.0:1775773184.362653:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:1.0:1775773184.362657:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-16, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:1.0:1775773184.362830:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773184.362864:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x51:0x0]: losing layout lock 00010000:00010000:1.0:1775773184.362929:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 1/0,0 mode: --/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773184.362938:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773184.362941:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ec0b lrc: 0/0,0 mode: --/PR res: [0x240002729:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab55c expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773184.363118:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773184.363131:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30380 x1862023612344576/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773184.363168:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344576:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773184.363318:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.367640:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344576:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.367829:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x51:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.367847:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.367919:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x51:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.367935:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x51:0x0](ffff8de1c4087448) 00000080:00200000:2.0:1775773184.368268:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.368283:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-9, flags=0 00000080:00200000:2.0:1775773184.368290:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.368296:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-9, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.368362:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.368395:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4a:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.368460:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.368468:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.368472:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ebda lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab467 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.368498:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.368631:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2e680 x1862023612344832/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.368662:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344832:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.368901:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.373691:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612344832:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.373879:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.373897:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.374107:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.374127:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4a:0x0](ffff8de1c407c2c8) 00000080:00200000:2.0:1775773184.374264:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.374282:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=0 00000080:00200000:2.0:1775773184.374288:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.374295:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-1, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.374364:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773184.374398:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x42:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.374469:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.374478:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.374481:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512f600/0x8a9f4e958445eba2 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab34f expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1775773184.374719:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.376612:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2f800 x1862023612345088/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.376665:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345088:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.377075:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.381371:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345088:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.381483:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x42:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1775773184.381498:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1775773184.381705:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x42:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773184.381803:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x42:0x0](ffff8de1c4081148) 00000080:00200000:2.0:1775773184.381922:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.381937:0:168140:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-13, flags=0 00000080:00200000:2.0:1775773184.381944:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.381950:0:168140:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-13, dir=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00010000:00010000:2.0:1775773184.382186:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.382220:0:168140:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x4e:0x0]: losing layout lock 00010000:00010000:2.0:1775773184.382285:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.382294:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773184.382297:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c512fe00/0x8a9f4e958445ebf6 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dab4f3 expref: -99 pid: 168137 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1775773184.382327:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.382338:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2c000 x1862023612345344/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.382366:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345344:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.382657:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142480 going to sleep for 11 seconds 00000100:00100000:3.0:1775773184.388885:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345344:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775773184.389013:0:168140:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x4e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1775773184.389028:0:168140:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1775773184.389097:0:168140:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x4e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1775773184.389112:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x4e:0x0](ffff8de1c40842c8) 00000080:00200008:3.0:1775773184.389241:0:168140:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x40:0x0](ffff8de1c40821c8), flags 704000 00010000:00010000:3.0:1775773184.389275:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773184.389318:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 1 00000080:00200000:3.0:1775773184.389338:0:168140:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags=0 00000080:00200000:3.0:1775773184.389343:0:168140:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448), intent=getattr 00000002:00010000:3.0:1775773184.389385:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773184.389447:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.389457:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.389468:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773184.389493:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345472:192.168.201.137@tcp:101:rm.0 00000100:00100000:3.0:1775773184.389588:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775773184.394537:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345472:192.168.201.137@tcp:101:rm.0 00010000:00010000:3.0:1775773184.394572:0:168140:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394593:0:168140:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394602:0:168140:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394617:0:168140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394629:0:168140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394645:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394654:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394661:0:168140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773184.394673:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0e77b80 x1862023612345472/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773184.394687:0:168140:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394705:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773184.394718:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773184.394763:0:168140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394770:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394776:0:168140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394795:0:168140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:3.0:1775773184.394813:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240002729:0x40:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773184.394866:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394872:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.394882:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773184.394907:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345600:192.168.201.137@tcp:101:rm.0 00010000:00010000:0.0:1775773184.395267:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775773184.395275:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395284:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384e00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775773184.395290:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395299:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395307:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395327:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.395364:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 2/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395371:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773184.395407:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395415:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384e00/0x8a9f4e958445ec51 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab881 expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773184.395430:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773184.395432:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773184.395434:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773184.395444:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775773184.395460:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612345728:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773184.396363:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773184.399900:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612345728:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773184.402372:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612345600:192.168.201.137@tcp:101:rm.0 00010000:00010000:3.0:1775773184.402404:0:168140:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402420:0:168140:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402435:0:168140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402446:0:168140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402461:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402470:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402477:0:168140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773184.402491:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0e74e00 x1862023612345600/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773184.402506:0:168140:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402535:0:168140:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/64 (0 0) 00000080:00200000:3.0:1775773184.402558:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xa:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773184.402598:0:168140:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x40:0x0], updating i_size 4096 00000080:00200000:3.0:1775773184.402602:0:168140:0:(namei.c:147:ll_iget()) got inode: [0x240002729:0x40:0x0](ffff8de1c40821c8): rc = 0 00000080:00010000:3.0:1775773184.402611:0:168140:0:(llite_internal.h:1976:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for remote lock 0x8a9f4e958445ec58 00000080:00010000:3.0:1775773184.402617:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) for lock 0x8a9f4e958445eb8d 00000080:00010000:3.0:1775773184.402630:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00010000:3.0:1775773184.402634:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb8d from it ffff9ba1c180fe00 00010000:00010000:3.0:1775773184.402638:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773184.402649:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1775773184.402664:0:168140:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x8a9f4e958445ec58 from it ffff9ba1c180fe00 00010000:00010000:3.0:1775773184.402667:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773184.402674:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773184.402697:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448), inode mode 41ed mask 3 00000080:00200000:3.0:1775773184.402706:0:168140:0:(namei.c:2305:ll_rmdir()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xa:0x0](ffff8de1c407f448) 00010000:00010000:3.0:1775773184.403216:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773184.403275:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 1/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773184.403287:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775773184.403315:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c512fa00/0x8a9f4e958445eb8d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab2f4 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1775773184.403359:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612345856:192.168.201.137@tcp:103:rm.0 00010000:00010000:3.0:1775773184.403490:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773184.403508:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:3.0:1775773184.403547:0:168140:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7024380 x1862023612339712/t34359738415(34359738415) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773184.403559:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773184.403565:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77b80 x1862023612346112/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773184.403581:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346112:192.168.201.137@tcp:35:rm.0 00000100:00100000:3.0:1775773184.403609:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c50e13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773184.408086:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346112:192.168.201.137@tcp:35:rm.0 00000002:00100000:0.0:1775773184.408137:0:168140:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7024380 x1862023612339712/t34359738415(34359738415) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1775773184.408249:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.408261:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 1/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775773184.408268:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1775773184.408271:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384000/0x8a9f4e958445ec58 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab88f expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773184.408286:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445ec4a lrc: 0/0,0 mode: --/CR res: [0x240002729:0x40:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab62e expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1775773184.408310:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1775773184.408317:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024380 x1862023612346368/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773184.408343:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346368:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773184.409025:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773184.410375:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612345856:192.168.201.137@tcp:103:rm.0 00000100:00100000:1.0:1775773184.411684:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:0.0:1775773184.411905:0:160415:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1775773184.411932:0:160415:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625253376 00000100:00100000:0.0:1775773184.411943:0:160415:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625253376 00000100:00100000:0.0:1775773184.412030:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 13 00000100:00100000:0.0:1775773184.412042:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1d0e09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:8403:x1862023625253376:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775773184.412065:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1775773184.412170:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775773184.412178:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1d0e09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:8403:x1862023625253376:12345-192.168.201.137@tcp:104: Request processed in 138us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1775773184.412186:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 13 00010000:00010000:3.0:1775773184.412844:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775773184.412854:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.412867:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d0e34e00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773184.412873:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.412882:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.412891:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.412924:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773184.412986:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.412993:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775773184.413017:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.413025:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d0e34e00/0x8a9f4e958445eb86 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297dab2d8 expref: -99 pid: 168128 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773184.413041:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773184.413043:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773184.413045:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773184.413068:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775773184.413085:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612346496:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773184.420432:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612346496:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773184.444846:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346368:192.168.201.137@tcp:36:rm.0 00000080:00200000:3.0:1775773184.444907:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x40:0x0](ffff8de1c40821c8) 00000080:00200008:2.0:1775773184.445635:0:168140:0:(file.c:447:ll_file_release()) START file d80d.replay-single:[0x200027cd1:0xa:0x0](ffff8de1c407f448), flags 704000 00010000:00010000:2.0:1775773184.445690:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773184.445790:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.445812:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.445824:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:2.0:1775773184.445834:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:2.0:1775773184.445842:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.445849:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.445853:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.445862:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c180fc10 00010000:00010000:2.0:1775773184.445866:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:2.0:1775773184.445875:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:2.0:1775773184.445892:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773184.445913:0:168140:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=0 00000080:00200000:2.0:1775773184.445918:0:168140:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:2.0:1775773184.445933:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80d.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.446212:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.446222:0:168140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.446234:0:168140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773184.446262:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346624:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773184.447328:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142e40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.453697:0:168140:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252867 gen 1 00000100:00100000:2.0:1775773184.453718:0:168140:0:(client.c:3131:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8de1d0f99180 x1862023612339328/t360777252867(360777252867) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1775773184.453778:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346624:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773184.453808:0:168140:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453825:0:168140:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453831:0:168140:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453842:0:168140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453850:0:168140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453865:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453871:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453875:0:168140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773184.453881:0:168140:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2fb80 x1862023612346624/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773184.453892:0:168140:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.453900:0:168140:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/10 (0 0) 00000080:00200000:2.0:1775773184.453906:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773184.453940:0:168140:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xa:0x0], updating i_size 4096 00000080:00200000:2.0:1775773184.453942:0:168140:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xa:0x0](ffff8de1c407f448): rc = 0 00000080:00010000:2.0:1775773184.453949:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) for lock 0x8a9f4e958445ec5f 00000080:00010000:2.0:1775773184.453962:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xa:0x0](ffff8de1c407f448) 00000080:00010000:2.0:1775773184.453966:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec5f from it ffff9ba1c180fe00 00010000:00010000:2.0:1775773184.453970:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773184.454234:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773184.454277:0:168140:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773184.454298:0:168140:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773184.454310:0:168140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:2.0:1775773184.454322:0:168140:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:2.0:1775773184.454330:0:168140:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773184.454335:0:168140:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773184.454338:0:168140:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eb7f 00000080:00010000:2.0:1775773184.454353:0:168140:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eb7f from it ffff9ba1c180fd88 00010000:00010000:2.0:1775773184.454357:0:168140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:2.0:1775773184.454363:0:168140:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:2.0:1775773184.454373:0:168140:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:2.0:1775773184.454382:0:168140:0:(namei.c:2305:ll_rmdir()) VFS Op:name=d80d.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:2.0:1775773184.454408:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:2.0:1775773184.454437:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.454449:0:168140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:2.0:1775773184.454497:0:168140:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f99180 x1862023612339328/t360777252867(360777252867) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773184.454507:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773184.454512:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2fb80 x1862023612346880/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773184.454540:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346880:192.168.201.137@tcp:35:rm.0 00000100:00100000:2.0:1775773184.454634:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142e40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.457876:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612346880:192.168.201.137@tcp:35:rm.0 00000002:00100000:2.0:1775773184.457925:0:168140:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f99180 x1862023612339328/t360777252867(360777252867) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773200 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1775773184.458190:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.458202:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.458210:0:168140:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:2.0:1775773184.458217:0:168140:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1775773184.458220:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ec5f lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab8dc expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773184.458235:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ec3c lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab60b expref: -99 pid: 168140 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773184.458258:0:168140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445eb7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab0e0 expref: -99 pid: 167505 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000020:00100000:2.0:1775773184.458285:0:168140:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773184.458292:0:168140:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2fb80 x1862023612347136/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773184.458318:0:168140:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612347136:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773184.458483:0:168140:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5142e40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773184.463543:0:168140:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168140:1862023612347136:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773184.463606:0:168140:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0xa:0x0](ffff8de1c407f448) 00010000:00010000:0.0:1775773184.769239:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773185.803519:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773186.816940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773187.840674:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773188.864557:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773189.444905:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612347264:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.444996:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347520:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.445026:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347776:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.445054:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775773189.445070:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347392:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.445093:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347648:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.461175:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347392:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.461192:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347648:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.461204:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347520:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.461213:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612347776:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773189.463511:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612347264:192.168.201.137@tcp:400:kworker.0 00010000:00010000:1.0:1775773189.888810:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773190.918349:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1775773191.531974:0:168706:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80e: DNE: create remote dir, drop MDT1 rep, fail MDT0 ========================================================== 18:19:50 (1775773190) 00000080:00200000:3.0:1775773191.927906:0:168719:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773191.927935:0:168719:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773191.928005:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.928032:0:168719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.928042:0:168719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773191.928660:0:168719:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168719:1862023612347904:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773191.928775:0:168719:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f240 going to sleep for 11 seconds 00000100:00100000:3.0:1775773191.931926:0:168719:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252872 gen 1 00000100:00100000:3.0:1775773191.931954:0:168719:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168719:1862023612347904:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773191.931975:0:168719:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.931985:0:168719:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.931996:0:168719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932005:0:168719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932026:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932035:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932291:0:168719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773191.932303:0:168719:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0e74e00 x1862023612347904/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773207 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773191.932316:0:168719:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932329:0:168719:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1775773191.932335:0:168719:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773191.932362:0:168719:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:3.0:1775773191.932367:0:168719:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec66 00000080:00010000:3.0:1775773191.932372:0:168719:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773191.932376:0:168719:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec66 from it ffff9ba1c109fb58 00010000:00010000:3.0:1775773191.932379:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932389:0:168719:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773191.932407:0:168719:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773191.932425:0:168719:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=13 00000080:00200000:3.0:1775773191.932429:0:168719:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:3.0:1775773191.932449:0:168719:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80e.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773191.932483:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932491:0:168719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.932500:0:168719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773191.932517:0:168719:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168719:1862023612348032:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773191.932571:0:168719:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c797f240 going to sleep for 11 seconds 00010000:00010000:1.0:1775773191.936262:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773191.942407:0:168719:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168719:1862023612348032:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773191.942428:0:168719:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942441:0:168719:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942448:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942455:0:168719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942463:0:168719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942469:0:168719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3385600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773191.942473:0:168719:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942479:0:168719:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942486:0:168719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942493:0:168719:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773191.942499:0:168719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773191.942505:0:168719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385600/0x8a9f4e958445ec6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168719 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773191.942521:0:168719:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d0e74e00 x1862023612348032/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/584 e 0 to 0 dl 1775773207 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773191.942534:0:168719:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1775773191.942655:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773191.942668:0:168719:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1775773191.942677:0:168719:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec66 from it ffff9ba1c109f930 00010000:00010000:2.0:1775773191.942680:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773191.942687:0:168719:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773191.943233:0:168719:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773191.943249:0:168719:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773191.943258:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773191.943266:0:168719:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773191.943273:0:168719:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773191.943279:0:168719:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773191.943282:0:168719:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec66 00000080:00010000:2.0:1775773191.943286:0:168719:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec66 from it ffff9ba1c109fbe8 00010000:00010000:2.0:1775773191.943289:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773191.943296:0:168719:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773191.943305:0:168719:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773191.943312:0:168719:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=16392 00000080:00200008:2.0:1775773191.943336:0:168719:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773191.943340:0:168719:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773191.943347:0:168719:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773191.943353:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773191.943360:0:168719:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773191.943367:0:168719:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773191.943371:0:168719:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773191.943373:0:168719:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec66 00000080:00010000:2.0:1775773191.943377:0:168719:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec66 from it ffff9ba1c109fcb8 00010000:00010000:2.0:1775773191.943380:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773191.943386:0:168719:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:2.0:1775773191.944394:0:168719:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773191.944400:0:168719:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773191.944410:0:168719:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773191.944419:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773191.944429:0:168719:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773191.944436:0:168719:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773191.944441:0:168719:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773191.944443:0:168719:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec66 00000080:00010000:2.0:1775773191.944447:0:168719:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec66 from it ffff9ba1c109fcb8 00010000:00010000:2.0:1775773191.944450:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773191.944464:0:168719:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773191.944578:0:168719:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773191.944586:0:168719:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773191.944594:0:168719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773191.944603:0:168719:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773191.944610:0:168719:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773191.944613:0:168719:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773191.944616:0:168719:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec66 00000080:00010000:2.0:1775773191.944619:0:168719:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec66 from it ffff9ba1c109fbb0 00010000:00010000:2.0:1775773191.944622:0:168719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1775773191.944629:0:168719:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:2.0:1775773191.944636:0:168719:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:2.0:1775773191.944643:0:168719:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 300000 00000080:00200080:2.0:1775773191.944660:0:168719:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c03066f0 arg=7ffced651030 00000080:00200000:2.0:1775773191.944672:0:168719:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) name=d80e.replay-single stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:2.0:1775773191.944694:0:168719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1775773191.945358:0:168719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1775773191.945367:0:168719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773191.945370:0:168719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385a00/0x8a9f4e958445ec66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab98b expref: -99 pid: 168719 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:2.0:1775773191.945394:0:168719:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773191.945405:0:168719:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ce00 x1862023612348288/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 568/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773191.945429:0:168719:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168719:1862023612348288:192.168.201.137@tcp:36:lfs.0 00000100:00100000:2.0:1775773191.945568:0:168719:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773191.959388:0:168719:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168719:1862023612348288:192.168.201.137@tcp:36:lfs.0 00000080:00200000:2.0:1775773191.959436:0:168719:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00200000:2.0:1775773191.959442:0:168719:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000080:00200008:2.0:1775773191.959474:0:168719:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 300000 00000080:00200000:1.0:1775773192.925072:0:168729:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773192.925103:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773192.925414:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.925424:0:168729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.925435:0:168729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773192.925462:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348416:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773192.925550:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1775773192.927698:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348416:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775773192.928525:0:168729:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928541:0:168729:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928553:0:168729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928566:0:168729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928579:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928600:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928606:0:168729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773192.928619:0:168729:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0a30a80 x1862023612348416/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773208 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773192.928633:0:168729:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.928646:0:168729:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1775773192.928652:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775773192.929094:0:168729:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:1.0:1775773192.929104:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773192.929110:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773192.929113:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c17c7b58 00010000:00010000:1.0:1775773192.929117:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.929131:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773192.929159:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773192.929177:0:168729:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=29 00000080:00200000:1.0:1775773192.929181:0:168729:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=0 00000002:00010000:1.0:1775773192.929204:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80e.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1775773192.929244:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.929252:0:168729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.929261:0:168729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773192.929283:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348544:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773192.929368:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1775773192.932152:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348544:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775773192.932176:0:168729:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932195:0:168729:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932203:0:168729:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932216:0:168729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932227:0:168729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932240:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932248:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932256:0:168729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773192.932266:0:168729:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8de1d0a30a80 x1862023612348544/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773208 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773192.932279:0:168729:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932289:0:168729:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/13 (0 0) 00000080:00200000:1.0:1775773192.932295:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1775773192.932322:0:168729:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000080:00200000:1.0:1775773192.932326:0:168729:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xd:0x0](ffff8de1c37b42c8): rc = 0 00000080:00010000:1.0:1775773192.932330:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ec7b 00000080:00010000:1.0:1775773192.932343:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:1.0:1775773192.932347:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec7b from it ffff9ba1c17c7a28 00010000:00010000:1.0:1775773192.932350:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932358:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773192.932389:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773192.932405:0:168729:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags=13 00000080:00200000:1.0:1775773192.932410:0:168729:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), intent=getattr 00000002:00010000:1.0:1775773192.932428:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xd:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773192.932464:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932471:0:168729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.932480:0:168729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773192.932499:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348672:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773192.932569:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1775773192.950092:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348672:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775773192.950115:0:168729:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950130:0:168729:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950140:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950147:0:168729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950155:0:168729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950161:0:168729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b9400 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775773192.950165:0:168729:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950172:0:168729:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950180:0:168729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950186:0:168729:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773192.950192:0:168729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.950198:0:168729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9400/0x8a9f4e958445ec82 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773192.950217:0:168729:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d0a30a80 x1862023612348672/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773208 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773192.950232:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xd:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1775773192.950270:0:168729:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/13 (0 0) 00000080:00200000:1.0:1775773192.950342:0:168729:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773192.950355:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773192.950363:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773192.950374:0:168729:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773192.950380:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773192.950384:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773192.950387:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773192.950391:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c17c7be8 00010000:00010000:1.0:1775773192.950394:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773192.950402:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773192.950413:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773192.950419:0:168729:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=16408 00000080:00200000:1.0:1775773192.950424:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773192.950439:0:168729:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags=16392 00000080:00200000:1.0:1775773192.950443:0:168729:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), intent=getattr 00000002:00010000:1.0:1775773192.950453:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xd:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773192.951629:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.951645:0:168729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.951657:0:168729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773192.951685:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348800:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773192.952638:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afd80 going to sleep for 11 seconds 00010000:00010000:2.0:1775773192.960685:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773192.967214:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348800:192.168.201.137@tcp:101:lfs.0 00010000:00010000:1.0:1775773192.967238:0:168729:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967252:0:168729:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967258:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967264:0:168729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967272:0:168729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967277:0:168729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b9200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:1.0:1775773192.967281:0:168729:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967286:0:168729:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967292:0:168729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967298:0:168729:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1775773192.967303:0:168729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773192.967308:0:168729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445ec89 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773192.967325:0:168729:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8de1d0a30a80 x1862023612348800/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773208 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773192.967338:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xd:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1775773192.970405:0:168729:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/13 (0 0) 00000080:00200000:2.0:1775773192.970509:0:168729:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773192.970528:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773192.970542:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773192.970555:0:168729:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773192.970569:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773192.970576:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773192.970579:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:2.0:1775773192.970587:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c17c7b58 00010000:00010000:2.0:1775773192.970591:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773192.970599:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773192.970613:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773192.970619:0:168729:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=13 00000080:00200008:2.0:1775773192.970629:0:168729:0:(file.c:6226:ll_getattr_dentry()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773192.970632:0:168729:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8),name=d80e.replay-single 00000002:00010000:2.0:1775773192.970644:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773192.970649:0:168729:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 30 res 8590097617/13 (0 0) 00010000:00010000:2.0:1775773192.970687:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.970696:0:168729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.970706:0:168729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773192.971163:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348928:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773192.971299:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773192.994379:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612348928:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773192.994404:0:168729:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994421:0:168729:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994429:0:168729:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994440:0:168729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994450:0:168729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994462:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994469:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994475:0:168729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773192.994487:0:168729:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2ed80 x1862023612348928/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773208 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773192.994501:0:168729:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994512:0:168729:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/13 (0 0) 00000080:00200000:2.0:1775773192.994517:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773192.994544:0:168729:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000080:00010000:2.0:1775773192.994550:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ec90 00000080:00010000:2.0:1775773192.994557:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:2.0:1775773192.994560:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec90 from it ffff9ba1c17c7cb8 00010000:00010000:2.0:1775773192.994563:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.994570:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775773192.995337:0:168729:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773192.995344:0:168729:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773192.995361:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773192.995372:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773192.995384:0:168729:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773192.995391:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773192.995396:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773192.995399:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:2.0:1775773192.995404:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c17c7cb8 00010000:00010000:2.0:1775773192.995407:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773192.995416:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773192.995545:0:168729:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773192.995554:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773192.995560:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773192.995568:0:168729:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773192.995574:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773192.995577:0:168729:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773192.995580:0:168729:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:2.0:1775773192.995583:0:168729:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c17c7bf8 00010000:00010000:2.0:1775773192.995586:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773192.995593:0:168729:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773192.995601:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773192.995607:0:168729:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=267 00000080:00200000:2.0:1775773192.995612:0:168729:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 44 00000080:00200008:2.0:1775773192.995618:0:168729:0:(file.c:1057:ll_file_open()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags 300000 00000002:00010000:2.0:1775773192.995631:0:168729:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0240300001 00010000:00010000:2.0:1775773192.995673:0:168729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773192.995681:0:168729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773192.995691:0:168729:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773192.995698:0:168729:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ed80 x1862023612349184/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773192.995708:0:168729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773192.998211:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612349184:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773192.998409:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773193.007326:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ed80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612349184:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773193.007350:0:168729:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007364:0:168729:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007371:0:168729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007378:0:168729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007387:0:168729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007398:0:168729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d49c00 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773193.007402:0:168729:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007410:0:168729:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007418:0:168729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007425:0:168729:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775773193.007431:0:168729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773193.007436:0:168729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49c00/0x8a9f4e958445ec97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 168729 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773193.007453:0:168729:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773208 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773193.007465:0:168729:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773208 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773193.007482:0:168729:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773193.007508:0:168729:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000002:00100000:2.0:1775773193.007527:0:168729:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773208 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:2.0:1775773193.007598:0:168729:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) cmd=c03066f0 arg=7ffcd436b180 00000080:00200000:2.0:1775773193.007614:0:168729:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) name=remote_dir stripe_offset=1 stripe_count=0, hash_type=0 00000020:00100000:2.0:1775773193.007671:0:168729:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773193.007677:0:168729:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2fb80 x1862023612349440/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773193.007698:0:168729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612349440:192.168.201.137@tcp:36:lfs.0 00000100:00100000:2.0:1775773193.007798:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773193.017648:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775773193.017773:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625263232 00000100:00100000:1.0:1775773193.017783:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625263232 00000100:00100000:0.0:1775773193.018154:0:160415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 14 00000100:00100000:0.0:1775773193.018168:0:160415:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c7025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:8404:x1862023625263232:12345-192.168.201.137@tcp:104: 00010000:00010000:0.0:1775773193.018186:0:160415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773193.018264:0:160415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1775773193.018270:0:160415:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c7025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:8404:x1862023625263232:12345-192.168.201.137@tcp:104: Request processed in 108us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1775773193.018279:0:160415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 14 00010000:00010000:3.0:1775773193.018344:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775773193.018351:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018359:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d48800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773193.018363:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018371:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018380:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018407:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773193.018450:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018458:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775773193.018498:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018507:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ec90 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297daba17 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773193.018522:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773193.018524:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773193.018526:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773193.018532:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775773193.018545:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612349568:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773193.023057:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612349568:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775773193.986865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773194.560130:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612349696:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773194.563546:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773194.563578:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612349824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773194.568220:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612349952:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773194.569100:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612350080:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773194.578440:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612350208:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773194.578695:0:2405:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252874 gen 1 00000100:00100000:2.0:1775773194.578718:0:2405:0:(client.c:3131:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773208 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1775773194.578759:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612349824:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773194.578774:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612349696:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773194.582455:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612350208:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773194.582477:0:2402:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 34359738437 gen 1 00000100:00100000:0.0:1775773194.582690:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612349952:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773194.588544:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612350080:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773195.008433:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773196.033235:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775773196.872961:0:168739:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775773196.872983:0:168739:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773196.873016:0:168739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773196.873041:0:168739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773196.873060:0:168739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775773196.873069:0:168739:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773196.873080:0:168739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773196.873085:0:168739:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773196.873094:0:168739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c1d6bcb8 00010000:00010000:1.0:1775773196.873098:0:168739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773196.873108:0:168739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200008:1.0:1775773196.874085:0:168739:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775773196.874092:0:168739:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773196.874104:0:168739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773196.874117:0:168739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773196.874130:0:168739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775773196.874137:0:168739:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773196.874143:0:168739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773196.874146:0:168739:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773196.874150:0:168739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c1d6bcb8 00010000:00010000:1.0:1775773196.874154:0:168739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773196.874162:0:168739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1775773196.874982:0:168739:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773196.874997:0:168739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773196.875008:0:168739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:1.0:1775773196.875022:0:168739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1775773196.875029:0:168739:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773196.875035:0:168739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773196.875038:0:168739:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773196.875042:0:168739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c1d6bbb0 00010000:00010000:1.0:1775773196.875045:0:168739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:1.0:1775773196.875053:0:168739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:1.0:1775773196.875062:0:168739:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:1.0:1775773196.875071:0:168739:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:1.0:1775773196.876036:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:1.0:1775773196.876060:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b93400 uarg=0000000000000000 00800000:00000004:1.0:1775773196.876069:0:168739:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9160, max_age 9172 00000100:00100000:1.0:1775773196.876125:0:168739:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350336:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773196.876713:0:168739:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773196.879754:0:168739:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350336:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773196.879789:0:168739:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:0.0:1775773196.881450:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:0.0:1775773196.881488:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660e800 uarg=0000000000000000 00800000:00000004:0.0:1775773196.881499:0:168739:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9160, max_age 9172 00000100:00100000:0.0:1775773196.881556:0:168739:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350464:192.168.201.137@tcp:41:lfs.0 00000100:00100000:0.0:1775773196.881672:0:168739:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c67eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773196.883644:0:168739:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8de1e006a000: committing for last_committed 34359738438 gen 1 00000100:00100000:2.0:1775773196.883667:0:168739:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350464:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773196.883694:0:168739:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317328/353529 objects 1023719/1024000 00000080:00200080:2.0:1775773196.883773:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883787:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883794:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883796:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883800:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883802:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883804:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883806:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883809:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883810:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883812:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883814:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883816:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883817:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883819:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883821:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883823:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883824:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883826:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883828:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883830:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883831:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883833:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883835:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883837:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883838:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883840:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883842:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883843:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883846:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883849:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883851:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883853:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883855:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883857:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883858:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883860:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883862:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883864:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883865:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883867:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883869:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883870:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883872:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883874:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883875:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883877:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883879:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883881:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883882:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883884:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883886:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883888:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883889:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883892:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883894:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883897:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883898:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883900:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883902:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883904:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883905:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883907:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883909:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883911:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883912:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883914:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883916:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883918:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883921:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883925:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883937:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883942:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883945:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883948:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883951:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883955:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883958:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883961:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883966:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883970:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883973:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883977:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883980:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883983:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883985:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883987:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883989:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883991:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883992:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883994:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883996:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.883998:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.883999:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884001:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884003:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884005:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884006:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884008:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884010:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884012:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884013:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884015:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884017:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884020:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884022:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884024:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884026:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884028:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884029:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884031:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884033:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884035:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884036:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884038:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884040:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884042:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884043:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884046:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884050:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884053:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884056:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884059:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884062:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884065:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00800000:00000080:2.0:1775773196.884068:0:168739:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.884071:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.884079:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00020000:00000004:2.0:1775773196.884088:0:168739:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9160, max_age 9172 00000100:00100000:2.0:1775773196.884129:0:168739:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350592:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773196.884205:0:168739:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd240 going to sleep for 11 seconds 00000100:00100000:2.0:1775773196.886538:0:168739:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350592:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773196.886567:0:168739:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:2.0:1775773196.886691:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.886709:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00020000:00000004:2.0:1775773196.886716:0:168739:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9160, max_age 9172 00000100:00100000:2.0:1775773196.886786:0:168739:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350720:192.168.201.137@tcp:13:lfs.0 00000100:00100000:2.0:1775773196.886851:0:168739:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd240 going to sleep for 11 seconds 00000100:00100000:2.0:1775773196.894028:0:168739:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168739:1862023612350720:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773196.894066:0:168739:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:2.0:1775773196.894296:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894318:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894326:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894330:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894334:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894337:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894340:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894343:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894346:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894349:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894352:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894355:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894359:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894363:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894367:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894370:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894373:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894377:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894380:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894383:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894386:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894389:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894392:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894395:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894399:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894402:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894405:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894408:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894412:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894415:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894419:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894421:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894425:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894427:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894430:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894433:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894436:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894438:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894442:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894445:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894448:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894451:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894455:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894459:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894463:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894465:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894469:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894472:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894476:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894479:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894482:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894485:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894488:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894491:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894494:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894497:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894501:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894503:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894507:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894510:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894513:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894516:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894519:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894523:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894526:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894529:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894532:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894535:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894538:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894541:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894545:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894548:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894551:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894553:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894557:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894560:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894563:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894566:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894569:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894571:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894575:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894578:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894581:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894583:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894587:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894589:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894593:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894596:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894601:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894604:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894607:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894610:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894613:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894616:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894619:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894622:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894625:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894628:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894632:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894635:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894638:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894641:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894645:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894648:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894652:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894655:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894659:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894662:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894666:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894669:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894672:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894675:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894679:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894683:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894687:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894690:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894693:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894695:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894698:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894701:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894705:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894708:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894711:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894714:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200080:2.0:1775773196.894717:0:168739:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffed72815c0 00020000:00000080:2.0:1775773196.894720:0:168739:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052000 uarg=0000000000000000 00000080:00200008:2.0:1775773196.894831:0:168739:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:1.0:1775773196.935531:0:168746:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773196.935573:0:168746:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773196.935597:0:168746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:1.0:1775773196.935616:0:168746:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:1.0:1775773196.935626:0:168746:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773196.935636:0:168746:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773196.935640:0:168746:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773196.935650:0:168746:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c1bebbd0 00010000:00010000:1.0:1775773196.935654:0:168746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:1.0:1775773196.935665:0:168746:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:1.0:1775773196.935685:0:168746:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773196.935702:0:168746:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=1536 00000080:00200000:1.0:1775773196.935707:0:168746:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773196.935713:0:168746:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773196.935720:0:168746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:1.0:1775773196.935753:0:168746:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:1.0:1775773196.935759:0:168746:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773196.935765:0:168746:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773196.935767:0:168746:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773196.935771:0:168746:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c1bebcd0 00010000:00010000:1.0:1775773196.935774:0:168746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:1.0:1775773196.935781:0:168746:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:1.0:1775773196.935790:0:168746:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775773196.935795:0:168746:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773196.935802:0:168746:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773196.935808:0:168746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:1.0:1775773196.935816:0:168746:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:1.0:1775773196.935823:0:168746:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773196.935826:0:168746:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773196.935828:0:168746:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec74 00000080:00010000:1.0:1775773196.935831:0:168746:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec74 from it ffff9ba1c1bebdb0 00010000:00010000:1.0:1775773196.935834:0:168746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:1.0:1775773196.935841:0:168746:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00000080:00200000:1.0:1775773196.935853:0:168746:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:1.0:1775773196.935858:0:168746:0:(namei.c:2106:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=33188, excl=1 00000080:00200000:1.0:1775773196.935862:0:168746:0:(namei.c:2061:ll_mknod()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) mode 100644 dev 0 00010000:00010000:1.0:1775773196.935896:0:168746:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00010000:00010000:1.0:1775773196.935975:0:168746:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00010000:00010000:1.0:1775773196.935983:0:168746:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773196.935986:0:168746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ec74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dab9c3 expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00000020:00100000:1.0:1775773196.936018:0:168746:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773196.936033:0:168746:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33800 x1862023612350976/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773196.936065:0:168746:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168746:1862023612350976:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:2.0:1775773196.936834:0:168746:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773196.940321:0:168746:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job mcreate:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168746:1862023612350976:192.168.201.137@tcp:36:mcreate.0 00000080:00200000:2.0:1775773196.940391:0:168746:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x200027cd1:0xe:0x0](ffff8de1c37b3248) 00000080:00200000:2.0:1775773196.940494:0:168746:0:(namei.c:2114:ll_create_nd()) VFS Op:name=fsa-oleg137-client.virtnet, unhashed 1 00000080:00200000:2.0:1775773196.997802:0:168749:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773196.997846:0:168749:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773196.997950:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 168749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773196.997964:0:168749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773196.997977:0:168749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 168749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773196.998011:0:168749:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168749:1862023612351104:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773196.998130:0:168749:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd240 going to sleep for 11 seconds 00000100:00100000:2.0:1775773197.009238:0:168749:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168749:1862023612351104:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773197.009272:0:168749:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009287:0:168749:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009302:0:168749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009316:0:168749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009331:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009340:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009348:0:168749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773197.009361:0:168749:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2ce00 x1862023612351104/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773212 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773197.009382:0:168749:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009397:0:168749:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1775773197.009405:0:168749:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773197.009442:0:168749:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:2.0:1775773197.009449:0:168749:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec9e 00000080:00010000:2.0:1775773197.009456:0:168749:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773197.009460:0:168749:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec9e from it ffff9ba1c1bebb58 00010000:00010000:2.0:1775773197.009463:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009472:0:168749:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773197.009505:0:168749:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773197.009532:0:168749:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=8 00000080:00200000:2.0:1775773197.009538:0:168749:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:2.0:1775773197.009567:0:168749:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: fsa-oleg137-client.virtnet,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773197.009691:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 168749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009700:0:168749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.009709:0:168749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 168749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773197.010051:0:168749:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168749:1862023612351232:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773197.010138:0:168749:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd240 going to sleep for 11 seconds 00000100:00100000:2.0:1775773197.012854:0:168749:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168749:1862023612351232:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773197.012875:0:168749:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012895:0:168749:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012902:0:168749:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012911:0:168749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012920:0:168749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012948:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012955:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.012962:0:168749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773197.012977:0:168749:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2ce00 x1862023612351232/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 600/584 e 0 to 0 dl 1775773213 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773197.012989:0:168749:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.013000:0:168749:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/14 (0 0) 00000080:00200000:2.0:1775773197.013008:0:168749:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773197.013032:0:168749:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xe:0x0], updating i_size 0 00000080:00200000:2.0:1775773197.013035:0:168749:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xe:0x0](ffff8de1c37b3248): rc = 0 00000080:00200000:2.0:1775773197.013091:0:168749:0:(file.c:6766:ll_layout_conf()) [0x200027cd1:0xe:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1775773197.013118:0:168749:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xe:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445eca5 00000080:00010000:2.0:1775773197.013132:0:168749:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xe:0x0](ffff8de1c37b3248) 00000080:00010000:2.0:1775773197.013135:0:168749:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eca5 from it ffff9ba1c1bebb20 00010000:00010000:2.0:1775773197.013139:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773197.013147:0:168749:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775773197.013190:0:168749:0:(file.c:6226:ll_getattr_dentry()) START file fsa-oleg137-client.virtnet:[0x200027cd1:0xe:0x0](ffff8de1c37b3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773197.013198:0:168749:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xe:0x0](ffff8de1c37b3248),name=fsa-oleg137-client.virtnet 00000002:00010000:2.0:1775773197.013221:0:168749:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773197.013231:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773197.013242:0:168749:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773197.013251:0:168749:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773197.013255:0:168749:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xe:0x0](ffff8de1c37b3248) 00000080:00010000:2.0:1775773197.013257:0:168749:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xe:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445eca5 00000080:00010000:2.0:1775773197.013260:0:168749:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eca5 from it ffff9ba1c1bebcb8 00010000:00010000:2.0:1775773197.013262:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773197.013267:0:168749:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773197.013323:0:168749:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773197.013328:0:168749:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773197.013333:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773197.013337:0:168749:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773197.013342:0:168749:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773197.013343:0:168749:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773197.013345:0:168749:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec9e 00000080:00010000:2.0:1775773197.013347:0:168749:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec9e from it ffff9ba1c1bebc10 00010000:00010000:2.0:1775773197.013348:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773197.013353:0:168749:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773197.013359:0:168749:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773197.013367:0:168749:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=fsa-oleg137-client.virtnet, flags=0 00000080:00200000:2.0:1775773197.013371:0:168749:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773197.013373:0:168749:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773197.013376:0:168749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773197.013381:0:168749:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773197.013384:0:168749:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773197.013386:0:168749:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773197.013387:0:168749:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445ec9e 00000080:00010000:2.0:1775773197.013388:0:168749:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ec9e from it ffff9ba1c1bebd68 00010000:00010000:2.0:1775773197.013390:0:168749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773197.013393:0:168749:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773197.013397:0:168749:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:2.0:1775773197.013401:0:168749:0:(namei.c:2395:ll_unlink()) VFS Op:name=fsa-oleg137-client.virtnet, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:2.0:1775773197.013428:0:168749:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773197.013448:0:168749:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773197.013463:0:168749:0:(vvp_object.c:117:vvp_conf_set()) [0x200027cd1:0xe:0x0]: losing layout lock 00010000:00010000:2.0:1775773197.013503:0:168749:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773197.013511:0:168749:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773197.013517:0:168749:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775773197.013520:0:168749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49a00/0x8a9f4e958445eca5 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297daba80 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773197.013539:0:168749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49400/0x8a9f4e958445ec9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297daba64 expref: -99 pid: 168749 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1775773197.013558:0:168749:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773197.013566:0:168749:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ce00 x1862023612351488/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773197.013603:0:168749:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168749:1862023612351488:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773197.013923:0:168749:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd240 going to sleep for 11 seconds 00000100:00100000:2.0:1775773197.017229:0:168749:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168749:1862023612351488:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773197.017341:0:168749:0:(vvp_io.c:1817:vvp_io_init()) [0x200027cd1:0xe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1775773197.017353:0:168749:0:(vvp_io.c:288:vvp_io_fini()) [0x200027cd1:0xe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1775773197.017382:0:168749:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0xe:0x0](ffff8de1c37b3248) 00010000:00010000:3.0:1775773197.059304:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773198.080646:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773199.104045:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773199.680279:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612351744:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.680366:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352000:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.680399:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1775773199.680406:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612351616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.680436:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612351872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.680465:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.689163:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612351616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.689182:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612351872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.689194:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.689209:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612351744:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773199.689218:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352000:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773200.127974:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773201.152091:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773202.176151:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775773202.825482:0:168822:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 00010000:00010000:3.0:1775773203.199931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773204.231810:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773204.291176:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 1 seconds 00000100:00100000:0.0:1775773204.800598:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612352384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773204.800619:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612352256:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773204.800834:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612352640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773204.800866:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773204.800921:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773204.809601:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612352640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773204.809964:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773204.811891:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612352512:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775773204.811942:0:2403:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff8de1e006a000 of lustre-MDT0000_UUID@192.168.201.137@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1775773204.811949:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1775773204.811953:0:2403:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection to lustre-MDT0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1775773204.811961:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773204.811967:0:2403:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9150 00000100:00080000:1.0:1775773204.811978:0:2403:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773204.811993:0:2403:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773204.812029:0:2403:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a33b80 x1862023612352896/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773204.812065:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612352384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773204.813071:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612352896:192.168.201.137@tcp:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1775773204.819245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773204.819281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:1.0:1775773204.819288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612352896:192.168.201.137@tcp:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1775773205.250076:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773205.312306:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 1 seconds 00010000:00010000:2.0:1775773206.272265:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773206.335911:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 1 seconds 00010000:00010000:3.0:1775773207.297280:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773207.360154:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 1 seconds 00010000:00010000:2.0:1775773208.325913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773208.383918:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 1 seconds 00010000:00010000:3.0:1775773209.346267:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1775773209.408072:0:168729:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773193/real 1775773193] req@ffff8de1d0f2fb80 x1862023612349440/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 560/576 e 0 to 1 dl 1775773209 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773209.408128:0:168729:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1775773209.408134:0:168729:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection to lustre-MDT0001 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1775773209.408142:0:168729:0:(import.c:416:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1775773209.408185:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00000100:00100000:0.0:1775773209.408495:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612353024:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775773209.408639:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773209.408644:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773209.408648:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773209.408654:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9181 00000100:00080000:1.0:1775773209.408664:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775773209.408671:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773209.408684:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773209.409400:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a32a00 x1862023612353152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773209.409424:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773209.409428:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773209.409431:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773209.409437:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9146 00000100:00080000:1.0:1775773209.409446:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773209.409454:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773209.409454:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612353152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773209.409473:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a32680 x1862023612353280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773209.409542:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612353280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773209.409645:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612353408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773209.409682:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775773209.409688:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612353536:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773209.416173:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773209.416197:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775773209.416204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612353152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773209.418831:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612353536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773209.418855:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612353408:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775773209.424807:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to target with instance 8 00000100:00080000:1.0:1775773209.424845:0:2401:0:(import.c:1295:ptlrpc_connect_interpret()) reconnected to lustre-MDT0001_UUID@192.168.201.137@tcp after partition 00000100:00080000:1.0:1775773209.424849:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1775773209.424857:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1775773209.425528:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00080000:3.0:1775773209.425548:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000ccb34c4c): req@ffff8de1d0f2fb80 x1862023612349440/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 560/576 e 0 to 1 dl 1775773209 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773209.425578:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612353280:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775773209.425717:0:168729:0:(client.c:3711:ptlrpc_set_mbits()) resend with new mbits old x1862023612349440 new x1862023612353664 00000100:00100000:0.0:1775773209.425829:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773209.483933:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612349440:192.168.201.137@tcp:36:lfs.0 00000080:00200000:2.0:1775773209.484019:0:168729:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00200000:2.0:1775773209.484029:0:168729:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000080:00200008:2.0:1775773209.484098:0:168729:0:(file.c:447:ll_file_release()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags 300000 00000002:00100000:2.0:1775773209.484189:0:168729:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773208 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773209.484203:0:168729:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773209.484208:0:168729:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2fb80 x1862023612353920/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00080000:2.0:1775773209.484233:0:168729:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8de1d0f2fb80 x1862023612353920/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1775773209.484244:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773210.367998:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773210.495932:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773211.392133:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773211.521787:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773212.416850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773212.544480:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773213.441691:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773213.568070:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773214.464151:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773214.530971:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773214.530980:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773214.530991:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773214.531004:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9186 00000100:00080000:1.0:1775773214.531023:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1775773214.531032:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773214.531050:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773214.531091:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0a33480 x1862023612354176/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773214.531411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612354176:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773214.531424:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612354304:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773214.531955:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612354560:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773214.534330:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612354048:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773214.549516:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612354432:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773214.559794:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612354304:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773214.559811:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612354560:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773214.559857:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612354432:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773214.560024:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773214.560031:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:3.0:1775773214.560035:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612354176:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773214.592018:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773215.488184:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773215.615883:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773216.512792:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773216.639856:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773217.537120:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773217.667462:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773218.560049:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773218.687955:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773219.584461:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773219.648343:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773219.648349:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773219.648365:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773219.648372:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612354688:192.168.201.137@tcp:400:kworker.0 00000100:00080000:0.0:1775773219.648377:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9191 00000100:00080000:0.0:1775773219.648395:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1775773219.648403:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773219.648418:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773219.648441:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7026a00 x1862023612354816/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773219.648483:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1775773219.648487:0:139607:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8de1e006a000: disconnect after 23s idle 00000100:00100000:1.0:1775773219.648494:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1775773219.648499:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1775773219.648503:0:139607:0:(import.c:2095:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff8de1e006a000: disconnect after 23s idle 00000100:00100000:1.0:1775773219.648504:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612354944:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773219.648686:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612354816:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773219.648745:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355072:192.168.201.137@tcp:9:kworker.0 00000100:00100000:3.0:1775773219.648774:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355200:192.168.201.137@tcp:9:kworker.0 00000100:00080000:3.0:1775773219.652137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773219.652155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:3.0:1775773219.652161:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612354816:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773219.652185:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1c7024380 x1862023612355072/t0(0) o9->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773229 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773219.652196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:3.0:1775773219.652200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355072:192.168.201.137@tcp:9:kworker.0 00000100:00080000:3.0:1775773219.652212:0:2401:0:(import.c:2005:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8de1c7027480 x1862023612355200/t0(0) o9->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 0 dl 1775773229 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773219.652227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:3.0:1775773219.652230:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355200:192.168.201.137@tcp:9:kworker.0 00000100:00100000:0.0:1775773219.655770:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612354944:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773219.711998:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773220.610774:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1775773220.671906:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773204/real 1775773204] req@ffff8de1c7024a80 x1862023612352256/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773220 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773220.671948:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7024a80 x1862023612352256/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773220 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773220.671964:0:2402:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1775773220.671968:0:2402:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.137@tcp: Connection to MGS (at 192.168.201.137@tcp) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1775773220.671972:0:2402:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.201.137@tcp for MGC192.168.201.137@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1775773220.671974:0:2402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1775773220.671978:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c7024a80 x1862023612352256/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773220 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773220.671986:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0a33b80 x1862023612353024/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773220.672016:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0a31180 x1862023612354048/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773220.672024:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c7024000 x1862023612354688/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773235 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1775773220.672033:0:2402:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1775773220.672036:0:2402:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1775773220.672037:0:2402:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1775773220.672039:0:2402:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1775773220.672085:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612354688:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773220.672094:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612354048:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773220.672100:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612352256:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773220.672264:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773220.672271:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773220.672275:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773220.672282:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9127 00000100:00080000:2.0:1775773220.672299:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773220.672357:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2dc00 x1862023612355328/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773220.672387:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773220.672391:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773220.672393:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773220.672396:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9196 00000100:00080000:2.0:1775773220.672401:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773220.672404:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773220.672416:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773220.672432:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c380 x1862023612355456/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773220.672487:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612355584:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773220.672769:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612355328:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773220.672812:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355456:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773220.674663:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612353024:192.168.201.137@tcp:400:kworker.0 00000100:00080000:3.0:1775773220.681318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773220.681350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:3.0:1775773220.681357:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355456:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773220.681683:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612355584:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773220.735823:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773221.631955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773221.759900:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773222.655945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773222.783853:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773223.679894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773223.812090:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773224.704299:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773224.704391:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773224.704400:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1775773224.704403:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773224.704407:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773224.704412:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773224.704425:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9197 00000100:00080000:3.0:1775773224.704450:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773224.704459:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773224.704475:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773224.704521:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e74380 x1862023612355712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773224.704609:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775773224.704630:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612355840:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773224.704844:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355712:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773224.719129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773224.719148:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775773224.719156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773224.719263:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612355840:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773224.832696:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00000100:00080000:3.0:1775773225.728621:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773225.728637:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1775773225.728642:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773225.728648:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773225.728655:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773225.728669:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9201 00000100:00080000:3.0:1775773225.728686:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773225.728695:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773225.728711:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773225.728782:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e75500 x1862023612355968/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773225.728880:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612356096:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773225.730309:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355968:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775773225.731546:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773225.735678:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612356096:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773225.736087:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773225.736095:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775773225.736099:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612355968:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773225.857062:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1775773226.752049:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773226.880569:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773227.778568:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773227.903856:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1775773228.802499:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773228.927919:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773229.828160:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773229.951901:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00000100:00100000:2.0:1775773230.847951:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773220/real 1775773220] req@ffff8de1d0f2dc00 x1862023612355328/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773230.847981:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2dc00 x1862023612355328/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773230.847997:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773230.848021:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773230.848024:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612355328:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773230.849698:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773230.849705:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773230.849708:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773230.849714:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9197 00000100:00080000:3.0:1775773230.849756:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1775773230.849764:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773230.849799:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e76a00 x1862023612356224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773230.849831:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773230.849835:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773230.849837:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773230.849841:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9202 00000100:00080000:3.0:1775773230.849844:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773230.849848:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773230.849857:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773230.849868:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e75500 x1862023612356352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773230.849907:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775773230.849922:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612356480:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773230.850056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612356224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773230.850087:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612356352:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775773230.850908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773230.853686:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.137@tcp: connect to target with instance 0 10000000:01000000:2.0:1775773230.853701:0:2401:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:02000400:2.0:1775773230.853708:0:2401:0:(import.c:1282:ptlrpc_connect_interpret()) Evicted from MGS (at 192.168.201.137@tcp) after server handle changed from 0x3797d62297daac87 to 0x3797d62297dababf 00000100:00080000:2.0:1775773230.853712:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1775773230.853717:0:2401:0:(import.c:1667:ptlrpc_import_recovery_state_machine()) evicted from MGS@192.168.201.137@tcp; invalidating 00000100:00100000:3.0:1775773230.854005:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612356480:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773230.857528:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612356224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773230.857573:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773230.857577:0:169046:0:(import.c:1591:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.201.137@tcp to MGS@192.168.201.137@tcp 00000100:00080000:2.0:1775773230.857578:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-19) 00000100:00100000:2.0:1775773230.857581:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612356352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773230.857582:0:169046:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1775773230.857586:0:169046:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1775773230.857603:0:169046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1775773230.857613:0:169046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1775773230.857619:0:169046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1775773230.857631:0:169046:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773230.857639:0:169046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d3384a00/0x8a9f4e958445eb63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297daac95 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773230.857651:0:169046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1775773230.857658:0:169046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1775773230.857663:0:169046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1775773230.857671:0:169046:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773230.857674:0:169046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35c00/0x8a9f4e958445eb71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297daaca3 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773230.857688:0:169046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1775773230.857694:0:169046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1775773230.857699:0:169046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1775773230.857709:0:169046:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773230.857713:0:169046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1d0e35800/0x8a9f4e958445eb78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297daaeb0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773230.857946:0:169046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1775773230.857954:0:169046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1775773230.857963:0:169046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1775773230.857974:0:169046:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773230.857978:0:169046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1c512e000/0x8a9f4e958445eb6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3797d62297daac9c expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775773230.857993:0:169046:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1775773230.857999:0:169046:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from RECOVER to FULL 10000000:01000000:3.0:1775773230.858001:0:169046:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1775773230.858003:0:169046:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:3.0:1775773230.858007:0:169046:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) MGC192.168.201.137@tcp: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00100000:2.0:1775773230.980400:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773231.875425:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773231.999867:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 10000000:01000000:2.0:1775773232.640937:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:2.0:1775773232.640944:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 350 10000000:01000000:2.0:1775773232.640949:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:2.0:1775773232.640994:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773232.641007:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773232.641017:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773232.641044:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356608:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1775773232.641131:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.645113:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356608:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775773232.645160:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.645173:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.645264:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356736:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.646511:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.654152:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356736:192.168.201.137@tcp:256:ll_cfg_requeue.0 10000000:01000000:1.0:1775773232.654196:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' failed (-2). 00010000:00010000:1.0:1775773232.654206:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.654218:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000400:1.0:1775773232.654234:0:160428:0:(mgc_request.c:1917:mgc_process_log()) MGC192.168.201.137@tcp: IR log lustre-cliir failed, not fatal: rc = -2 10000000:01000000:1.0:1775773232.654240:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1775773232.654242:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-client-ffff8de1e006a000 from 52 10000000:01000000:1.0:1775773232.654245:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1775773232.654283:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.654292:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.654319:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.654341:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356864:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.654421:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.661483:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356864:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775773232.661514:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabacd expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.661533:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297dabacd expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.661624:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356992:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.661720:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.677990:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612356992:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.678050:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357120:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.678420:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.685192:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357120:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:2.0:1775773232.686386:0:169047:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1775773232.686872:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1775773232.686889:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1775773232.686899:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabacd expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.686910:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9e00/0x8a9f4e958445ecb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabacd expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773232.686919:0:160428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1775773232.686922:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log params-ffff8de1e006a000 from 7 10000000:01000000:1.0:1775773232.686925:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1775773232.686960:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.686968:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.686983:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.687006:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357248:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.687084:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.693158:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357248:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775773232.693187:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabad4 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.693199:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297dabad4 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.693277:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357376:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.694488:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.698091:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357376:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.698171:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357504:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.698323:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.713625:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357504:192.168.201.137@tcp:503:ll_cfg_requeue.0 00000040:00080000:2.0:1775773232.717496:0:169048:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1775773232.719829:0:160428:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1775773232.720983:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1775773232.720999:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabad4 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.721016:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9000/0x8a9f4e958445ecba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabad4 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1775773232.721026:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1775773232.721029:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-sptlrpc-ffff8de1e005cd40 from 1 10000000:01000000:1.0:1775773232.721032:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1775773232.721071:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.721079:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.721090:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.721508:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357632:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.721681:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.726981:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357632:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775773232.727011:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabadb expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.727024:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297dabadb expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773232.727103:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357760:192.168.201.137@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1775773232.727559:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773232.730979:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612357760:192.168.201.137@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1775773232.731023:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1775773232.731034:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabadb expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773232.731044:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9600/0x8a9f4e958445ecc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabadb expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773232.899709:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773233.026069:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00000100:00100000:0.0:1775773233.588232:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775773233.588373:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625282304 00000100:00100000:1.0:1775773233.588388:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625282304 00000100:00100000:1.0:1775773233.588458:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 15 00000100:00100000:1.0:1775773233.588468:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c7024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:201207:x1862023625282304:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775773233.588485:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773233.588575:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775773233.588582:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c7024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c+3:201207:x1862023625282304:12345-192.168.201.137@tcp:104: Request processed in 115us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1775773233.588590:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 15 00010000:00010000:3.0:1775773233.589663:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775773233.589676:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773233.589688:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d49200 already unused, calling callback (ffffffffc1197c20) 10000000:00010000:3.0:1775773233.589693:0:160426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773233.589705:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1775773233.589713:0:160426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1775773233.589720:0:160426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1775773233.589820:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773233.589832:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1775773233.589921:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612357888:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775773233.590057:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773233.590066:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.137@tcp lock: ffff8de1c5d49200/0x8a9f4e958445ecac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3797d62297dabac6 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773233.590089:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773233.590091:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773233.590093:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773233.602166:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612357888:192.168.201.137@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775773233.920253:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773234.050571:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 10000000:01000000:1.0:1775773234.688802:0:160428:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:1.0:1775773234.688812:0:160428:0:(mgc_request.c:1819:mgc_process_log()) Process log lustre-cliir-ffff8de1e006a000 from 350 10000000:01000000:1.0:1775773234.688819:0:160428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:1.0:1775773234.688886:0:160428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773234.688902:0:160428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773234.688916:0:160428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773234.688953:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612358016:192.168.201.137@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1775773234.689073:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773234.707405:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612358016:192.168.201.137@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1775773234.707441:0:160428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabbfa expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773234.707458:0:160428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3797d62297dabbfa expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773234.707554:0:160428:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612358144:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1775773234.707657:0:160428:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773234.744289:0:160428:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:160428:1862023612358144:192.168.201.137@tcp:256:ll_cfg_requeue.0 00000020:00000080:1.0:1775773234.744366:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:1.0:1775773234.744513:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:1.0:1775773234.744551:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 00000020:00000080:1.0:1775773234.744587:0:160428:0:(obd_config.c:1468:class_process_config()) processing cmd: cf00f 10000000:01000000:1.0:1775773234.744649:0:160428:0:(mgc_request.c:1896:mgc_process_log()) MGC192.168.201.137@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:1.0:1775773234.744661:0:160428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabbfa expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773234.744673:0:160428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.137@tcp lock: ffff8de1c29b9400/0x8a9f4e958445ecc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3797d62297dabbfa expref: -99 pid: 160428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775773234.788999:0:169065:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 30, was 0): DISCONN 00010000:00080000:3.0:1775773234.789037:0:169065:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8de1c3008000@lustre-MDT0000-mdc-ffff8de1e006a000: found existing conn 192.168.201.137@tcp, moved to head 00000100:00080000:3.0:1775773234.789045:0:169065:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773234.789056:0:169065:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 0 00000100:00080000:3.0:1775773234.789067:0:169065:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773234.789082:0:169065:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773234.789117:0:169065:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e74700 x1862023612358272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773234.789294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612358272:192.168.201.137@tcp:38:lctl.0 00010000:00080000:1.0:1775773234.810606:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8de1d0e74700 x1862023612358272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/416 e 0 to 0 dl 1775773244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'lctl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773234.810643:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to target with instance 85 00000100:00080000:1.0:1775773234.810666:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1775773234.810675:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1775773234.810679:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252874 gen 1 00000100:00100000:1.0:1775773234.810686:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0a33800 x1862023612350976/t360777252879(360777252879) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773212 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773234.810697:0:2401:0:(client.c:3170:ptlrpc_free_committed()) @@@ free closed open request req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773208 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1775773234.810709:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 360777252874 last 0 00000100:00080000:1.0:1775773234.810717:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0a33800 x1862023612350976/t360777252879(360777252879) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773212 ref 1 fl New:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773234.810776:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612358272:192.168.201.137@tcp:38:lctl.0 00000100:00100000:1.0:1775773234.810815:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612350976:192.168.201.137@tcp:36:mcreate.0 00010000:00010000:3.0:1775773234.944126:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773235.072629:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1775773235.972311:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773236.033269:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level REPLAY/5 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773236.033277:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY) 00000100:00100000:0.0:1775773236.033493:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612358400:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773236.033624:0:2402:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775773236.033631:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612358528:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773236.048430:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612358528:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773236.055762:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612358400:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773236.097345:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773236.993047:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773237.122987:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1775773238.017594:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773238.145971:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1775773239.040267:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773239.167921:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1775773239.230023:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0a33800 x1862023612350976/t360777252879(360777252879) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773250 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.230040:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1775773239.230044:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252874 gen 1 00000100:00100000:0.0:1775773239.230049:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0a33800 x1862023612350976/t360777252879(360777252879) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 528/448 e 0 to 0 dl 1775773250 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.230057:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 360777252874 last 360777252879 00000100:00080000:0.0:1775773239.230066:0:2401:0:(client.c:3524:ptlrpc_replay_req()) @@@ REPLAY req@ffff8de1d0f2ce00 x1862023612351488/t360777252880(360777252880) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773213 ref 1 fl New:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773239.230079:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612350976:192.168.201.137@tcp:36:mcreate.0 00000100:00100000:0.0:1775773239.230104:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612351488:192.168.201.137@tcp:36:rm.0 00000100:00100000:0.0:1775773239.240605:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252879 gen 1 00000100:00100000:0.0:1775773239.240647:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f2ce00 x1862023612351488/t360777252880(360777252880) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773255 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.240664:0:2401:0:(client.c:3409:ptlrpc_replay_interpret()) @@@ got reply req@ffff8de1d0f2ce00 x1862023612351488/t360777252880(360777252880) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773255 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.240674:0:2401:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1775773239.240677:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252879 gen 1 00000100:00100000:0.0:1775773239.240681:0:2401:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff8de1d0f2ce00 x1862023612351488/t360777252880(360777252880) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/456 e 0 to 0 dl 1775773255 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.240689:0:2401:0:(recover.c:53:ptlrpc_replay_next()) import ffff8de1c3008000 from lustre-MDT0000_UUID committed 360777252879 last 360777252880 00000100:00080000:0.0:1775773239.240694:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1775773239.241610:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612351488:192.168.201.137@tcp:36:rm.0 00010000:00080000:0.0:1775773239.241679:0:169103:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-mdc-ffff8de1e006a000 to lustre-MDT0000_UUID@192.168.201.137@tcp 00010000:00010000:0.0:1775773239.241686:0:169103:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-mdc-ffff8de1e006a000 (1) 00010000:00010000:0.0:1775773239.241767:0:169103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ec7b lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x3797d62297dab9df expref: -99 pid: 168729 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1775773239.241794:0:169103:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-mdc-ffff8de1e006a000 00000100:00080000:0.0:1775773239.242578:0:169103:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1775773239.243009:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612358656:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000100:00100000:0.0:1775773239.271624:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8de1e006a000: committing for last_committed 360777252880 gen 1 00000100:00080000:0.0:1775773239.271664:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1775773239.271681:0:2401:0:(client.c:3204:ptlrpc_resend_req()) @@@ going to resend req@ffff8de1c7025880 x1862023612358656/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773255 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.271693:0:2401:0:(client.c:3213:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8de1c7025880 x1862023612358656/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 0 dl 1775773255 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773239.271711:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1775773239.275077:0:2401:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection restored to 192.168.201.137@tcp (at 192.168.201.137@tcp) 00000100:00080000:2.0:1775773239.275095:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000ccb34c4c): req@ffff8de1d0f2fb80 x1862023612353920/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1775773239.275141:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612358656:192.168.201.137@tcp:400:ldlm_lock_repla.0 00000100:00100000:0.0:1775773239.276181:0:168729:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773239.319587:0:168729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:168729:1862023612353920:192.168.201.137@tcp:35:lfs.0 00000002:00080000:0.0:1775773239.319617:0:168729:0:(mdc_request.c:1003:mdc_close()) @@@ Reset ESTALE = -116 req@ffff8de1d0f2fb80 x1862023612353920/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/456 e 0 to 0 dl 1775773255 ref 1 fl Complete:RQU/600/0 rc -116/-116 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773239.319650:0:168729:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2ed80 x1862023612349184/t360777252874(360777252874) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773208 ref 1 fl Complete:RMQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1775773240.064798:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773240.064999:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612358912:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773240.065149:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773240.065157:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612358784:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773240.080310:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612358912:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773240.088621:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612358784:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773241.089094:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773242.115548:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773243.151102:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:2.0:1775773244.122010:0:169157:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773244.122028:0:169157:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773244.122057:0:169157:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773244.127047:0:169157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.127073:0:169157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.127087:0:169157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773244.127136:0:169157:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359040:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773244.127253:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd300 going to sleep for 11 seconds 00000100:00100000:2.0:1775773244.130894:0:169157:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359040:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773244.130929:0:169157:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.130942:0:169157:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.130956:0:169157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.130973:0:169157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.130986:0:169157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.130994:0:169157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.131001:0:169157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773244.131011:0:169157:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2d880 x1862023612359040/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773260 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773244.131025:0:169157:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.131039:0:169157:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1775773244.131046:0:169157:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773244.131080:0:169157:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 61440 00000080:00010000:2.0:1775773244.131085:0:169157:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773244.131092:0:169157:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773244.131095:0:169157:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0da3cb8 00010000:00010000:2.0:1775773244.131098:0:169157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773244.131124:0:169157:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1775773244.131987:0:169157:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1775773244.131996:0:169157:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773244.132020:0:169157:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773244.132034:0:169157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773244.132049:0:169157:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773244.132057:0:169157:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773244.132062:0:169157:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773244.132066:0:169157:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773244.132072:0:169157:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0da3cb8 00010000:00010000:2.0:1775773244.132076:0:169157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773244.132084:0:169157:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773244.132233:0:169157:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773244.132242:0:169157:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773244.132249:0:169157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773244.132263:0:169157:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773244.132270:0:169157:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773244.132274:0:169157:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773244.132277:0:169157:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773244.132280:0:169157:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0da3bb0 00010000:00010000:2.0:1775773244.132283:0:169157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773244.132290:0:169157:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773244.132299:0:169157:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:2.0:1775773244.132307:0:169157:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:2.0:1775773244.132401:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.132419:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00800000:00000004:2.0:1775773244.132427:0:169157:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9173, max_age 9219 00000100:00100000:2.0:1775773244.132475:0:169157:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359168:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773244.132563:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd300 going to sleep for 11 seconds 00000100:00100000:2.0:1775773244.138120:0:169157:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359168:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773244.138161:0:169157:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:2.0:1775773244.138263:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.138284:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00800000:00000004:2.0:1775773244.138293:0:169157:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9173, max_age 9219 00000100:00100000:2.0:1775773244.138395:0:169157:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359296:192.168.201.137@tcp:41:lfs.0 00000100:00100000:2.0:1775773244.138555:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5cdd300 going to sleep for 11 seconds 00000100:00100000:2.0:1775773244.150455:0:169157:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359296:192.168.201.137@tcp:41:lfs.0 00800000:00000004:2.0:1775773244.150495:0:169157:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317337/353529 objects 1023720/1024000 00000080:00200080:2.0:1775773244.150591:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150616:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150630:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150635:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150640:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150643:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150647:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150651:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150655:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150658:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150663:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150666:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150670:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150673:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150677:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150680:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150684:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150687:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150690:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150693:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150699:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150703:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150717:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150760:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150767:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150773:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150778:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150781:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150785:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150788:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150792:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150796:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150800:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150804:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150808:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150811:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150815:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150819:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150823:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150826:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150831:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150834:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150838:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150841:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150845:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150850:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150854:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150857:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150861:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150865:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150869:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150873:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150877:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150880:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150884:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150887:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150891:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150894:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150898:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150902:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.150906:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.150910:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152392:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.152493:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152503:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.152508:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152512:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.152515:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152519:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.152522:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152526:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.152530:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152534:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:2.0:1775773244.152537:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c8052800 uarg=0000000000000000 00000080:00200080:2.0:1775773244.152540:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156624:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156677:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156691:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156696:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156700:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156703:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156707:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156710:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156713:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156716:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156718:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156738:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156742:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156745:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156748:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156751:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156753:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156756:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156759:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156762:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156765:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156767:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156770:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156773:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156775:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156778:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156781:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156784:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156786:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156790:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156793:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156797:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156800:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156803:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156805:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156808:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156811:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156814:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156817:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156820:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156823:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156826:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156829:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156833:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156836:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156839:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156841:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156844:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156846:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156848:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00800000:00000080:3.0:1775773244.156850:0:169157:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00000080:00200080:3.0:1775773244.156852:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:3.0:1775773244.156857:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c3ee3800 uarg=0000000000000000 00020000:00000004:3.0:1775773244.156864:0:169157:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9173, max_age 9220 00000100:00080000:3.0:1775773244.156889:0:169157:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9151 00000100:00080000:3.0:1775773244.156910:0:169157:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773244.156984:0:169157:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:3.0:1775773244.157017:0:169157:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0e76d80 x1862023612359424/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773244.157056:0:169157:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1d0e76680 x1862023612359552/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773244.157065:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9300 going to sleep for 0 seconds 00000100:00100000:2.0:1775773244.157266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612359424:192.168.201.137@tcp:8:lfs.0 00010000:00010000:2.0:1775773244.161529:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773244.162345:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8de1e006a000: committing for last_committed 38654705666 gen 7 00000100:00080000:3.0:1775773244.162364:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8de1e006a000: connect to target with instance 9 00000100:00080000:3.0:1775773244.162376:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:3.0:1775773244.162390:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775773244.162397:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775773244.162404:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1775773244.162420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000080:00000004:3.0:1775773244.162429:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:3.0:1775773244.162431:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:3.0:1775773244.162449:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 0000000007b67c3e): req@ffff8de1d0e76680 x1862023612359552/t0(0) o13->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773244.169152:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1ca3e9300 going to sleep for 11 seconds 00000100:00100000:3.0:1775773244.175256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612359424:192.168.201.137@tcp:8:lfs.0 00000100:00100000:2.0:1775773244.176784:0:169157:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359552:192.168.201.137@tcp:13:lfs.0 00020000:00000004:2.0:1775773244.176811:0:169157:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:0.0:1775773244.177086:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.177121:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00020000:00000004:0.0:1775773244.177132:0:169157:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9173, max_age 9220 00000100:00080000:0.0:1775773244.177149:0:169157:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9151 00000100:00080000:0.0:1775773244.177162:0:169157:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773244.177176:0:169157:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8437760, lost: 0. 00000100:00100000:0.0:1775773244.177207:0:169157:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7026300 x1862023612359680/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773244.177268:0:169157:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8de1c7025f80 x1862023612359808/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773244.177280:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baf540 going to sleep for 0 seconds 00000100:00100000:2.0:1775773244.177365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612359680:192.168.201.137@tcp:8:lfs.0 00000100:00100000:2.0:1775773244.186221:0:2401:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8de1e006a000: committing for last_committed 0 gen 7 00000100:00080000:2.0:1775773244.186245:0:2401:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8de1e006a000: connect to target with instance 1 00000100:00080000:2.0:1775773244.186257:0:2401:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8de1e006a000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:2.0:1775773244.186272:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1775773244.186279:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1775773244.186287:0:2401:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1775773244.186292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000080:00000004:2.0:1775773244.186301:0:2401:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1775773244.186303:0:2401:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1775773244.186318:0:2401:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000ec915d57): req@ffff8de1c7025f80 x1862023612359808/t0(0) o13->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773244.186351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612359680:192.168.201.137@tcp:8:lfs.0 00000100:00100000:0.0:1775773244.186637:0:169157:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7baf540 going to sleep for 11 seconds 00000100:00100000:0.0:1775773244.190819:0:169157:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169157:1862023612359808:192.168.201.137@tcp:13:lfs.0 00020000:00000004:0.0:1775773244.190854:0:169157:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:0.0:1775773244.191413:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191440:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191450:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191456:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191460:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191465:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191469:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191473:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191478:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191482:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191486:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191490:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191495:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191499:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191504:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191508:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191512:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191517:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191521:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191525:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191530:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191534:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191539:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191543:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191547:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191553:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191557:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191562:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191566:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191570:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191574:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191578:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191582:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191586:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191589:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191593:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191596:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191600:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191604:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191607:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191611:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191614:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191618:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191622:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191626:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191629:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191633:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191636:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191640:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191643:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191648:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191652:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191657:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191660:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191664:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191667:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191672:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191676:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191680:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191684:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191688:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191691:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191696:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191700:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191704:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191708:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191713:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191717:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191748:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191753:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191759:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191763:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191767:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191771:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191775:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191780:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191784:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191789:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191793:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191798:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191803:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191807:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191812:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191816:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191821:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191825:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191829:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191834:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191838:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191842:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191846:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191849:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191853:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191857:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191861:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191864:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191868:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191872:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191890:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191895:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191901:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191905:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.191909:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.191923:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192082:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192091:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192108:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192113:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192118:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192122:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192126:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192129:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192133:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192137:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192141:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192145:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192148:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192152:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192156:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192159:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192164:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192167:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192170:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192173:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200080:0.0:1775773244.192177:0:169157:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7fffe5490b20 00020000:00000080:0.0:1775773244.192182:0:169157:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1c660f800 uarg=0000000000000000 00000080:00200008:0.0:1775773244.192200:0:169157:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00010000:00010000:0.0:1775773245.187401:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773245.248410:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612359936:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.248541:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612360192:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.248575:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612360448:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773245.248691:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360064:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773245.248757:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360320:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.256533:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612359936:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.256699:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612360192:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.256716:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612360448:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.256793:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360064:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773245.256806:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360320:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773246.211433:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773247.236150:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775773247.710898:0:169408:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1775773248.260699:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773249.281072:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1775773250.076390:0:169564:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1775773250.304706:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773250.373608:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612360576:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.373747:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360832:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.373781:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612361088:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.373815:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1775773250.377628:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360704:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.377757:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.397772:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360704:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.397794:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360960:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.397805:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2403:1862023612360576:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.397816:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612360832:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773250.397828:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612361088:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773251.330780:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773252.359898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1775773252.535388:0:169603:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775773252.535405:0:169603:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773252.535435:0:169603:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773252.535458:0:169603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773252.535475:0:169603:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775773252.535484:0:169603:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773252.535493:0:169603:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773252.535497:0:169603:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773252.535506:0:169603:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d7fcb8 00010000:00010000:1.0:1775773252.535511:0:169603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773252.535521:0:169603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:1.0:1775773252.536704:0:169603:0:(file.c:6226:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1775773252.536714:0:169603:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773252.537111:0:169603:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773252.537131:0:169603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775773252.537146:0:169603:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1775773252.537155:0:169603:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773252.537163:0:169603:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773252.537166:0:169603:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773252.537173:0:169603:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d7fcb8 00010000:00010000:1.0:1775773252.537176:0:169603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1775773252.537184:0:169603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775773252.537322:0:169603:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773252.537331:0:169603:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773252.537338:0:169603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773252.537347:0:169603:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1775773252.537359:0:169603:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773252.537362:0:169603:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773252.537366:0:169603:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773252.537369:0:169603:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d7fbb0 00010000:00010000:1.0:1775773252.537372:0:169603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773252.537379:0:169603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775773252.537389:0:169603:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 44 00000080:00200008:1.0:1775773252.537397:0:169603:0:(file.c:1057:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200080:1.0:1775773252.537597:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.537615:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00800000:00000004:1.0:1775773252.537623:0:169603:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9220, max_age 9228 00000100:00100000:1.0:1775773252.537682:0:169603:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361216:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773252.537872:0:169603:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773252.546332:0:169603:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361216:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773252.546371:0:169603:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: update ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00000080:00200080:1.0:1775773252.546484:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.546505:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00800000:00000004:1.0:1775773252.546514:0:169603:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9221, max_age 9228 00000100:00100000:1.0:1775773252.546559:0:169603:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361344:192.168.201.137@tcp:41:lfs.0 00000100:00100000:1.0:1775773252.546645:0:169603:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773252.556183:0:169603:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361344:192.168.201.137@tcp:41:lfs.0 00800000:00000004:1.0:1775773252.556222:0:169603:0:(obd_class.h:1118:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: update ffff8de1c5515190 cache blocks 317337/353529 objects 1023720/1024000 00000080:00200080:1.0:1775773252.556320:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556343:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556352:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556357:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556361:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556365:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556369:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556373:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556377:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556380:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556384:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556387:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556391:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556395:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556399:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556403:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556407:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556411:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556415:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556419:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556423:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556427:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556431:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556436:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556441:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556445:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556449:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556452:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556456:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556460:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556464:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556468:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556472:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556475:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556479:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556482:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556486:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556489:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556493:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556496:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556500:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556503:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556506:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556509:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556513:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556516:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556519:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556523:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556527:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556531:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556535:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556538:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556542:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556546:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556551:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556554:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556558:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556561:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556565:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556568:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556572:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556575:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556579:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556583:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556587:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556590:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556595:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556598:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556603:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556607:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556610:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556614:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556618:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556621:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556625:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556628:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556632:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556635:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556639:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556642:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556646:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556649:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556653:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556656:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556659:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556663:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556666:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556670:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556674:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556677:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556681:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556685:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556689:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556692:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556696:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556700:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556703:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556706:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556711:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556714:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556718:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556764:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556770:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556774:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556778:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556782:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556786:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556789:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556793:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556797:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556801:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556805:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556809:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556812:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556816:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556819:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556822:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556826:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556830:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556833:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556837:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556840:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556844:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556848:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556851:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00800000:00000080:1.0:1775773252.556854:0:169603:0:(lmv_obd.c:907:lmv_iocontrol()) lustre-clilmv-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.556859:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.556866:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00020000:00000004:1.0:1775773252.556877:0:169603:0:(obd_class.h:1092:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: age 9221, max_age 9228 00000100:00100000:1.0:1775773252.556923:0:169603:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361472:192.168.201.137@tcp:13:lfs.0 00000100:00100000:1.0:1775773252.557014:0:169603:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773252.563571:0:169603:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361472:192.168.201.137@tcp:13:lfs.0 00020000:00000004:1.0:1775773252.563612:0:169603:0:(obd_class.h:1118:obd_statfs()) lustre-OST0000-osc-ffff8de1e006a000: update ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00000080:00200080:1.0:1775773252.563710:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.563769:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00020000:00000004:1.0:1775773252.563780:0:169603:0:(obd_class.h:1092:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: age 9221, max_age 9228 00000100:00100000:1.0:1775773252.563825:0:169603:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361600:192.168.201.137@tcp:13:lfs.0 00000100:00100000:1.0:1775773252.563902:0:169603:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773252.571854:0:169603:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169603:1862023612361600:192.168.201.137@tcp:13:lfs.0 00020000:00000004:1.0:1775773252.571897:0:169603:0:(obd_class.h:1118:obd_statfs()) lustre-OST0001-osc-ffff8de1e006a000: update ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00200080:1.0:1775773252.572025:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572051:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572060:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572065:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572069:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572073:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572077:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572082:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572086:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572089:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572093:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572097:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572100:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572104:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572109:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572112:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572117:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572120:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572124:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572128:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572132:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572135:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572139:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572142:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572146:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572150:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572154:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572158:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572162:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572166:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572171:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572174:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572178:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572181:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572185:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572190:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572194:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572198:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572202:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572205:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572209:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572213:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572217:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572221:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572225:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572228:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572232:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572235:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572239:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572242:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572246:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572250:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572254:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572257:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572261:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572264:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572267:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572272:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572275:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572278:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572281:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572284:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572288:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572291:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572295:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572298:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572301:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572305:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572309:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572312:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572316:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572319:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572323:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572327:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572331:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572334:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572338:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572341:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572345:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572349:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572353:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572356:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572360:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572363:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572367:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572370:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572374:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572378:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572381:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572385:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572389:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572392:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572396:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572399:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572403:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572407:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572411:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572414:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572419:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572423:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572426:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572430:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572434:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572437:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572442:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572445:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572449:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572453:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572457:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572460:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572464:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572468:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572471:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572475:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572478:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572482:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572486:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572489:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572493:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572497:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572501:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572505:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572509:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572512:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200080:1.0:1775773252.572516:0:169603:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148) cmd=c00866a4 arg=7ffc93490140 00020000:00000080:1.0:1775773252.572520:0:169603:0:(lov_obd.c:961:lov_iocontrol()) lustre-clilov-ffff8de1e006a000: cmd=c00866a4 len=592 karg=ffff8de1d0b92c00 uarg=0000000000000000 00000080:00200008:1.0:1775773252.572539:0:169603:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8de1c4079148), flags 100000 00000080:00200000:1.0:1775773252.632709:0:169620:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773252.632768:0:169620:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773252.635139:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773252.635173:0:169620:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1775773252.635188:0:169620:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773252.635201:0:169620:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773252.635206:0:169620:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773252.635218:0:169620:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fbf8 00010000:00010000:1.0:1775773252.635222:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1775773252.635232:0:169620:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1775773252.635253:0:169620:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773252.635279:0:169620:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=27 00000080:00200000:1.0:1775773252.635284:0:169620:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=0 00000002:00010000:1.0:1775773252.635308:0:169620:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80e.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1775773252.635366:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773252.635374:0:169620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773252.635385:0:169620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773252.635418:0:169620:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612361728:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773252.635527:0:169620:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.647329:0:169620:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612361728:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773252.647367:0:169620:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647399:0:169620:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647409:0:169620:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647422:0:169620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647435:0:169620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647451:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647460:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647468:0:169620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.647481:0:169620:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8de1d0a33b80 x1862023612361728/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773252.647496:0:169620:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647508:0:169620:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/13 (0 0) 00000080:00200000:3.0:1775773252.647516:0:169620:0:(namei.c:943:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773252.647553:0:169620:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000080:00200000:3.0:1775773252.647557:0:169620:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xd:0x0](ffff8de1c37b42c8): rc = 0 00000080:00010000:3.0:1775773252.647563:0:169620:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ecd6 00000080:00010000:3.0:1775773252.647574:0:169620:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:3.0:1775773252.647579:0:169620:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecd6 from it ffff9ba1c147fac8 00010000:00010000:3.0:1775773252.647582:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647592:0:169620:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773252.647630:0:169620:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.647660:0:169620:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), file ffff8de1e0178780, open_flags 18800, mode 0 opened 0 00000080:00200000:3.0:1775773252.647667:0:169620:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), intent=open 00000002:00010000:3.0:1775773252.647695:0:169620:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xd:0x0], intent: open flags 0304001 00010000:00010000:3.0:1775773252.647786:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.647794:0:169620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773252.647806:0:169620:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773252.647812:0:169620:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612361984/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 656/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773252.647822:0:169620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773252.647846:0:169620:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612361984:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773252.648346:0:169620:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.658424:0:169620:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612361984:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773252.658464:0:169620:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658496:0:169620:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658508:0:169620:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658522:0:169620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658536:0:169620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658553:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658563:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658572:0:169620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.658586:0:169620:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=0 req@ffff8de1d0e76d80 x1862023612361984/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 656/608 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773252.658602:0:169620:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658615:0:169620:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 9663686441/85 (0 0) 00000002:00010000:3.0:1775773252.658637:0:169620:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x240002729:0x55:0x0], intent: open flags 0304001 00010000:00010000:3.0:1775773252.658705:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.658714:0:169620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773252.658748:0:169620:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773252.658755:0:169620:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75c00 x1862023612362240/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773252.658765:0:169620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773252.658868:0:169620:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612362240:192.168.201.137@tcp:101:lfs.0 00000100:00100000:3.0:1775773252.659313:0:169620:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.675842:0:169620:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612362240:192.168.201.137@tcp:101:lfs.0 00010000:00010000:3.0:1775773252.675870:0:169620:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675887:0:169620:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675895:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675904:0:169620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 3/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675914:0:169620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 4/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675921:0:169620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3384200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773252.675937:0:169620:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 4/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675945:0:169620:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 4/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675963:0:169620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 5/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675971:0:169620:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773252.675979:0:169620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 3/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.675994:0:169620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ece4 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 169620 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.676024:0:169620:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0e75c00 x1862023612362240/t34359738440(34359738440) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773252.676038:0:169620:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75c00 x1862023612362240/t34359738440(34359738440) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773252.676116:0:169620:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xd:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773252.676158:0:169620:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000080:00200000:3.0:1775773252.676162:0:169620:0:(namei.c:147:ll_iget()) got inode: [0x240002729:0x55:0x0](ffff8de1c37b3248): rc = 0 00000080:00010000:3.0:1775773252.676169:0:169620:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445ecdd 00000080:00010000:3.0:1775773252.676187:0:169620:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00200008:3.0:1775773252.676206:0:169620:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 304000 00000002:00100000:3.0:1775773252.676234:0:169620:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75c00 x1862023612362240/t34359738440(34359738440) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773252.676283:0:169620:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecdd from it ffff8de1c7cee900 00010000:00010000:3.0:1775773252.676289:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.676300:0:169620:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773252.676326:0:169620:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 44 00000080:00200000:3.0:1775773252.676391:0:169620:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773252.676413:0:169620:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773252.676430:0:169620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1775773252.676443:0:169620:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1775773252.676450:0:169620:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773252.676455:0:169620:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773252.676459:0:169620:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773252.676463:0:169620:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fbf8 00010000:00010000:3.0:1775773252.676466:0:169620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1775773252.676479:0:169620:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:3.0:1775773252.676488:0:169620:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.676494:0:169620:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=24 00000080:00200000:3.0:1775773252.676500:0:169620:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.676504:0:169620:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=264 00000080:00200000:3.0:1775773252.676508:0:169620:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 44 00000080:00200008:3.0:1775773252.676513:0:169620:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 504000 00000080:00200008:3.0:1775773252.676535:0:169620:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 304000 00000080:00200080:3.0:1775773252.676574:0:169620:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248) cmd=800466af arg=7ffe64ee0c2c 00000080:00200008:3.0:1775773252.676717:0:169620:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 504000 00000002:00100000:3.0:1775773252.676792:0:169620:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e75c00 x1862023612362240/t34359738440(34359738440) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773252.676804:0:169620:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773252.676809:0:169620:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612362496/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773252.676838:0:169620:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612362496:192.168.201.137@tcp:35:lfs.0 00000100:00100000:3.0:1775773252.676942:0:169620:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.692220:0:169620:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169620:1862023612362496:192.168.201.137@tcp:35:lfs.0 00000002:00100000:3.0:1775773252.692278:0:169620:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75c00 x1862023612362240/t34359738440(34359738440) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773252.721513:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773252.721548:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773252.722716:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:0.0:1775773252.722749:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:0.0:1775773252.722760:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773252.722771:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773252.722775:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773252.722783:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773252.722788:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:0.0:1775773252.722798:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:0.0:1775773252.722815:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.722825:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773252.722834:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.722838:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773252.722843:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.722861:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773252.722866:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-0, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e0161800, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773252.722878:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-0, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773252.722905:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-0,[0x240002729:0x56:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773252.722972:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.722986:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773252.723000:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773252.723013:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7026d80 x1862023612362752/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773252.723025:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773252.723052:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612362752:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773252.723823:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.748665:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612362752:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773252.748703:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748764:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 4/0,1 mode: --/PR res: [0x240002729:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748774:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 4/0,1 mode: --/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748788:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748800:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748816:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748825:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748833:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.748848:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7026d80 x1862023612362752/t34359738442(34359738442) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773252.748863:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7026d80 x1862023612362752/t34359738442(34359738442) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773252.748881:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773252.748895:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.748908:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/86 (0 0) 00000080:00200000:3.0:1775773252.748915:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773252.748946:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-0, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:3.0:1775773252.748991:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x56:0x0](ffff8de1c40780c8) 00000080:00200000:3.0:1775773252.749183:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x56:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773252.749195:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x56:0x0](ffff8de1c40780c8) 00000080:00010000:3.0:1775773252.749199:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x56:0x0](ffff8de1c40780c8) for lock 0x8a9f4e958445eceb 00000080:00010000:3.0:1775773252.749213:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x56:0x0](ffff8de1c40780c8) 00000080:00200008:3.0:1775773252.749230:0:169623:0:(file.c:1057:ll_file_open()) START file f-0:[0x240002729:0x56:0x0](ffff8de1c40780c8), flags 100102 00000002:00100000:3.0:1775773252.749258:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7026d80 x1862023612362752/t34359738442(34359738442) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773252.749303:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eceb from it ffff8de1d2190c60 00010000:00010000:3.0:1775773252.749308:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.749318:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773252.749347:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x56:0x0](ffff8de1c40780c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773252.749381:0:169623:0:(file.c:447:ll_file_release()) START file f-0:[0x240002729:0x56:0x0](ffff8de1c40780c8), flags 100002 00000002:00100000:3.0:1775773252.749437:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7026d80 x1862023612362752/t34359738442(34359738442) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773252.749448:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773252.749453:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76d80 x1862023612363008/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773252.749478:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363008:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773252.749590:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11000 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.755100:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76d80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363008:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773252.755147:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7026d80 x1862023612362752/t34359738442(34359738442) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773252.755237:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773252.755260:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773252.755284:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:3.0:1775773252.755301:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00000080:00200000:3.0:1775773252.755311:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773252.755318:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773252.755323:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773252.755331:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:3.0:1775773252.755336:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 0 00010000:00010000:3.0:1775773252.755346:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:3.0:1775773252.755364:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.755373:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:3.0:1775773252.755380:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.755384:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773252.755387:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.755408:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:3.0:1775773252.755413:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-1, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c517f080, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773252.755423:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-1, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:3.0:1775773252.755448:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-1,[0x240002729:0x57:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773252.755517:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.755527:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773252.755541:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773252.755547:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75c00 x1862023612363264/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773252.755559:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773252.755584:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363264:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773252.755803:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11000 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.763360:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363264:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773252.763399:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763439:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763448:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763463:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763476:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763499:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763510:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763518:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773252.763530:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e75c00 x1862023612363264/t34359738444(34359738444) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773252.763544:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75c00 x1862023612363264/t34359738444(34359738444) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773252.763572:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773252.763587:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763598:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/87 (0 0) 00000080:00200000:0.0:1775773252.763606:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773252.763623:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-1, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773252.763658:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x57:0x0](ffff8de1c4073a88) 00000080:00200000:0.0:1775773252.763835:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x57:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773252.763846:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x57:0x0](ffff8de1c4073a88) 00000080:00010000:0.0:1775773252.763850:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x57:0x0](ffff8de1c4073a88) for lock 0x8a9f4e958445ecf2 00000080:00010000:0.0:1775773252.763860:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x57:0x0](ffff8de1c4073a88) 00000080:00200008:0.0:1775773252.763878:0:169623:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x57:0x0](ffff8de1c4073a88), flags 100102 00000002:00100000:0.0:1775773252.763902:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75c00 x1862023612363264/t34359738444(34359738444) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773252.763942:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecf2 from it ffff8de1c7cee900 00010000:00010000:0.0:1775773252.763947:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.763964:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773252.763989:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x57:0x0](ffff8de1c4073a88), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773252.764019:0:169623:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x57:0x0](ffff8de1c4073a88), flags 100002 00000002:00100000:0.0:1775773252.764062:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e75c00 x1862023612363264/t34359738444(34359738444) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773252.764072:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773252.764077:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027800 x1862023612363520/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773252.764100:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363520:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773252.764179:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149900 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.784223:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363520:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773252.784279:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75c00 x1862023612363264/t34359738444(34359738444) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773252.784398:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773252.784422:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773252.784447:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:3.0:1775773252.784465:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00000080:00200000:3.0:1775773252.784475:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773252.784483:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773252.784488:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773252.784497:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:3.0:1775773252.784501:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 0 00010000:00010000:3.0:1775773252.784512:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00000080:00200000:3.0:1775773252.784530:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.784539:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:3.0:1775773252.784546:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.784550:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773252.784554:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.784568:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:3.0:1775773252.784574:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-2, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c517e480, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773252.784585:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-2, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:3.0:1775773252.784614:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-2,[0x240002729:0x58:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773252.784684:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.784695:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773252.784709:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773252.784716:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75880 x1862023612363776/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773252.784768:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773252.784795:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363776:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773252.784975:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11f00 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.801962:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612363776:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773252.801994:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802022:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802031:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802041:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802051:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802065:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802761:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.802769:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.802869:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e75880 x1862023612363776/t34359738446(34359738446) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773252.802884:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75880 x1862023612363776/t34359738446(34359738446) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773252.802901:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773252.803135:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.803168:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/88 (0 0) 00000080:00200000:0.0:1775773252.803181:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773252.803209:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-2, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773252.803259:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x58:0x0](ffff8de1c4076c08) 00000080:00200000:0.0:1775773252.803424:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x58:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773252.803434:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x58:0x0](ffff8de1c4076c08) 00000080:00010000:0.0:1775773252.803437:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x58:0x0](ffff8de1c4076c08) for lock 0x8a9f4e958445ecf9 00000080:00010000:0.0:1775773252.803450:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x58:0x0](ffff8de1c4076c08) 00000080:00200008:0.0:1775773252.803466:0:169623:0:(file.c:1057:ll_file_open()) START file f-2:[0x240002729:0x58:0x0](ffff8de1c4076c08), flags 100102 00000002:00100000:0.0:1775773252.803497:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75880 x1862023612363776/t34359738446(34359738446) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773252.803549:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecf9 from it ffff8de1c7cee300 00010000:00010000:0.0:1775773252.803554:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.803567:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773252.803595:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x58:0x0](ffff8de1c4076c08), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773252.803627:0:169623:0:(file.c:447:ll_file_release()) START file f-2:[0x240002729:0x58:0x0](ffff8de1c4076c08), flags 100002 00000002:00100000:0.0:1775773252.803679:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e75880 x1862023612363776/t34359738446(34359738446) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773252.803690:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773252.803696:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027100 x1862023612364032/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773252.803779:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364032:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773252.803887:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149240 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.814368:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364032:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773252.814506:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75880 x1862023612363776/t34359738446(34359738446) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773252.814605:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773252.814633:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773252.814661:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00010000:00010000:0.0:1775773252.814681:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00000080:00200000:0.0:1775773252.814693:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773252.814700:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773252.814704:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773252.814712:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773252.814717:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 0 00010000:00010000:0.0:1775773252.814768:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:0.0:1775773252.814788:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.814796:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773252.814804:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.814809:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773252.814813:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.814827:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773252.814833:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-3, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c613c300, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773252.814844:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-3, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773252.814870:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-3,[0x240002729:0x59:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773252.815378:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.815391:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773252.815407:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773252.815416:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7025180 x1862023612364288/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773252.816077:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773252.816117:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364288:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773252.816310:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149240 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.833355:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364288:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773252.833396:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833436:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833446:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833464:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833479:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833494:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833504:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833512:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773252.833525:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7025180 x1862023612364288/t34359738448(34359738448) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773252.833542:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7025180 x1862023612364288/t34359738448(34359738448) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773252.833558:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773252.833572:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.833584:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/89 (0 0) 00000080:00200000:0.0:1775773252.833591:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773252.833608:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-3, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773252.833644:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x59:0x0](ffff8de1c4071148) 00000080:00200000:0.0:1775773252.833888:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x59:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773252.833911:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x59:0x0](ffff8de1c4071148) 00000080:00010000:0.0:1775773252.833916:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x59:0x0](ffff8de1c4071148) for lock 0x8a9f4e958445ed00 00000080:00010000:0.0:1775773252.833942:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x59:0x0](ffff8de1c4071148) 00000080:00200008:0.0:1775773252.833969:0:169623:0:(file.c:1057:ll_file_open()) START file f-3:[0x240002729:0x59:0x0](ffff8de1c4071148), flags 100102 00000002:00100000:0.0:1775773252.833998:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7025180 x1862023612364288/t34359738448(34359738448) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773252.834056:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed00 from it ffff8de1d2190420 00010000:00010000:0.0:1775773252.834062:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.834073:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773252.834104:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x59:0x0](ffff8de1c4071148), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773252.834143:0:169623:0:(file.c:447:ll_file_release()) START file f-3:[0x240002729:0x59:0x0](ffff8de1c4071148), flags 100002 00000002:00100000:0.0:1775773252.834198:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7025180 x1862023612364288/t34359738448(34359738448) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773252.834211:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773252.834218:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7025500 x1862023612364544/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773252.834245:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364544:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773252.834344:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c51499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.844974:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025500 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364544:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773252.845026:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7025180 x1862023612364288/t34359738448(34359738448) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773252.845120:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773252.845145:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773252.845169:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:0.0:1775773252.845185:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:0.0:1775773252.845193:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773252.845200:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773252.845204:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773252.845212:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773252.845216:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:0.0:1775773252.845225:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:0.0:1775773252.845244:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.845253:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773252.845260:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.845263:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773252.845266:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.845281:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773252.845287:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-4, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015b080, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773252.845297:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-4, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773252.845322:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-4,[0x240002729:0x5a:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773252.845388:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.845398:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773252.845411:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773252.845418:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027b80 x1862023612364800/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773252.845428:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773252.845454:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364800:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773252.845621:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c51499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.882470:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612364800:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773252.884032:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885134:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885149:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885166:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885178:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885195:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885203:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885210:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.885227:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7027b80 x1862023612364800/t34359738450(34359738450) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773252.885239:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7027b80 x1862023612364800/t34359738450(34359738450) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773252.885253:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773252.885266:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.885276:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/90 (0 0) 00000080:00200000:3.0:1775773252.885282:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773252.885295:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-4, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:3.0:1775773252.885329:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x5a:0x0](ffff8de1c407db88) 00000080:00200000:3.0:1775773252.885448:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x5a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773252.885458:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x5a:0x0](ffff8de1c407db88) 00000080:00010000:3.0:1775773252.885461:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x5a:0x0](ffff8de1c407db88) for lock 0x8a9f4e958445ed07 00000080:00010000:3.0:1775773252.885470:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x5a:0x0](ffff8de1c407db88) 00000080:00200008:3.0:1775773252.885484:0:169623:0:(file.c:1057:ll_file_open()) START file f-4:[0x240002729:0x5a:0x0](ffff8de1c407db88), flags 100102 00000002:00100000:3.0:1775773252.885505:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7027b80 x1862023612364800/t34359738450(34359738450) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773252.886654:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed07 from it ffff8de1d2190000 00010000:00010000:3.0:1775773252.886667:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.886679:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773252.886706:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x5a:0x0](ffff8de1c407db88), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773252.886753:0:169623:0:(file.c:447:ll_file_release()) START file f-4:[0x240002729:0x5a:0x0](ffff8de1c407db88), flags 100002 00000002:00100000:3.0:1775773252.889935:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7027b80 x1862023612364800/t34359738450(34359738450) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773252.889960:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773252.889966:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77100 x1862023612365056/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773252.889991:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365056:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773252.890095:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11780 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.902395:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365056:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773252.902452:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7027b80 x1862023612364800/t34359738450(34359738450) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773252.902574:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773252.902602:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773252.902630:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1775773252.902648:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:3.0:1775773252.902657:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773252.902663:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773252.902668:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773252.902676:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:3.0:1775773252.902681:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1775773252.902691:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:3.0:1775773252.902709:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.902716:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:3.0:1775773252.905698:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.905857:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773252.905866:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:3.0:1775773252.905893:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:3.0:1775773252.905901:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-5, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c517ef00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773252.905911:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-5, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:3.0:1775773252.906025:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-5,[0x240002729:0x5b:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773252.906120:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.906131:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773252.906146:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773252.906160:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75f80 x1862023612365312/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773252.906171:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773252.906197:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365312:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773252.906420:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11780 going to sleep for 11 seconds 00000100:00100000:3.0:1775773252.918173:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365312:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773252.918203:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918236:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918245:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918257:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918269:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918282:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918291:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918297:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773252.918309:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e75f80 x1862023612365312/t34359738452(34359738452) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773252.918322:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75f80 x1862023612365312/t34359738452(34359738452) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773252.918337:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773252.918349:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918360:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/91 (0 0) 00000080:00200000:3.0:1775773252.918366:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773252.918379:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-5, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:3.0:1775773252.918413:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x5b:0x0](ffff8de1c407d348) 00000080:00200000:3.0:1775773252.918566:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x5b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773252.918579:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x5b:0x0](ffff8de1c407d348) 00000080:00010000:3.0:1775773252.918583:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x5b:0x0](ffff8de1c407d348) for lock 0x8a9f4e958445ed0e 00000080:00010000:3.0:1775773252.918592:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x5b:0x0](ffff8de1c407d348) 00000080:00200008:3.0:1775773252.918606:0:169623:0:(file.c:1057:ll_file_open()) START file f-5:[0x240002729:0x5b:0x0](ffff8de1c407d348), flags 100102 00000002:00100000:3.0:1775773252.918626:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e75f80 x1862023612365312/t34359738452(34359738452) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773252.918666:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed0e from it ffff8de1c7ceea80 00010000:00010000:3.0:1775773252.918671:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773252.918681:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773252.918703:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x5b:0x0](ffff8de1c407d348), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773252.918784:0:169623:0:(file.c:447:ll_file_release()) START file f-5:[0x240002729:0x5b:0x0](ffff8de1c407d348), flags 100002 00000002:00100000:2.0:1775773252.920351:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e75f80 x1862023612365312/t34359738452(34359738452) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773252.920371:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773252.920377:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77800 x1862023612365568/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773252.920415:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365568:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773252.920523:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052e40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773252.945005:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77800 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365568:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773252.945235:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e75f80 x1862023612365312/t34359738452(34359738452) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773252.945376:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773252.945405:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773252.945430:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1775773252.945449:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:0.0:1775773252.945459:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773252.945466:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773252.945471:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773252.945479:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773252.945485:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1775773252.945494:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:0.0:1775773252.945514:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.945522:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773252.945530:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.945535:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773252.945538:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.945557:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773252.945562:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-6, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015b380, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773252.945572:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-6, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773252.945600:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-6,[0x240002729:0x5c:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773252.945668:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.945679:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773252.945693:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773252.945699:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024700 x1862023612365824/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773252.945709:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773252.949138:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365824:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773252.949368:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149840 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.957096:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024700 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612365824:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773252.957133:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957176:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957186:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957200:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957213:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957229:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957237:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957245:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773252.957264:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7024700 x1862023612365824/t34359738454(34359738454) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773252.957279:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024700 x1862023612365824/t34359738454(34359738454) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773252.957297:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773252.957312:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957326:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/92 (0 0) 00000080:00200000:0.0:1775773252.957335:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773252.957354:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-6, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773252.957389:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x5c:0x0](ffff8de1c4071988) 00000080:00200000:0.0:1775773252.957621:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x5c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773252.957632:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x5c:0x0](ffff8de1c4071988) 00000080:00010000:0.0:1775773252.957636:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x5c:0x0](ffff8de1c4071988) for lock 0x8a9f4e958445ed15 00000080:00010000:0.0:1775773252.957649:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x5c:0x0](ffff8de1c4071988) 00000080:00200008:0.0:1775773252.957665:0:169623:0:(file.c:1057:ll_file_open()) START file f-6:[0x240002729:0x5c:0x0](ffff8de1c4071988), flags 100102 00000002:00100000:0.0:1775773252.957693:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024700 x1862023612365824/t34359738454(34359738454) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773252.957814:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed15 from it ffff8de1d2190120 00010000:00010000:0.0:1775773252.957820:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.957838:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773252.957867:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x5c:0x0](ffff8de1c4071988), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773252.957904:0:169623:0:(file.c:447:ll_file_release()) START file f-6:[0x240002729:0x5c:0x0](ffff8de1c4071988), flags 100002 00000002:00100000:0.0:1775773252.957969:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7024700 x1862023612365824/t34359738454(34359738454) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773252.957981:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773252.957987:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7026680 x1862023612366080/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773252.958013:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366080:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773252.958103:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149c00 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.965355:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026680 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366080:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773252.965401:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7024700 x1862023612365824/t34359738454(34359738454) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773252.965507:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773252.965531:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773252.965554:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:0.0:1775773252.965571:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:0.0:1775773252.965580:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773252.965588:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773252.965592:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773252.965601:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773252.965605:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:0.0:1775773252.965614:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:0.0:1775773252.965631:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.965638:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773252.965645:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.965649:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773252.965653:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773252.965667:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773252.965673:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-7, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015a600, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773252.965681:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-7, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773252.965705:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-7,[0x240002729:0x5d:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773252.965797:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.965807:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773252.965821:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773252.965828:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024e00 x1862023612366336/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773252.965838:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773252.965863:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366336:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773252.966055:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149c00 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.976219:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366336:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773252.976258:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976306:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976316:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976330:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976342:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976358:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976370:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976377:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773252.976396:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7024e00 x1862023612366336/t34359738456(34359738456) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773252.976410:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024e00 x1862023612366336/t34359738456(34359738456) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773252.976429:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773252.976445:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976456:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/93 (0 0) 00000080:00200000:0.0:1775773252.976466:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773252.976488:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-7, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773252.976540:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x5d:0x0](ffff8de1c4072a08) 00000080:00200000:0.0:1775773252.976706:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x5d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773252.976717:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x5d:0x0](ffff8de1c4072a08) 00000080:00010000:0.0:1775773252.976805:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x5d:0x0](ffff8de1c4072a08) for lock 0x8a9f4e958445ed1c 00000080:00010000:0.0:1775773252.976818:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x5d:0x0](ffff8de1c4072a08) 00000080:00200008:0.0:1775773252.976839:0:169623:0:(file.c:1057:ll_file_open()) START file f-7:[0x240002729:0x5d:0x0](ffff8de1c4072a08), flags 100102 00000002:00100000:0.0:1775773252.976870:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7024e00 x1862023612366336/t34359738456(34359738456) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773252.976934:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed1c from it ffff8de1d21909c0 00010000:00010000:0.0:1775773252.976940:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773252.976964:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773252.977172:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x5d:0x0](ffff8de1c4072a08), inode mode 81a4 mask 40 00000080:00200008:1.0:1775773252.977222:0:169623:0:(file.c:447:ll_file_release()) START file f-7:[0x240002729:0x5d:0x0](ffff8de1c4072a08), flags 100002 00000002:00100000:1.0:1775773252.977302:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7024e00 x1862023612366336/t34359738456(34359738456) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1775773252.977316:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1775773252.977322:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31c00 x1862023612366592/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1775773252.977346:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366592:192.168.201.137@tcp:35:createmany.0 00000100:00100000:1.0:1775773252.977507:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af900 going to sleep for 11 seconds 00000100:00100000:0.0:1775773252.994832:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31c00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366592:192.168.201.137@tcp:35:createmany.0 00000002:00100000:1.0:1775773252.997828:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7024e00 x1862023612366336/t34359738456(34359738456) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773252.997935:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773252.997980:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773252.997999:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1775773252.998014:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:1.0:1775773252.998022:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773252.998029:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773252.998033:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773252.998039:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:1.0:1775773252.998043:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1775773252.998050:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:1.0:1775773252.998080:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773252.998088:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:1.0:1775773252.998094:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773252.998097:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:1.0:1775773252.998100:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773252.998112:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773252.998117:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-8, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c67aed80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1775773252.998125:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-8, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:1.0:1775773252.998146:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-8,[0x240002729:0x5e:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1775773252.998200:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773252.998208:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773252.998219:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773252.998226:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33b80 x1862023612366848/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773252.998235:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773252.998257:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366848:192.168.201.137@tcp:101:createmany.0 00000100:00100000:1.0:1775773252.998396:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.007343:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612366848:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773253.007369:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007400:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007407:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007419:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007429:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007442:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007450:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007459:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.007469:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0a33b80 x1862023612366848/t34359738458(34359738458) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.007481:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a33b80 x1862023612366848/t34359738458(34359738458) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.007494:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773253.007507:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007524:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/94 (0 0) 00000080:00200000:2.0:1775773253.007531:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.007544:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-8, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:2.0:1775773253.007673:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x5e:0x0](ffff8de1c37b5348) 00000080:00200000:2.0:1775773253.007860:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x5e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773253.007870:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x5e:0x0](ffff8de1c37b5348) 00000080:00010000:2.0:1775773253.007874:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x5e:0x0](ffff8de1c37b5348) for lock 0x8a9f4e958445ed23 00000080:00010000:2.0:1775773253.007884:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x5e:0x0](ffff8de1c37b5348) 00000080:00200008:2.0:1775773253.007910:0:169623:0:(file.c:1057:ll_file_open()) START file f-8:[0x240002729:0x5e:0x0](ffff8de1c37b5348), flags 100102 00000002:00100000:2.0:1775773253.007934:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a33b80 x1862023612366848/t34359738458(34359738458) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773253.007983:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed23 from it ffff8de1c670f000 00010000:00010000:2.0:1775773253.007987:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.007996:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.008019:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x5e:0x0](ffff8de1c37b5348), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773253.008049:0:169623:0:(file.c:447:ll_file_release()) START file f-8:[0x240002729:0x5e:0x0](ffff8de1c37b5348), flags 100002 00000002:00100000:2.0:1775773253.008669:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a33b80 x1862023612366848/t34359738458(34359738458) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.008681:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.008685:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2d880 x1862023612367104/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.008708:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367104:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773253.008812:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.012853:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367104:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773253.012886:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a33b80 x1862023612366848/t34359738458(34359738458) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.012967:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.012987:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.013004:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:2.0:1775773253.013017:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:2.0:1775773253.013025:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.013031:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.013034:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.013040:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:2.0:1775773253.013044:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:2.0:1775773253.013052:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:2.0:1775773253.013075:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.013083:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:2.0:1775773253.013088:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.013092:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773253.013094:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.013105:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:2.0:1775773253.013110:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-9, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1d0b46c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773253.013117:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-9, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:2.0:1775773253.013137:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-9,[0x240002729:0x5f:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773253.013186:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.013199:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773253.013209:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773253.013215:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2f480 x1862023612367360/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773253.013224:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.013244:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367360:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773253.013360:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.024719:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367360:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773253.024787:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024818:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024826:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 4/0,1 mode: --/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024836:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024846:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024864:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024872:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024879:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.024891:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f2f480 x1862023612367360/t34359738460(34359738460) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.024903:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2f480 x1862023612367360/t34359738460(34359738460) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.024916:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773253.024930:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.024940:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/95 (0 0) 00000080:00200000:2.0:1775773253.024956:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.024969:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-9, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:2.0:1775773253.025002:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x5f:0x0](ffff8de1c37b63c8) 00000080:00200000:2.0:1775773253.025262:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x5f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773253.025272:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x5f:0x0](ffff8de1c37b63c8) 00000080:00010000:2.0:1775773253.025277:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x5f:0x0](ffff8de1c37b63c8) for lock 0x8a9f4e958445ed2a 00000080:00010000:2.0:1775773253.025289:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x5f:0x0](ffff8de1c37b63c8) 00000080:00200008:2.0:1775773253.025305:0:169623:0:(file.c:1057:ll_file_open()) START file f-9:[0x240002729:0x5f:0x0](ffff8de1c37b63c8), flags 100102 00000002:00100000:2.0:1775773253.025325:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2f480 x1862023612367360/t34359738460(34359738460) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773253.025371:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed2a from it ffff8de1d2129180 00010000:00010000:2.0:1775773253.025376:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.025385:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.025407:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x5f:0x0](ffff8de1c37b63c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773253.025437:0:169623:0:(file.c:447:ll_file_release()) START file f-9:[0x240002729:0x5f:0x0](ffff8de1c37b63c8), flags 100002 00000002:00100000:2.0:1775773253.025476:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2f480 x1862023612367360/t34359738460(34359738460) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.025486:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.025491:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2d180 x1862023612367616/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.025510:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367616:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773253.026002:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.043467:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367616:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773253.043502:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2f480 x1862023612367360/t34359738460(34359738460) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.043602:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.043621:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.043639:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:2.0:1775773253.043653:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:2.0:1775773253.043660:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.043666:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.043669:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.043675:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:2.0:1775773253.043679:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:2.0:1775773253.043687:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:2.0:1775773253.043701:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.043707:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:2.0:1775773253.043712:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.043716:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773253.043719:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.043785:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:2.0:1775773253.043790:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-10, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1d0b47e00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773253.043798:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-10, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:2.0:1775773253.043817:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-10,[0x240002729:0x60:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773253.043868:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.043880:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773253.043889:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773253.043895:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2fb80 x1862023612367872/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773253.043904:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.043923:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367872:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773253.044049:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.057160:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2fb80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612367872:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773253.057200:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057233:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057241:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057252:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057262:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057280:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057289:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057296:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.057308:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f2fb80 x1862023612367872/t34359738462(34359738462) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.057320:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2fb80 x1862023612367872/t34359738462(34359738462) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.057332:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773253.057344:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.057353:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/96 (0 0) 00000080:00200000:2.0:1775773253.057361:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.057373:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-10, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:2.0:1775773253.057400:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x60:0x0](ffff8de1c37b7448) 00000080:00200000:2.0:1775773253.057521:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x60:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773253.057532:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x60:0x0](ffff8de1c37b7448) 00000080:00010000:2.0:1775773253.057536:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x60:0x0](ffff8de1c37b7448) for lock 0x8a9f4e958445ed31 00000080:00010000:2.0:1775773253.057545:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x60:0x0](ffff8de1c37b7448) 00000080:00200008:2.0:1775773253.057962:0:169623:0:(file.c:1057:ll_file_open()) START file f-10:[0x240002729:0x60:0x0](ffff8de1c37b7448), flags 100102 00000002:00100000:2.0:1775773253.057987:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2fb80 x1862023612367872/t34359738462(34359738462) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773253.058028:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed31 from it ffff8de1d2129180 00010000:00010000:2.0:1775773253.058033:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.058042:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.058438:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x60:0x0](ffff8de1c37b7448), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773253.058468:0:169623:0:(file.c:447:ll_file_release()) START file f-10:[0x240002729:0x60:0x0](ffff8de1c37b7448), flags 100002 00000002:00100000:2.0:1775773253.058532:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2fb80 x1862023612367872/t34359738462(34359738462) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.058543:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.059485:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ed80 x1862023612368128/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.059515:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ed80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368128:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773253.059603:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.066039:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ed80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368128:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773253.066073:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2fb80 x1862023612367872/t34359738462(34359738462) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.066146:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.066164:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.066181:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1775773253.066194:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:2.0:1775773253.066203:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.066209:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.066212:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.066219:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:2.0:1775773253.066222:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1775773253.066231:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00000080:00200000:2.0:1775773253.066245:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.066250:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:2.0:1775773253.066255:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.066259:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773253.066263:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.066279:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:2.0:1775773253.066284:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-11, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1d0b46c00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773253.066292:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-11, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:2.0:1775773253.066325:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-11,[0x240002729:0x61:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773253.066373:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.066387:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773253.066397:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773253.066403:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ce00 x1862023612368384/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773253.066412:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.066431:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368384:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773253.066549:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.082096:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ce00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368384:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773253.082129:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082162:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082170:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082181:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082206:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082227:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082236:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082244:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.082255:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f2ce00 x1862023612368384/t34359738464(34359738464) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.082269:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2ce00 x1862023612368384/t34359738464(34359738464) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.082284:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773253.082297:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082318:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/97 (0 0) 00000080:00200000:2.0:1775773253.082326:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.082342:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-11, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:2.0:1775773253.082376:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x61:0x0](ffff8de1c37b00c8) 00000080:00200000:2.0:1775773253.082511:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x61:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773253.082522:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x61:0x0](ffff8de1c37b00c8) 00000080:00010000:2.0:1775773253.082527:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x61:0x0](ffff8de1c37b00c8) for lock 0x8a9f4e958445ed38 00000080:00010000:2.0:1775773253.082537:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x61:0x0](ffff8de1c37b00c8) 00000080:00200008:2.0:1775773253.082552:0:169623:0:(file.c:1057:ll_file_open()) START file f-11:[0x240002729:0x61:0x0](ffff8de1c37b00c8), flags 100102 00000002:00100000:2.0:1775773253.082574:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2ce00 x1862023612368384/t34359738464(34359738464) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773253.082618:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed38 from it ffff8de1d2129180 00010000:00010000:2.0:1775773253.082622:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.082632:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.082655:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x61:0x0](ffff8de1c37b00c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773253.082685:0:169623:0:(file.c:447:ll_file_release()) START file f-11:[0x240002729:0x61:0x0](ffff8de1c37b00c8), flags 100002 00000002:00100000:2.0:1775773253.086388:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2ce00 x1862023612368384/t34359738464(34359738464) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.086404:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.086410:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2dc00 x1862023612368640/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773253.086765:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368640:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773253.087578:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11900 going to sleep for 11 seconds 00000100:00100000:3.0:1775773253.091439:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2dc00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368640:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773253.091475:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2ce00 x1862023612368384/t34359738464(34359738464) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773253.091554:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773253.091571:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773253.091589:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00010000:00010000:3.0:1775773253.091603:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00000080:00200000:3.0:1775773253.091612:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773253.091617:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773253.091621:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773253.091628:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:3.0:1775773253.091632:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 20 lru_type: 1 00010000:00010000:3.0:1775773253.091640:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:3.0:1775773253.091654:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.091661:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:3.0:1775773253.091666:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.091670:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773253.091673:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.091686:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:3.0:1775773253.091690:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-12, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c517e000, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773253.091698:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-12, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:3.0:1775773253.091719:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-12,[0x240002729:0x62:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773253.092849:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.092861:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773253.092874:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773253.092883:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e74e00 x1862023612368896/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773253.092894:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773253.092914:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368896:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773253.093052:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11900 going to sleep for 11 seconds 00000100:00100000:3.0:1775773253.098542:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74e00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612368896:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773253.098567:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098596:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 4/0,1 mode: --/PR res: [0x240002729:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098604:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 4/0,1 mode: --/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098614:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098623:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098636:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098649:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098655:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773253.098665:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e74e00 x1862023612368896/t34359738466(34359738466) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773253.098677:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e74e00 x1862023612368896/t34359738466(34359738466) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773253.098688:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773253.098701:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.098710:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/98 (0 0) 00000080:00200000:3.0:1775773253.098716:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773253.098767:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-12, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:3.0:1775773253.098800:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x62:0x0](ffff8de1c407e3c8) 00000080:00200000:3.0:1775773253.099117:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x62:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773253.099129:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x62:0x0](ffff8de1c407e3c8) 00000080:00010000:3.0:1775773253.099132:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x62:0x0](ffff8de1c407e3c8) for lock 0x8a9f4e958445ed3f 00000080:00010000:3.0:1775773253.099143:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x62:0x0](ffff8de1c407e3c8) 00000080:00200008:3.0:1775773253.099156:0:169623:0:(file.c:1057:ll_file_open()) START file f-12:[0x240002729:0x62:0x0](ffff8de1c407e3c8), flags 100102 00000002:00100000:3.0:1775773253.099177:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e74e00 x1862023612368896/t34359738466(34359738466) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773253.099214:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed3f from it ffff8de1c7cee3c0 00010000:00010000:3.0:1775773253.099218:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.099227:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773253.099249:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x62:0x0](ffff8de1c407e3c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773253.099276:0:169623:0:(file.c:447:ll_file_release()) START file f-12:[0x240002729:0x62:0x0](ffff8de1c407e3c8), flags 100002 00000002:00100000:3.0:1775773253.099319:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e74e00 x1862023612368896/t34359738466(34359738466) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773253.099328:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773253.099332:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e77b80 x1862023612369152/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773253.099354:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369152:192.168.201.137@tcp:35:createmany.0 00000100:00100000:3.0:1775773253.099477:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773253.112014:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77b80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369152:192.168.201.137@tcp:35:createmany.0 00000002:00100000:3.0:1775773253.112047:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e74e00 x1862023612368896/t34359738466(34359738466) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773253.112121:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773253.112138:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773253.112156:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:3.0:1775773253.112173:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00000080:00200000:3.0:1775773253.112181:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773253.112186:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773253.112189:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773253.112196:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:3.0:1775773253.112199:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 21 lru_type: 1 00010000:00010000:3.0:1775773253.112208:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:3.0:1775773253.112222:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.112228:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:3.0:1775773253.112234:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.112238:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:3.0:1775773253.112241:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.112252:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:3.0:1775773253.112256:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-13, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1c517fc80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1775773253.112263:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-13, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:3.0:1775773253.112282:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-13,[0x240002729:0x63:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1775773253.112342:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.112352:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773253.112362:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773253.112368:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e76300 x1862023612369408/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773253.112376:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773253.112395:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369408:192.168.201.137@tcp:101:createmany.0 00000100:00100000:3.0:1775773253.112523:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11180 going to sleep for 11 seconds 00000100:00100000:3.0:1775773253.124981:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369408:192.168.201.137@tcp:101:createmany.0 00010000:00010000:3.0:1775773253.125009:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125048:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125057:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125068:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125079:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125093:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125106:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125115:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773253.125125:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0e76300 x1862023612369408/t34359738468(34359738468) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773253.125138:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76300 x1862023612369408/t34359738468(34359738468) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1775773253.125152:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1775773253.125165:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125174:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/99 (0 0) 00000080:00200000:3.0:1775773253.125180:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1775773253.125192:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-13, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:3.0:1775773253.125217:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x63:0x0](ffff8de1c407ba88) 00000080:00200000:3.0:1775773253.125347:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x63:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1775773253.125357:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x63:0x0](ffff8de1c407ba88) 00000080:00010000:3.0:1775773253.125360:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x63:0x0](ffff8de1c407ba88) for lock 0x8a9f4e958445ed46 00000080:00010000:3.0:1775773253.125370:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x63:0x0](ffff8de1c407ba88) 00000080:00200008:3.0:1775773253.125382:0:169623:0:(file.c:1057:ll_file_open()) START file f-13:[0x240002729:0x63:0x0](ffff8de1c407ba88), flags 100102 00000002:00100000:3.0:1775773253.125402:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e76300 x1862023612369408/t34359738468(34359738468) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1775773253.125443:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed46 from it ffff8de1c7cee3c0 00010000:00010000:3.0:1775773253.125448:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.125457:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773253.125478:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x63:0x0](ffff8de1c407ba88), inode mode 81a4 mask 40 00000080:00200008:3.0:1775773253.125512:0:169623:0:(file.c:447:ll_file_release()) START file f-13:[0x240002729:0x63:0x0](ffff8de1c407ba88), flags 100002 00000002:00100000:3.0:1775773253.125553:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e76300 x1862023612369408/t34359738468(34359738468) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1775773253.125563:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1775773253.125567:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e75180 x1862023612369664/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1775773253.125587:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369664:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773253.126519:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11b40 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.134142:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369664:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773253.134179:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e76300 x1862023612369408/t34359738468(34359738468) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773253.134254:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773253.134272:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773253.134290:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:0.0:1775773253.134304:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00000080:00200000:0.0:1775773253.134456:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773253.134463:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773253.134466:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773253.134474:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773253.134478:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 22 lru_type: 1 00010000:00010000:0.0:1775773253.134486:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:0.0:1775773253.134502:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.134508:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773253.134514:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.134517:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773253.134521:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.134537:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773253.134542:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-14, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015b380, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773253.134549:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-14, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773253.134569:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-14,[0x240002729:0x64:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773253.134617:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.134626:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773253.134636:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773253.134643:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7025f80 x1862023612369920/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773253.134652:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773253.134671:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369920:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773253.134849:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.141516:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025f80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612369920:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773253.141542:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141573:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 4/0,1 mode: --/PR res: [0x240002729:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141581:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 4/0,1 mode: --/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141593:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141603:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141616:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141624:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141632:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773253.141643:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7025f80 x1862023612369920/t34359738470(34359738470) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773253.141656:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7025f80 x1862023612369920/t34359738470(34359738470) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773253.141669:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773253.141682:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.141692:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/100 (0 0) 00000080:00200000:0.0:1775773253.141699:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773253.141711:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-14, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773253.141792:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x64:0x0](ffff8de1c4074b08) 00000080:00200000:0.0:1775773253.141915:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x64:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773253.141926:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x64:0x0](ffff8de1c4074b08) 00000080:00010000:0.0:1775773253.141930:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x64:0x0](ffff8de1c4074b08) for lock 0x8a9f4e958445ed4d 00000080:00010000:0.0:1775773253.141938:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x64:0x0](ffff8de1c4074b08) 00000080:00200008:0.0:1775773253.141961:0:169623:0:(file.c:1057:ll_file_open()) START file f-14:[0x240002729:0x64:0x0](ffff8de1c4074b08), flags 100102 00000002:00100000:0.0:1775773253.141981:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7025f80 x1862023612369920/t34359738470(34359738470) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773253.142021:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed4d from it ffff8de1d2190420 00010000:00010000:0.0:1775773253.142025:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.142035:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773253.142055:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x64:0x0](ffff8de1c4074b08), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773253.142239:0:169623:0:(file.c:447:ll_file_release()) START file f-14:[0x240002729:0x64:0x0](ffff8de1c4074b08), flags 100002 00000002:00100000:0.0:1775773253.142288:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7025f80 x1862023612369920/t34359738470(34359738470) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.142304:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.142308:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7026300 x1862023612370176/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.142330:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370176:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773253.142395:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149540 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.146638:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026300 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370176:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773253.146671:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7025f80 x1862023612369920/t34359738470(34359738470) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773253.146798:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773253.146930:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773253.146957:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:0.0:1775773253.146973:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:0.0:1775773253.146981:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773253.146987:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773253.146990:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773253.146997:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773253.147001:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:0.0:1775773253.147009:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:0.0:1775773253.147025:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.147031:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773253.147037:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.147040:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773253.147043:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.147056:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773253.147060:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-15, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015aa80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773253.147146:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-15, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773253.147165:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-15,[0x240002729:0x65:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773253.147209:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.147217:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773253.147228:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773253.147235:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7025880 x1862023612370432/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773253.147243:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773253.147261:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370432:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773253.147439:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149540 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.153215:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7025880 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370432:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773253.153243:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153278:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153287:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153300:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153310:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153325:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153333:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153339:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773253.153351:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7025880 x1862023612370432/t34359738472(34359738472) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773253.153362:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7025880 x1862023612370432/t34359738472(34359738472) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773253.153375:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773253.153387:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153396:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/101 (0 0) 00000080:00200000:0.0:1775773253.153404:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773253.153418:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-15, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773253.153449:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x65:0x0](ffff8de1c4075b88) 00000080:00200000:0.0:1775773253.153573:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x65:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773253.153584:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x65:0x0](ffff8de1c4075b88) 00000080:00010000:0.0:1775773253.153587:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x65:0x0](ffff8de1c4075b88) for lock 0x8a9f4e958445ed54 00000080:00010000:0.0:1775773253.153596:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x65:0x0](ffff8de1c4075b88) 00000080:00200008:0.0:1775773253.153612:0:169623:0:(file.c:1057:ll_file_open()) START file f-15:[0x240002729:0x65:0x0](ffff8de1c4075b88), flags 100102 00000002:00100000:0.0:1775773253.153633:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7025880 x1862023612370432/t34359738472(34359738472) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773253.153677:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed54 from it ffff8de1d2190420 00010000:00010000:0.0:1775773253.153682:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.153692:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773253.153712:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x65:0x0](ffff8de1c4075b88), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773253.153801:0:169623:0:(file.c:447:ll_file_release()) START file f-15:[0x240002729:0x65:0x0](ffff8de1c4075b88), flags 100002 00000002:00100000:0.0:1775773253.153851:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7025880 x1862023612370432/t34359738472(34359738472) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.153866:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.153871:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024000 x1862023612370688/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.153892:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370688:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773253.153964:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c51490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.166573:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370688:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773253.166612:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7025880 x1862023612370432/t34359738472(34359738472) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773253.166686:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773253.166703:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773253.166934:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:0.0:1775773253.166960:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:0.0:1775773253.166968:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773253.166974:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773253.166978:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773253.166985:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773253.166989:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:0.0:1775773253.166998:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:0.0:1775773253.167015:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.167022:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773253.167029:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.167033:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773253.167036:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.167050:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773253.167055:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-16, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015b380, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773253.167200:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-16, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773253.167224:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-16,[0x240002729:0x66:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773253.167280:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.167289:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773253.167300:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773253.167317:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7027480 x1862023612370944/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773253.167328:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773253.167347:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370944:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773253.167521:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c51490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.175372:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7027480 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612370944:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773253.175396:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175425:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175433:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 4/0,1 mode: --/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175444:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175455:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175469:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175478:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175485:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773253.175496:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7027480 x1862023612370944/t34359738474(34359738474) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773253.175508:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7027480 x1862023612370944/t34359738474(34359738474) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773253.175521:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773253.175533:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175542:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/102 (0 0) 00000080:00200000:0.0:1775773253.175549:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773253.175561:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-16, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773253.175593:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x66:0x0](ffff8de1c4070908) 00000080:00200000:0.0:1775773253.175700:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x66:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773253.175710:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x66:0x0](ffff8de1c4070908) 00000080:00010000:0.0:1775773253.175714:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x66:0x0](ffff8de1c4070908) for lock 0x8a9f4e958445ed5b 00000080:00010000:0.0:1775773253.175772:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x66:0x0](ffff8de1c4070908) 00000080:00200008:0.0:1775773253.175786:0:169623:0:(file.c:1057:ll_file_open()) START file f-16:[0x240002729:0x66:0x0](ffff8de1c4070908), flags 100102 00000002:00100000:0.0:1775773253.175815:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7027480 x1862023612370944/t34359738474(34359738474) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773253.175856:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed5b from it ffff8de1d2190420 00010000:00010000:0.0:1775773253.175860:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.175869:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773253.175888:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x66:0x0](ffff8de1c4070908), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773253.175915:0:169623:0:(file.c:447:ll_file_release()) START file f-16:[0x240002729:0x66:0x0](ffff8de1c4070908), flags 100002 00000002:00100000:0.0:1775773253.175965:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7027480 x1862023612370944/t34359738474(34359738474) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.175981:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.175986:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7024380 x1862023612371200/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.176008:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371200:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773253.176075:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149900 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.190987:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7024380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371200:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773253.191027:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7027480 x1862023612370944/t34359738474(34359738474) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773253.191119:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773253.191138:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773253.191157:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:0.0:1775773253.191173:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:0.0:1775773253.191182:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773253.191188:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773253.191192:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773253.191198:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773253.191203:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:0.0:1775773253.191213:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:0.0:1775773253.191229:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.191236:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773253.191242:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.191247:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773253.191250:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.191263:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773253.191268:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-17, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015aa80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773253.191277:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-17, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773253.191300:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-17,[0x240002729:0x67:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773253.191371:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.191381:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773253.191394:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773253.191401:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c7026a00 x1862023612371456/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773253.191410:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773253.191431:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371456:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773253.191569:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149900 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.210789:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7026a00 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371456:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773253.210825:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210855:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210864:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210875:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210885:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210897:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210905:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210911:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773253.210922:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c7026a00 x1862023612371456/t34359738476(34359738476) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773253.210934:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7026a00 x1862023612371456/t34359738476(34359738476) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773253.210955:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773253.210968:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.210977:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/103 (0 0) 00000080:00200000:0.0:1775773253.210983:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773253.210997:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-17, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773253.211027:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x67:0x0](ffff8de1c40700c8) 00000080:00200000:0.0:1775773253.211301:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x67:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773253.211320:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x67:0x0](ffff8de1c40700c8) 00000080:00010000:0.0:1775773253.211324:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x67:0x0](ffff8de1c40700c8) for lock 0x8a9f4e958445ed62 00000080:00010000:0.0:1775773253.211334:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x67:0x0](ffff8de1c40700c8) 00000080:00200008:0.0:1775773253.211348:0:169623:0:(file.c:1057:ll_file_open()) START file f-17:[0x240002729:0x67:0x0](ffff8de1c40700c8), flags 100102 00000002:00100000:0.0:1775773253.211368:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c7026a00 x1862023612371456/t34359738476(34359738476) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773253.211404:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed62 from it ffff8de1d2190420 00010000:00010000:0.0:1775773253.211408:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.211419:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773253.211441:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x67:0x0](ffff8de1c40700c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773253.211473:0:169623:0:(file.c:447:ll_file_release()) START file f-17:[0x240002729:0x67:0x0](ffff8de1c40700c8), flags 100002 00000002:00100000:0.0:1775773253.211517:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c7026a00 x1862023612371456/t34359738476(34359738476) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.211533:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.211538:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5680a80 x1862023612371712/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.211558:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371712:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773253.211618:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149840 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.215508:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680a80 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371712:192.168.201.137@tcp:35:createmany.0 00000002:00100000:0.0:1775773253.215545:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c7026a00 x1862023612371456/t34359738476(34359738476) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773253.215621:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773253.215640:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773253.215658:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:0.0:1775773253.215673:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:0.0:1775773253.215682:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773253.215687:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773253.215691:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773253.215697:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:0.0:1775773253.215701:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:0.0:1775773253.215709:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:0.0:1775773253.215767:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.215781:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:0.0:1775773253.215787:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.215790:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:0.0:1775773253.215793:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.215813:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:0.0:1775773253.215819:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-18, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1e015b380, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1775773253.215826:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-18, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:0.0:1775773253.215846:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-18,[0x240002729:0x68:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1775773253.215896:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.215904:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1775773253.215914:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1775773253.215919:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5681180 x1862023612371968/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1775773253.215928:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775773253.215975:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371968:192.168.201.137@tcp:101:createmany.0 00000100:00100000:0.0:1775773253.216093:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5149840 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.231617:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681180 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612371968:192.168.201.137@tcp:101:createmany.0 00010000:00010000:0.0:1775773253.231643:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231674:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x68:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231683:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231694:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231704:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231716:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231779:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231786:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1775773253.231797:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1c5681180 x1862023612371968/t34359738478(34359738478) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1775773253.231816:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681180 x1862023612371968/t34359738478(34359738478) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1775773253.231829:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1775773253.231843:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.231852:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/104 (0 0) 00000080:00200000:0.0:1775773253.231859:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1775773253.231871:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-18, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:0.0:1775773253.231898:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x68:0x0](ffff8de1c40721c8) 00000080:00200000:0.0:1775773253.232024:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x68:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1775773253.232035:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x68:0x0](ffff8de1c40721c8) 00000080:00010000:0.0:1775773253.232039:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x68:0x0](ffff8de1c40721c8) for lock 0x8a9f4e958445ed69 00000080:00010000:0.0:1775773253.232048:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x68:0x0](ffff8de1c40721c8) 00000080:00200008:0.0:1775773253.232073:0:169623:0:(file.c:1057:ll_file_open()) START file f-18:[0x240002729:0x68:0x0](ffff8de1c40721c8), flags 100102 00000002:00100000:0.0:1775773253.232094:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1c5681180 x1862023612371968/t34359738478(34359738478) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1775773253.232134:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed69 from it ffff8de1d2190420 00010000:00010000:0.0:1775773253.232139:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.232149:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1775773253.232172:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x68:0x0](ffff8de1c40721c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1775773253.232199:0:169623:0:(file.c:447:ll_file_release()) START file f-18:[0x240002729:0x68:0x0](ffff8de1c40721c8), flags 100002 00000002:00100000:0.0:1775773253.232239:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1c5681180 x1862023612371968/t34359738478(34359738478) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.232255:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.232260:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5683100 x1862023612372224/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.232282:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612372224:192.168.201.137@tcp:35:createmany.0 00000100:00100000:0.0:1775773253.232359:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.246526:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683100 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612372224:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773253.246563:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1c5681180 x1862023612371968/t34359738478(34359738478) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.246645:0:169623:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.246664:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.246683:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:2.0:1775773253.246698:0:169623:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:2.0:1775773253.246705:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.246711:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.246714:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.246720:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c0d17bf8 00010000:00010000:2.0:1775773253.246772:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:2.0:1775773253.246781:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:2.0:1775773253.246797:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.246885:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:2.0:1775773253.246893:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.246897:0:169623:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773253.246900:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.246914:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:2.0:1775773253.246918:0:169623:0:(namei.c:1399:ll_atomic_open()) VFS Op:name=f-19, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), file ffff8de1d0b47e00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1775773253.246926:0:169623:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=f-19, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000002:00010000:2.0:1775773253.246957:0:169623:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f-19,[0x240002729:0x69:0x0]) in obj [0x240002729:0x55:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1775773253.247018:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.247026:0:169623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773253.247037:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773253.247043:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2c380 x1862023612372480/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773253.247052:0:169623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 3/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.247161:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612372480:192.168.201.137@tcp:101:createmany.0 00000100:00100000:2.0:1775773253.247295:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052600 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.257737:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c380 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612372480:192.168.201.137@tcp:101:createmany.0 00010000:00010000:2.0:1775773253.257763:0:169623:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 4/0,1 mode: --/CW res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257807:0:169623:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257816:0:169623:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 4/0,1 mode: --/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257826:0:169623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257838:0:169623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 4/0,1 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257851:0:169623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257865:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 5/1,1 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257873:0:169623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.257885:0:169623:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8de1d0f2c380 x1862023612372480/t34359738480(34359738480) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.257898:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2c380 x1862023612372480/t34359738480(34359738480) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.257911:0:169623:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773253.257925:0:169623:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.257935:0:169623:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/105 (0 0) 00000080:00200000:2.0:1775773253.257951:0:169623:0:(namei.c:943:ll_intent_lock()) intent lock 3 on i1 [0x240002729:0x55:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.257966:0:169623:0:(namei.c:1610:ll_create_it()) VFS Op:name=f-19, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248), intent=open|creat 00000080:00200000:2.0:1775773253.257992:0:169623:0:(llite_lib.c:3177:ll_read_inode2()) VFS Op:inode=[0x240002729:0x69:0x0](ffff8de1c37b0908) 00000080:00200000:2.0:1775773253.258110:0:169623:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x69:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1775773253.258120:0:169623:0:(namei.c:1576:ll_create_node()) setting l_ast_data to inode [0x240002729:0x69:0x0](ffff8de1c37b0908) 00000080:00010000:2.0:1775773253.258123:0:169623:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x69:0x0](ffff8de1c37b0908) for lock 0x8a9f4e958445ed70 00000080:00010000:2.0:1775773253.258133:0:169623:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x69:0x0](ffff8de1c37b0908) 00000080:00200008:2.0:1775773253.258146:0:169623:0:(file.c:1057:ll_file_open()) START file f-19:[0x240002729:0x69:0x0](ffff8de1c37b0908), flags 100102 00000002:00100000:2.0:1775773253.258166:0:169623:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2c380 x1862023612372480/t34359738480(34359738480) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1775773253.258204:0:169623:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed70 from it ffff8de1d2129180 00010000:00010000:2.0:1775773253.258208:0:169623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.258218:0:169623:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.258238:0:169623:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x69:0x0](ffff8de1c37b0908), inode mode 81a4 mask 40 00000080:00200008:2.0:1775773253.258266:0:169623:0:(file.c:447:ll_file_release()) START file f-19:[0x240002729:0x69:0x0](ffff8de1c37b0908), flags 100002 00000002:00100000:2.0:1775773253.258304:0:169623:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2c380 x1862023612372480/t34359738480(34359738480) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.258531:0:169623:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.258537:0:169623:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2c000 x1862023612372736/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.258559:0:169623:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612372736:192.168.201.137@tcp:35:createmany.0 00000100:00100000:2.0:1775773253.258637:0:169623:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c70520c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.262071:0:169623:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c000 pname:cluuid:pid:xid:nid:opc:job createmany:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169623:1862023612372736:192.168.201.137@tcp:35:createmany.0 00000002:00100000:2.0:1775773253.262101:0:169623:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2c380 x1862023612372480/t34359738480(34359738480) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773253.289407:0:169631:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773253.289437:0:169631:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773253.289455:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:1.0:1775773253.289473:0:169631:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:1.0:1775773253.289482:0:169631:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773253.289490:0:169631:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773253.289494:0:169631:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773253.289501:0:169631:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c1bcbbf8 00010000:00010000:1.0:1775773253.289505:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:1.0:1775773253.289514:0:169631:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:1.0:1775773253.289529:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.289536:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=27 00000080:00200000:1.0:1775773253.289541:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.289545:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=27 00000080:00200000:1.0:1775773253.289548:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.289551:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=267 00000080:00200000:1.0:1775773253.289577:0:169631:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:1.0:1775773253.289584:0:169631:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773253.289591:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:1.0:1775773253.289600:0:169631:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:1.0:1775773253.289613:0:169631:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773253.289616:0:169631:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:1.0:1775773253.289619:0:169631:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:1.0:1775773253.289623:0:169631:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c1bcbbf8 00010000:00010000:1.0:1775773253.289625:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:1.0:1775773253.289633:0:169631:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:1.0:1775773253.289642:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.289645:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=27 00000080:00200000:1.0:1775773253.289648:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.289652:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=267 00000080:00200000:1.0:1775773253.289654:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 44 00000080:00200008:1.0:1775773253.289661:0:169631:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 304000 00000002:00010000:1.0:1775773253.289676:0:169631:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x200027cd1:0xd:0x0], intent: open flags 0100240304001 00010000:00010000:1.0:1775773253.289949:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.289957:0:169631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773253.289971:0:169631:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773253.289982:0:169631:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33800 x1862023612372992/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773253.289992:0:169631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773253.290015:0:169631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612372992:192.168.201.137@tcp:101:lfs.0 00000100:00100000:1.0:1775773253.290221:0:169631:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af180 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.294124:0:169631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612372992:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773253.294147:0:169631:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294165:0:169631:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294172:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294180:0:169631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294189:0:169631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294194:0:169631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b8400 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773253.294199:0:169631:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294207:0:169631:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294215:0:169631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294222:0:169631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775773253.294229:0:169631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294235:0:169631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b8400/0x8a9f4e958445ed77 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.294259:0:169631:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0a33800 x1862023612372992/t34359738482(34359738482) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.294278:0:169631:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a33800 x1862023612372992/t34359738482(34359738482) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.294294:0:169631:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xd:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773253.294415:0:169631:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000002:00100000:2.0:1775773253.294436:0:169631:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a33800 x1862023612372992/t34359738482(34359738482) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.294533:0:169631:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.294549:0:169631:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.294562:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:2.0:1775773253.294573:0:169631:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:2.0:1775773253.294580:0:169631:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.294585:0:169631:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.294588:0:169631:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.294593:0:169631:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c1bcbbf8 00010000:00010000:2.0:1775773253.294596:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:2.0:1775773253.294605:0:169631:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:2.0:1775773253.294618:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.294624:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=25 00000080:00200000:2.0:1775773253.294629:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.294633:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=25 00000080:00200000:2.0:1775773253.294636:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.294639:0:169631:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=265 00000080:00200000:2.0:1775773253.294644:0:169631:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x57:0x0](ffff8de1c4073a88), inode mode 81a4 mask 44 00000080:00200008:2.0:1775773253.294650:0:169631:0:(file.c:1057:ll_file_open()) START file f-1:[0x240002729:0x57:0x0](ffff8de1c4073a88), flags 100400 00000002:00010000:2.0:1775773253.294664:0:169631:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x57:0x0]) in obj [0x240002729:0x55:0x0], intent: open flags 0240100401 00010000:00010000:2.0:1775773253.294707:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.294715:0:169631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773253.295193:0:169631:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773253.295202:0:169631:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2f800 x1862023612373248/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773253.295211:0:169631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.295232:0:169631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612373248:192.168.201.137@tcp:101:lfs.0 00000100:00100000:2.0:1775773253.295533:0:169631:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c70520c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.299596:0:169631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612373248:192.168.201.137@tcp:101:lfs.0 00010000:00010000:2.0:1775773253.299623:0:169631:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299647:0:169631:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 4/1,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299656:0:169631:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 4/1,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299668:0:169631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299679:0:169631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299692:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299699:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299705:0:169631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.299717:0:169631:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0f2f800 x1862023612373248/t34359738483(34359738483) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.299789:0:169631:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2f800 x1862023612373248/t34359738483(34359738483) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.299951:0:169631:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1775773253.299967:0:169631:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.299980:0:169631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.299991:0:169631:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.299998:0:169631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.300004:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.300009:0:169631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.300026:0:169631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:2.0:1775773253.300032:0:169631:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x240002729:0x55:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773253.300129:0:169631:0:(file.c:6766:ll_layout_conf()) [0x240002729:0x57:0x0]: layout version change: 0 -> 0 00000080:00010000:2.0:1775773253.300141:0:169631:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x57:0x0](ffff8de1c4073a88) for lock 0x8a9f4e958445ecf2 00000080:00010000:2.0:1775773253.300148:0:169631:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecf2 from it ffff9ba1c1bcbbf0 00010000:00010000:2.0:1775773253.300151:0:169631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.300159:0:169631:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:2.0:1775773253.300186:0:169631:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2f800 x1862023612373248/t34359738483(34359738483) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:2.0:1775773253.300266:0:169631:0:(file.c:4602:ll_file_ioctl()) VFS Op:inode=[0x240002729:0x57:0x0](ffff8de1c4073a88) cmd=800466af arg=7ffefc0c397c 00000080:00200008:2.0:1775773253.300290:0:169631:0:(file.c:447:ll_file_release()) START file f-1:[0x240002729:0x57:0x0](ffff8de1c4073a88), flags 100000 00000002:00100000:2.0:1775773253.300330:0:169631:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2f800 x1862023612373248/t34359738483(34359738483) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.300339:0:169631:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.300343:0:169631:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2e680 x1862023612373504/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.300365:0:169631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612373504:192.168.201.137@tcp:35:lfs.0 00000100:00100000:2.0:1775773253.300438:0:169631:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052540 going to sleep for 11 seconds 00010000:00010000:0.0:1775773253.301329:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775773253.301338:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301349:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d48200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775773253.301353:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301364:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301373:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301395:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775773253.301430:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 2/0,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301437:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773253.301470:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 1/0,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301477:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48200/0x8a9f4e958445ed7e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac1fe expref: -99 pid: 169631 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.301492:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773253.301493:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773253.301495:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773253.301503:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775773253.301517:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612373632:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773253.309794:0:169631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612373504:192.168.201.137@tcp:35:lfs.0 00000002:00100000:2.0:1775773253.309841:0:169631:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2f800 x1862023612373248/t34359738483(34359738483) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773253.309996:0:169631:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 304000 00000002:00100000:2.0:1775773253.310049:0:169631:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a33800 x1862023612372992/t34359738482(34359738482) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.310060:0:169631:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.310064:0:169631:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2e680 x1862023612373888/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.310086:0:169631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612373888:192.168.201.137@tcp:35:lfs.0 00000100:00100000:2.0:1775773253.310151:0:169631:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052540 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.310357:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612373632:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773253.349382:0:169631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job lfs:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169631:1862023612373888:192.168.201.137@tcp:35:lfs.0 00000002:00100000:2.0:1775773253.349417:0:169631:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a33800 x1862023612372992/t34359738482(34359738482) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773253.370617:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773253.370657:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773253.370681:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:3.0:1775773253.370698:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:3.0:1775773253.370707:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773253.370716:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773253.370720:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773253.370752:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fb58 00010000:00010000:3.0:1775773253.370756:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:3.0:1775773253.370765:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:3.0:1775773253.370781:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.370790:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=8 00000080:00200008:3.0:1775773253.370801:0:169632:0:(file.c:6226:ll_getattr_dentry()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775773253.370806:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8),name=d80e.replay-single 00000002:00010000:3.0:1775773253.370818:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773253.370826:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773253.370833:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1775773253.370840:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773253.370844:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:3.0:1775773253.370847:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ecd6 00000080:00010000:3.0:1775773253.370850:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecd6 from it ffff9ba1c147fcb8 00010000:00010000:3.0:1775773253.370853:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1775773253.370860:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773253.370889:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:3.0:1775773253.370896:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773253.370902:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:3.0:1775773253.370911:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:3.0:1775773253.370918:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773253.370921:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:3.0:1775773253.370924:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:3.0:1775773253.370927:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fbf8 00010000:00010000:3.0:1775773253.370930:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:3.0:1775773253.376600:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:0.0:1775773253.377462:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1775773253.377869:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:3.0:1775773253.377884:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=266 00000080:00200000:3.0:1775773253.377893:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 44 00000080:00200008:3.0:1775773253.377901:0:169632:0:(file.c:1057:ll_file_open()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags 704400 00000002:00010000:3.0:1775773253.377930:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:3.0:1775773253.378001:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.378012:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1775773253.378024:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1775773253.378035:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0e74000 x1862023612374144/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1775773253.378044:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775773253.378066:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374144:192.168.201.137@tcp:101:rm.0 00000100:00100000:3.0:1775773253.378243:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c5d11a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775773253.383198:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374144:192.168.201.137@tcp:101:rm.0 00010000:00010000:3.0:1775773253.383221:0:169632:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383235:0:169632:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383241:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383248:0:169632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383256:0:169632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383263:0:169632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1d3385200 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773253.383268:0:169632:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383280:0:169632:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383287:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383294:0:169632:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1775773253.383300:0:169632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775773253.383319:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3385200/0x8a9f4e958445ed85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1775773253.383338:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0e74000 x1862023612374144/t365072220162(365072220162) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1775773253.383352:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e74000 x1862023612374144/t365072220162(365072220162) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1775773253.383368:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1775773253.383399:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000002:00100000:3.0:1775773253.383418:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0e74000 x1862023612374144/t365072220162(365072220162) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1775773253.383483:0:169632:0:(file.c:6226:ll_getattr_dentry()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1775773253.383490:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8),name=d80e.replay-single 00000002:00010000:3.0:1775773253.383510:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1775773253.383525:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773253.383542:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1775773253.383551:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1775773253.383557:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:3.0:1775773253.383560:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ecd6 00000080:00010000:3.0:1775773253.383566:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecd6 from it ffff9ba1c147fcd8 00010000:00010000:3.0:1775773253.383570:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773253.383579:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1775773253.383670:0:169632:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) pos/size0/4096 32bit_api 0 00000002:00010000:3.0:1775773253.383684:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200027cd1:0xd:0x0], intent: readdir flags 0 00010000:00010000:3.0:1775773253.383691:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1775773253.383698:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1775773253.389720:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374272:192.168.201.137@tcp:37:rm.0 00000100:00100000:0.0:1775773253.389881:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.399300:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374272:192.168.201.137@tcp:37:rm.0 00010000:00010000:0.0:1775773253.400135:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1775773253.400155:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1775773253.400288:0:169632:0:(file.c:447:ll_file_release()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags 704000 00000002:00100000:0.0:1775773253.400362:0:169632:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0e74000 x1862023612374144/t365072220162(365072220162) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.400375:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.400381:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682680 x1862023612374528/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.400406:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374528:192.168.201.137@tcp:35:rm.0 00000100:00100000:0.0:1775773253.400476:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1775773253.406207:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374528:192.168.201.137@tcp:35:rm.0 00000002:00100000:0.0:1775773253.407056:0:169632:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0e74000 x1862023612374144/t365072220162(365072220162) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1775773253.407166:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:0.0:1775773253.407188:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1775773253.407210:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:0.0:1775773253.407225:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:0.0:1775773253.408449:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1775773253.408468:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:0.0:1775773253.408472:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:0.0:1775773253.408482:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fbf8 00010000:00010000:0.0:1775773253.408487:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:0.0:1775773253.408499:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:0.0:1775773253.408516:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:0.0:1775773253.408526:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d80e.replay-single, flags=266 00000080:00200000:1.0:1775773253.408602:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 44 00000080:00200008:1.0:1775773253.408616:0:169632:0:(file.c:1057:ll_file_open()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags 704400 00000002:00010000:1.0:1775773253.408745:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1775773253.409040:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.409049:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773253.409061:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773253.409072:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31180 x1862023612374784/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773253.409081:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773253.409202:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374784:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775773253.409388:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71afb40 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.417487:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31180 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374784:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773253.417519:0:169632:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.417530:0:169632:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.417541:0:169632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.417551:0:169632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.417565:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8de1d0a31180 x1862023612374784/t365072220164(365072220164) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.417576:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a31180 x1862023612374784/t365072220164(365072220164) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.417590:0:169632:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.417599:0:169632:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 16 res 8590097617/13 (0 0) 00000080:00200000:2.0:1775773253.417606:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773253.417630:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000080:00010000:2.0:1775773253.417980:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ed8c 00000080:00010000:2.0:1775773253.417991:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed8c from it ffff9ba1c147fbd0 00010000:00010000:2.0:1775773253.417996:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.418011:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1775773253.418048:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a31180 x1862023612374784/t365072220164(365072220164) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773253.418419:0:169632:0:(file.c:6226:ll_getattr_dentry()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773253.418427:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8),name=d80e.replay-single 00000002:00010000:2.0:1775773253.418450:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200027cd1:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.418461:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773253.418473:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1775773253.418480:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.418489:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:2.0:1775773253.418492:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445ecd6 00000080:00010000:2.0:1775773253.418497:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecd6 from it ffff9ba1c147fcd8 00010000:00010000:2.0:1775773253.418500:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1775773253.418506:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1775773253.418615:0:169632:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1775773253.419256:0:169632:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1775773253.419287:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.419296:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=0 00000080:00200008:2.0:1775773253.419306:0:169632:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773253.420302:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248),name=remote_dir 00000002:00010000:2.0:1775773253.420328:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x200027cd1:0xd:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.420385:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.420394:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.420406:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.420430:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374912:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773253.420544:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.426427:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612374912:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773253.426454:0:169632:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426482:0:169632:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426490:0:169632:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426503:0:169632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426608:0:169632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426623:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426716:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.426997:0:169632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.427010:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2e680 x1862023612374912/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.427024:0:169632:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.427035:0:169632:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/85 (0 0) 00000080:00200000:2.0:1775773253.427043:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xd:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773253.427070:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000080:00010000:2.0:1775773253.427075:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445ed93 00000080:00010000:2.0:1775773253.427081:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00010000:2.0:1775773253.427085:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed93 from it ffff9ba1c147fcb8 00010000:00010000:2.0:1775773253.427183:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.427198:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.427266:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.427274:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=258 00000080:00200000:2.0:1775773253.427350:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 44 00000080:00200008:2.0:1775773253.427362:0:169632:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 704400 00000002:00010000:2.0:1775773253.427392:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x200027cd1:0xd:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1775773253.427444:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.427451:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1775773253.427463:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1775773253.427471:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2e680 x1862023612375168/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1775773253.427480:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.427503:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375168:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773253.428834:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.434886:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375168:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773253.434911:0:169632:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434925:0:169632:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434933:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434955:0:169632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434963:0:169632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434970:0:169632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c5d48000 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:2.0:1775773253.434975:0:169632:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434982:0:169632:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 4/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434989:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 5/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.434995:0:169632:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1775773253.435001:0:169632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.435008:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445ed9a lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.435033:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8de1d0f2e680 x1862023612375168/t34359738486(34359738486) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1775773253.435047:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2e680 x1862023612375168/t34359738486(34359738486) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1775773253.435065:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xd:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1775773253.435094:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000002:00100000:2.0:1775773253.435115:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0f2e680 x1862023612375168/t34359738486(34359738486) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1775773253.435192:0:169632:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1775773253.435200:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248),name=remote_dir 00000002:00010000:2.0:1775773253.435220:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x200027cd1:0xd:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.435247:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.435260:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.435268:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xd:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.435274:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00010000:2.0:1775773253.435289:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445ed93 00000080:00010000:2.0:1775773253.435295:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed93 from it ffff9ba1c147fcd8 00010000:00010000:2.0:1775773253.435298:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.435315:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1775773253.435346:0:169632:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1775773253.435360:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x240002729:0x55:0x0], intent: readdir flags 0 00010000:00010000:2.0:1775773253.435366:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773253.435375:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1775773253.436062:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375296:192.168.201.137@tcp:37:rm.0 00000100:00100000:2.0:1775773253.436156:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052540 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.450453:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375296:192.168.201.137@tcp:37:rm.0 00010000:00010000:2.0:1775773253.451625:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773253.451643:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1775773253.458046:0:169632:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 704000 00000002:00100000:0.0:1775773253.458141:0:169632:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0f2e680 x1862023612375168/t34359738486(34359738486) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1775773253.458154:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1775773253.458160:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c5682680 x1862023612375552/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1775773253.458188:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375552:192.168.201.137@tcp:35:rm.0 00000100:00100000:0.0:1775773253.458560:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1d21f0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.466761:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375552:192.168.201.137@tcp:35:rm.0 00000002:00100000:1.0:1775773253.466811:0:169632:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0f2e680 x1862023612375168/t34359738486(34359738486) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1775773253.466882:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.466892:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=remote_dir, flags=258 00000080:00200000:1.0:1775773253.466900:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 44 00000080:00200008:1.0:1775773253.466909:0:169632:0:(file.c:1057:ll_file_open()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 704400 00000002:00010000:1.0:1775773253.466933:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x200027cd1:0xd:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1775773253.467016:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.467027:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1775773253.467037:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1775773253.467044:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33480 x1862023612375808/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1775773253.467053:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773253.467075:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375808:192.168.201.137@tcp:101:rm.0 00000100:00100000:1.0:1775773253.467252:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.485318:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33480 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612375808:192.168.201.137@tcp:101:rm.0 00010000:00010000:1.0:1775773253.485358:0:169632:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.485368:0:169632:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.485379:0:169632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 4/1,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.485388:0:169632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 4/1,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1775773253.485405:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8de1d0a33480 x1862023612375808/t34359738488(34359738488) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1775773253.485416:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a33480 x1862023612375808/t34359738488(34359738488) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 648/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1775773253.485429:0:169632:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.485438:0:169632:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 16 res 9663686441/85 (0 0) 00000080:00200000:1.0:1775773253.485444:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 1 on i1 [0x200027cd1:0xd:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1775773253.485471:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000080:00010000:1.0:1775773253.485477:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445eda1 00000080:00010000:1.0:1775773253.485485:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eda1 from it ffff9ba1c147fbd0 00010000:00010000:1.0:1775773253.485489:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 3/1,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.485498:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1775773253.486227:0:169632:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8de1d0a33480 x1862023612375808/t34359738488(34359738488) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1775773253.486303:0:169632:0:(file.c:6226:ll_getattr_dentry()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1775773253.486311:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248),name=remote_dir 00000002:00010000:1.0:1775773253.486334:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240002729:0x55:0x0]) in obj [0x200027cd1:0xd:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773253.486349:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773253.486361:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775773253.486368:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xd:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1775773253.486373:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00010000:1.0:1775773253.486376:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445ed93 00000080:00010000:1.0:1775773253.486381:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ed93 from it ffff9ba1c147fcd8 00010000:00010000:1.0:1775773253.486383:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773253.486390:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000080:00200000:1.0:1775773253.486423:0:169632:0:(llite_lib.c:2726:ll_statfs()) VFS Op:sb=lustre (ffff8de1e006a000) remote_dir proj=0 00000080:00000004:1.0:1775773253.486427:0:169632:0:(obd_class.h:1092:obd_statfs()) lustre-clilmv-ffff8de1e006a000: age 9161, max_age 9229 00800000:00000004:1.0:1775773253.486440:0:169632:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: age 9229, max_age 9229 00800000:00000004:1.0:1775773253.486443:0:169632:0:(obd_class.h:1132:obd_statfs()) lustre-MDT0000-mdc-ffff8de1e006a000: use ffff8de1c5511e10 cache blocks 317240/353529 objects 1023640/1024000 00800000:00000004:1.0:1775773253.486446:0:169632:0:(obd_class.h:1092:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: age 9229, max_age 9229 00800000:00000004:1.0:1775773253.486448:0:169632:0:(obd_class.h:1132:obd_statfs()) lustre-MDT0001-mdc-ffff8de1e006a000: use ffff8de1c5515190 cache blocks 317337/353529 objects 1023720/1024000 00000080:00000004:1.0:1775773253.486452:0:169632:0:(obd_class.h:1118:obd_statfs()) lustre-clilmv-ffff8de1e006a000: update ffff8de1c55137d0 cache blocks 634577/707058 objects 2047360/2048000 00000080:00000004:1.0:1775773253.486456:0:169632:0:(llite_lib.c:2589:ll_statfs_internal()) MDC blocks 634577/707058 objects 2047360/2048000 00000080:00000004:1.0:1775773253.486459:0:169632:0:(obd_class.h:1092:obd_statfs()) lustre-clilov-ffff8de1e006a000: age 9161, max_age 9229 00020000:00000004:1.0:1775773253.486489:0:169632:0:(obd_class.h:1058:obd_statfs_async()) lustre-OST0000-osc-ffff8de1e006a000: age 9229, max_age 9229 00000008:00000004:1.0:1775773253.486494:0:169632:0:(osc_request.c:3416:osc_statfs_async()) lustre-OST0000-osc-ffff8de1e006a000: use ffff8de1c5579e10 cache blocks 901355/958279 objects 261721/262144 00020000:00000004:1.0:1775773253.486500:0:169632:0:(obd_class.h:1058:obd_statfs_async()) lustre-OST0001-osc-ffff8de1e006a000: age 9229, max_age 9229 00000008:00000004:1.0:1775773253.486502:0:169632:0:(osc_request.c:3416:osc_statfs_async()) lustre-OST0001-osc-ffff8de1e006a000: use ffff8de1c557b7d0 cache blocks 901361/958279 objects 261738/262144 00000080:00000004:1.0:1775773253.486522:0:169632:0:(obd_class.h:1118:obd_statfs()) lustre-clilov-ffff8de1e006a000: update ffff8de1c5510450 cache blocks 1802716/1916558 objects 523459/524288 00000080:00000004:1.0:1775773253.486526:0:169632:0:(llite_lib.c:2600:ll_statfs_internal()) OSC blocks 1802716/1916558 objects 523459/524288 00000080:00200000:1.0:1775773253.486542:0:169632:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1775773253.486620:0:169632:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1775773253.486666:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.486675:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-12, flags=0 00000080:00200000:1.0:1775773253.486680:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.486685:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-12, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.486797:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1775773253.486868:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.486887:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x62:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.486929:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 1/0,0 mode: --/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.486947:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1775773253.486953:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1775773253.486956:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385400/0x8a9f4e958445ed3f lrc: 0/0,0 mode: --/PR res: [0x240002729:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac0e6 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.486971:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48600/0x8a9f4e958445ed93 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac236 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000020:00100000:1.0:1775773253.486984:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.486992:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32d80 x1862023612376064/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.487010:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376064:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.487094:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.494227:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376064:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.494317:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x62:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.494331:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.494388:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x62:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.494402:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x62:0x0](ffff8de1c407e3c8) 00000080:00200000:1.0:1775773253.494503:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.494528:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-2, flags=0 00000080:00200000:1.0:1775773253.494533:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.494539:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-2, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.494591:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.494618:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x58:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.494689:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.494697:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.494700:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3385800/0x8a9f4e958445ecf9 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabf88 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.494986:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.494995:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31500 x1862023612376320/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.495025:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376320:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.495102:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.500415:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31500 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376320:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.500511:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x58:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.500523:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.500577:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x58:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.500591:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x58:0x0](ffff8de1c4076c08) 00000080:00200000:1.0:1775773253.500952:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.500964:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-3, flags=0 00000080:00200000:1.0:1775773253.500969:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.500974:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-3, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.501031:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.501059:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x59:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.501206:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.501214:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.501218:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35400/0x8a9f4e958445ed00 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabfab expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.501242:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.501251:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33100 x1862023612376576/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.501274:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376576:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.501338:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.507198:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33100 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376576:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.507279:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x59:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.507291:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.507346:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x59:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.507359:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x59:0x0](ffff8de1c4071148) 00000080:00200000:1.0:1775773253.507446:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.507459:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-8, flags=0 00000080:00200000:1.0:1775773253.507465:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.507472:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-8, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.507530:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.507557:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5e:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.507606:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.507613:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.507615:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445ed23 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac05a expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.507637:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.507644:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32680 x1862023612376832/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.507667:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376832:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.507785:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.513107:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32680 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612376832:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.513190:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.513205:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.513258:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.513276:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5e:0x0](ffff8de1c37b5348) 00000080:00200000:1.0:1775773253.513363:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.513374:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-7, flags=0 00000080:00200000:1.0:1775773253.513379:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.513384:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-7, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.513443:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.513473:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5d:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.513525:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.513532:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.513535:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35a00/0x8a9f4e958445ed1c lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac037 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.513559:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.513566:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32a00 x1862023612377088/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.513587:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377088:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.513648:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.518548:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377088:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.518639:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.518652:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.518710:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.519070:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5d:0x0](ffff8de1c4072a08) 00000080:00200000:1.0:1775773253.519165:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.519177:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-19, flags=0 00000080:00200000:1.0:1775773253.519182:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.519186:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-19, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.519235:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.519262:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x69:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.519310:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.519317:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.519320:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49600/0x8a9f4e958445ed70 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac1db expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.519344:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.519352:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30a80 x1862023612377344/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.519374:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377344:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.519434:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.527461:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30a80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377344:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.527581:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x69:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.527598:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.527671:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x69:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.527690:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x69:0x0](ffff8de1c37b0908) 00000080:00200000:1.0:1775773253.527852:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.527864:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-10, flags=0 00000080:00200000:1.0:1775773253.527870:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.527875:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-10, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.527944:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.527977:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x60:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.528039:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.528046:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.528049:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d49200/0x8a9f4e958445ed31 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac0a0 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.528075:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.528083:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30380 x1862023612377600/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.528107:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377600:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.528181:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.533160:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30380 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377600:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.533255:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x60:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.533268:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.533337:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x60:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.533354:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x60:0x0](ffff8de1c37b7448) 00000080:00200000:1.0:1775773253.533450:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.533463:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-14, flags=0 00000080:00200000:1.0:1775773253.533469:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.533474:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-14, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.533531:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.533561:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x64:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.533614:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 1/0,0 mode: --/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.533622:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.533625:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34000/0x8a9f4e958445ed4d lrc: 0/0,0 mode: --/PR res: [0x240002729:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac12c expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.533647:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.533655:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30000 x1862023612377856/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.533677:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377856:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.533795:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.541080:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612377856:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.541164:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x64:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.541175:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.541228:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x64:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.541242:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x64:0x0](ffff8de1c4074b08) 00000080:00200000:1.0:1775773253.541335:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.541346:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-6, flags=0 00000080:00200000:1.0:1775773253.541350:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.541354:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-6, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.541399:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.541423:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5c:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.541470:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.541477:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.541480:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34800/0x8a9f4e958445ed15 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac014 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.541502:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.541520:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30700 x1862023612378112/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.541541:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378112:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.541604:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.546155:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30700 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378112:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.546255:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.546268:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.546333:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.546348:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5c:0x0](ffff8de1c4071988) 00000080:00200000:1.0:1775773253.546455:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.546468:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-11, flags=0 00000080:00200000:1.0:1775773253.546474:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.546480:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-11, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.546534:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.546562:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x61:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.546616:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.546624:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.546627:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48800/0x8a9f4e958445ed38 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac0c3 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.546651:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.546660:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31880 x1862023612378368/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.546685:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378368:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.546882:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.552498:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378368:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.552606:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x61:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.552619:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.552680:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x61:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.552694:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x61:0x0](ffff8de1c37b00c8) 00000080:00200000:1.0:1775773253.552871:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.552882:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-4, flags=0 00000080:00200000:1.0:1775773253.552887:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.552892:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-4, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.552953:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.552980:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5a:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.553031:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.553042:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.553044:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35c00/0x8a9f4e958445ed07 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabfce expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.553064:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.553071:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a32300 x1862023612378624/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.553092:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378624:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.553154:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.565243:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a32300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378624:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.565337:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.565350:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.565407:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.565422:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5a:0x0](ffff8de1c407db88) 00000080:00200000:1.0:1775773253.565532:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.565543:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-18, flags=0 00000080:00200000:1.0:1775773253.565548:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.565553:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-18, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.565606:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.565634:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x68:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.565682:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.565689:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.565692:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35600/0x8a9f4e958445ed69 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac1b8 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.565715:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.565970:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a30e00 x1862023612378880/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.565995:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378880:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.566063:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af300 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.572069:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a30e00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612378880:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.572158:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x68:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.572170:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.572224:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x68:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.572237:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x68:0x0](ffff8de1c40721c8) 00000080:00200000:1.0:1775773253.572390:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.572401:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-17, flags=0 00000080:00200000:1.0:1775773253.572406:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.572411:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-17, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.572460:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.572484:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x67:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.572599:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.572607:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.572610:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34c00/0x8a9f4e958445ed62 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac195 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.572641:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.572648:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a31f80 x1862023612379136/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.572669:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379136:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.573444:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af600 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.581020:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a31f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379136:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.581103:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x67:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.581115:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.581171:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x67:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.581185:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x67:0x0](ffff8de1c40700c8) 00000080:00200000:1.0:1775773253.581277:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.581288:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-0, flags=0 00000080:00200000:1.0:1775773253.581293:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.581298:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-0, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.581347:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.581372:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x56:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.581424:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 1/0,0 mode: --/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.581431:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.581433:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34600/0x8a9f4e958445eceb lrc: 0/0,0 mode: --/PR res: [0x240002729:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabf42 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.581457:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.581466:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0a33800 x1862023612379392/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.581491:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379392:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.581585:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af600 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.587579:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0a33800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379392:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.587665:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x56:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.587678:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.587786:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x56:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.587800:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x56:0x0](ffff8de1c40780c8) 00000080:00200000:1.0:1775773253.587890:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.587901:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-15, flags=0 00000080:00200000:1.0:1775773253.587907:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.587912:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-15, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.587980:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.588010:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x65:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.588062:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.588070:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.588072:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e35e00/0x8a9f4e958445ed54 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac14f expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.588099:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.588108:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15f80 x1862023612379648/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.588134:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379648:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.588198:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af600 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.593428:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15f80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379648:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.593531:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x65:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.593543:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.593601:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x65:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.593614:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x65:0x0](ffff8de1c4075b88) 00000080:00200000:1.0:1775773253.593708:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.593719:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-5, flags=0 00000080:00200000:1.0:1775773253.593818:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.593825:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-5, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.593877:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.593900:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5b:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.593957:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.593964:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.593967:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384600/0x8a9f4e958445ed0e lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabff1 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.593987:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.593995:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16300 x1862023612379904/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.594016:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379904:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.594077:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af600 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.599251:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16300 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612379904:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.599350:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.599365:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.599429:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.599444:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5b:0x0](ffff8de1c407d348) 00000080:00200000:1.0:1775773253.599541:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.599553:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-16, flags=0 00000080:00200000:1.0:1775773253.599558:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.599563:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-16, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.599615:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.599641:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x66:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.599691:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 1/0,0 mode: --/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.599699:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.599701:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d0e34a00/0x8a9f4e958445ed5b lrc: 0/0,0 mode: --/PR res: [0x240002729:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac172 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.599784:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.599793:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15880 x1862023612380160/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.599817:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380160:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.599881:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af600 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.611315:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15880 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380160:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.611418:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x66:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.611430:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.611493:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x66:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.611507:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x66:0x0](ffff8de1c4070908) 00000080:00200000:1.0:1775773253.611666:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.611678:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-9, flags=0 00000080:00200000:1.0:1775773253.611694:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.611699:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-9, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.612124:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.612158:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x5f:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.612212:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 1/0,0 mode: --/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.612219:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.612222:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48400/0x8a9f4e958445ed2a lrc: 0/0,0 mode: --/PR res: [0x240002729:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac07d expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.612246:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.612257:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e16d80 x1862023612380416/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.612282:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380416:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.612350:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af000 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.618277:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16d80 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380416:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.618360:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x5f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.618372:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.618427:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x5f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.618441:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x5f:0x0](ffff8de1c37b63c8) 00000080:00200000:1.0:1775773253.618543:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.618555:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-1, flags=0 00000080:00200000:1.0:1775773253.618560:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.618565:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-1, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.618616:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1775773253.618643:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x57:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.618702:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1775773253.618711:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.618714:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384200/0x8a9f4e958445ecf2 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dabf65 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:1.0:1775773253.618785:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.618793:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e15c00 x1862023612380672/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.618814:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380672:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.618877:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af000 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.626473:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15c00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380672:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.626572:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x57:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.626585:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.626642:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x57:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.626657:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x57:0x0](ffff8de1c4073a88) 00000080:00200000:1.0:1775773253.626797:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.626810:0:169632:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f-13, flags=0 00000080:00200000:1.0:1775773253.626816:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248), inode mode 41ed mask 3 00000080:00200000:1.0:1775773253.626821:0:169632:0:(namei.c:2395:ll_unlink()) VFS Op:name=f-13, dir=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00010000:00010000:1.0:1775773253.626879:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1775773253.626910:0:169632:0:(vvp_object.c:117:vvp_conf_set()) [0x240002729:0x63:0x0]: losing layout lock 00010000:00010000:1.0:1775773253.626979:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1775773253.626986:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775773253.626989:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1d3384400/0x8a9f4e958445ed46 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x3797d62297dac109 expref: -99 pid: 169623 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1775773253.627015:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1775773253.627023:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1c2e14000 x1862023612380928/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773253.627045:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380928:192.168.201.137@tcp:36:rm.0 00000100:00100000:1.0:1775773253.627114:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af000 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.635104:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14000 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612380928:192.168.201.137@tcp:36:rm.0 00000080:00200000:1.0:1775773253.635200:0:169632:0:(vvp_io.c:1817:vvp_io_init()) [0x240002729:0x63:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1775773253.635214:0:169632:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1775773253.635273:0:169632:0:(vvp_io.c:288:vvp_io_fini()) [0x240002729:0x63:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1775773253.635287:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x63:0x0](ffff8de1c407ba88) 00000080:00200008:1.0:1775773253.635408:0:169632:0:(file.c:447:ll_file_release()) START file remote_dir:[0x240002729:0x55:0x0](ffff8de1c37b3248), flags 704000 00010000:00010000:1.0:1775773253.635448:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1775773253.635494:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 1 00000080:00200000:1.0:1775773253.635515:0:169632:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags=0 00000080:00200000:1.0:1775773253.635520:0:169632:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), intent=getattr 00000002:00010000:1.0:1775773253.635574:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: remote_dir,[0x0:0x0:0x0]) in obj [0x200027cd1:0xd:0x0], intent: getattr flags 0 00010000:00010000:1.0:1775773253.635638:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.635648:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775773253.635660:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775773253.635686:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381056:192.168.201.137@tcp:101:rm.0 00000100:00100000:0.0:1775773253.638101:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c71af000 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.643273:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381056:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773253.643299:0:169632:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 4/1,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643316:0:169632:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643325:0:169632:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643336:0:169632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643351:0:169632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643362:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643369:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643376:0:169632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.643387:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1c2e16a00 x1862023612381056/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 584/584 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.643398:0:169632:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643409:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.643420:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 2/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.643427:0:169632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643433:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643439:0:169632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643501:0:169632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:2.0:1775773253.643534:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240002729:0x55:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.643578:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643586:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.643594:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 3/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.643617:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381184:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773253.643760:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052480 going to sleep for 11 seconds 00010000:00010000:0.0:1775773253.644351:0:160426:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775773253.644359:0:160426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644368:0:160426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b9800 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:0.0:1775773253.644372:0:160426:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644380:0:160426:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644388:0:160426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 3/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644407:0:160426:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1775773253.644444:0:160426:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 2/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644452:0:160426:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775773253.644474:0:160426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 1/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644481:0:160426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9800/0x8a9f4e958445eda8 lrc: 0/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac4a5 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775773253.644496:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773253.644497:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773253.644499:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775773253.644512:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612381312:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773253.650838:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381184:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773253.650862:0:169632:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 4/1,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650875:0:169632:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 4/1,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650887:0:169632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650899:0:169632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650912:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650920:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 5/2,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650926:0:169632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 4/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.650948:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2f800 x1862023612381184/t0(0) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 576/688 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.650964:0:169632:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.650979:0:169632:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2179800 type 13 mode 4 res 9663686441/85 (0 0) 00000080:00200000:2.0:1775773253.651005:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200027cd1:0xd:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.651038:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x240002729:0x55:0x0], updating i_size 4096 00000080:00200000:2.0:1775773253.651041:0:169632:0:(namei.c:147:ll_iget()) got inode: [0x240002729:0x55:0x0](ffff8de1c37b3248): rc = 0 00000080:00010000:2.0:1775773253.651047:0:169632:0:(llite_internal.h:1976:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for remote lock 0x8a9f4e958445edaf 00000080:00010000:2.0:1775773253.651052:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) for lock 0x8a9f4e958445ecdd 00000080:00010000:2.0:1775773253.651063:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00010000:2.0:1775773253.651067:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445ecdd from it ffff9ba1c147fe00 00010000:00010000:2.0:1775773253.651070:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.651079:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1775773253.651093:0:169632:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0x8a9f4e958445edaf from it ffff9ba1c147fe00 00010000:00010000:2.0:1775773253.651095:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 3/1,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.651101:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.651118:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), inode mode 41ed mask 3 00000080:00200000:2.0:1775773253.651126:0:169632:0:(namei.c:2305:ll_rmdir()) VFS Op:name=remote_dir, dir=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00010000:00010000:2.0:1775773253.651154:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773253.651195:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 1/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773253.651202:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1775773253.651226:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1d3384c00/0x8a9f4e958445ecdd lrc: 0/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dabf18 expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1775773253.651254:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775773253.651272:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612381440:192.168.201.137@tcp:103:rm.0 00010000:00010000:2.0:1775773253.651372:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 2/0,0 mode: PR/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.651389:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 2/0,0 mode: CR/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:2.0:1775773253.651432:0:169632:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a33480 x1862023612375808/t34359738488(34359738488) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.651446:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.651453:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ea00 x1862023612381696/t0(0) o35->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.651471:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ea00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381696:192.168.201.137@tcp:35:rm.0 00000100:00100000:2.0:1775773253.651498:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.655668:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ea00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381696:192.168.201.137@tcp:35:rm.0 00000002:00100000:2.0:1775773253.655708:0:169632:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a33480 x1862023612375808/t34359738488(34359738488) o101->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1775773253.655798:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 1/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.655809:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 1/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1775773253.655815:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1775773253.655818:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edaf lrc: 0/0,0 mode: --/PR res: [0x240002729:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac4b3 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.655829:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8de1e006a000 lock: ffff8de1c29b9200/0x8a9f4e958445eda1 lrc: 0/0,0 mode: --/CR res: [0x240002729:0x55:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac252 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000020:00100000:2.0:1775773253.655850:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773253.655857:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2ea00 x1862023612381952/t0(0) o36->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773253.655878:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ea00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381952:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773253.655949:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052480 going to sleep for 11 seconds 00000100:00100000:1.0:1775773253.659869:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.137@tcp (source: 12345-192.168.201.137@tcp) 00000100:00100000:1.0:1775773253.659906:0:160416:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023625300864 00000100:00100000:1.0:1775773253.659915:0:160416:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023625300864 00000100:00100000:1.0:1775773253.659985:0:160416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.137@tcp, seq: 16 00000100:00100000:1.0:1775773253.659997:0:160416:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8de1c2e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:171947:x1862023625300864:12345-192.168.201.137@tcp:104: 00010000:00010000:1.0:1775773253.660020:0:160416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1775773253.660099:0:160416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775773253.660105:0:160416:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8de1c2e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a027f8-bfcb-4fff-aef1-8eea1b45c79e+5:171947:x1862023625300864:12345-192.168.201.137@tcp:104: Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1775773253.660113:0:160416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.137@tcp, seq: 16 00010000:00010000:3.0:1775773253.660478:0:160425:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775773253.660487:0:160425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660496:0:160425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8de1c29b8600 already unused, calling callback (ffffffffc19692e0) 00010000:00010000:3.0:1775773253.660501:0:160425:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660521:0:160425:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660531:0:160425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660562:0:160425:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1775773253.660613:0:160425:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660620:0:160425:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1775773253.660641:0:160425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660649:0:160425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b8600/0x8a9f4e958445ecd6 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x3797d62297dabefc expref: -99 pid: 169620 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1775773253.660663:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773253.660665:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773253.660667:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773253.660676:0:2404:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775773253.660694:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612382080:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773253.663814:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612381440:192.168.201.137@tcp:103:rm.0 00000100:00100000:0.0:1775773253.664167:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612381312:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775773253.668023:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612382080:192.168.201.137@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1775773253.682594:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ea00 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612381952:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773253.682667:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x240002729:0x55:0x0](ffff8de1c37b3248) 00000080:00200008:2.0:1775773253.682788:0:169632:0:(file.c:447:ll_file_release()) START file d80e.replay-single:[0x200027cd1:0xd:0x0](ffff8de1c37b42c8), flags 704000 00010000:00010000:2.0:1775773253.682832:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1775773253.682874:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.682892:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.682903:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:2.0:1775773253.682911:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:2.0:1775773253.682919:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.682925:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.682929:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.682946:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fc10 00010000:00010000:2.0:1775773253.682950:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:2.0:1775773253.682958:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:2.0:1775773253.682978:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 1 00000080:00200000:2.0:1775773253.682998:0:169632:0:(namei.c:1322:ll_lookup_nd()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), flags=0 00000080:00200000:2.0:1775773253.683003:0:169632:0:(namei.c:1063:ll_lookup_it()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148), intent=getattr 00000002:00010000:2.0:1775773253.683016:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d80e.replay-single,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.683064:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.683072:0:169632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.683180:0:169632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 169632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775773253.683203:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612382208:192.168.201.137@tcp:101:rm.0 00000100:00100000:2.0:1775773253.683269:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.694452:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612382208:192.168.201.137@tcp:101:rm.0 00010000:00010000:2.0:1775773253.694486:0:169632:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694506:0:169632:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694514:0:169632:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694528:0:169632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694540:0:169632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694554:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694563:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 5/2,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694570:0:169632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1775773253.694581:0:169632:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8de1d0f2f800 x1862023612382208/t0(0) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 592/688 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1775773253.694595:0:169632:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694605:0:169632:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8de1d2178400 type 13 mode 4 res 8590097617/13 (0 0) 00000080:00200000:2.0:1775773253.694611:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1775773253.694853:0:169632:0:(llite_lib.c:2941:ll_update_inode()) inode=[0x200027cd1:0xd:0x0], updating i_size 4096 00000080:00200000:2.0:1775773253.694857:0:169632:0:(namei.c:147:ll_iget()) got inode: [0x200027cd1:0xd:0x0](ffff8de1c37b42c8): rc = 0 00000080:00010000:2.0:1775773253.694865:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) for lock 0x8a9f4e958445edb6 00000080:00010000:2.0:1775773253.694879:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00000080:00010000:2.0:1775773253.694883:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445edb6 from it ffff9ba1c147fe00 00010000:00010000:2.0:1775773253.694887:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775773253.694913:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1775773253.694954:0:169632:0:(file.c:6121:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148),name=/ 00000002:00010000:2.0:1775773253.694974:0:169632:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1775773253.694983:0:169632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:2.0:1775773253.694991:0:169632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:2.0:1775773253.694995:0:169632:0:(namei.c:943:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1775773253.694999:0:169632:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) 00000080:00010000:2.0:1775773253.695002:0:169632:0:(llite_internal.h:1984:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8de1c4079148) for lock 0x8a9f4e958445eccf 00000080:00010000:2.0:1775773253.695004:0:169632:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a9f4e958445eccf from it ffff9ba1c147fd88 00010000:00010000:2.0:1775773253.695006:0:169632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:2.0:1775773253.695010:0:169632:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:2.0:1775773253.695016:0:169632:0:(file.c:6593:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8de1c4079148), inode mode 41ed mask 3 00000080:00200000:2.0:1775773253.695021:0:169632:0:(namei.c:2305:ll_rmdir()) VFS Op:name=d80e.replay-single, dir=[0x200000007:0x1:0x0](ffff8de1c4079148) 00010000:00010000:2.0:1775773253.695036:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:2.0:1775773253.695054:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.695063:0:169632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:2.0:1775773253.695104:0:169632:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8de1d0a31180 x1862023612374784/t365072220164(365072220164) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1775773253.695111:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1775773253.695114:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2f800 x1862023612382464/t0(0) o35->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1775773253.695131:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612382464:192.168.201.137@tcp:35:rm.0 00000100:00100000:2.0:1775773253.695191:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.698259:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612382464:192.168.201.137@tcp:35:rm.0 00000002:00100000:2.0:1775773253.698293:0:169632:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8de1d0a31180 x1862023612374784/t365072220164(365072220164) o101->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/664 e 0 to 0 dl 1775773269 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1775773253.698368:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 1/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.698376:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773253.698383:0:169632:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:2.0:1775773253.698388:0:169632:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1775773253.698391:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d48000/0x8a9f4e958445edb6 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac500 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1775773253.698408:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c29b9a00/0x8a9f4e958445ed8c lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dac221 expref: -99 pid: 169632 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1775773253.698421:0:169632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8de1e006a000 lock: ffff8de1c5d49e00/0x8a9f4e958445eccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3797d62297dabed2 expref: -99 pid: 169157 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000020:00100000:2.0:1775773253.698438:0:169632:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8de1e006a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1775773253.698444:0:169632:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8de1d0f2f800 x1862023612382720/t0(0) o36->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773253.698466:0:169632:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612382720:192.168.201.137@tcp:36:rm.0 00000100:00100000:2.0:1775773253.699438:0:169632:0:(client.c:2691:ptlrpc_set_wait()) set ffff8de1c7052480 going to sleep for 11 seconds 00000100:00100000:2.0:1775773253.707284:0:169632:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f800 pname:cluuid:pid:xid:nid:opc:job rm:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:169632:1862023612382720:192.168.201.137@tcp:36:rm.0 00000080:00200000:2.0:1775773253.707338:0:169632:0:(llite_lib.c:1913:ll_clear_inode()) VFS Op:inode=[0x200027cd1:0xd:0x0](ffff8de1c37b42c8) 00010000:00010000:2.0:1775773254.401122:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773255.423993:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773255.502247:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612382976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.502340:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612383232:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.502374:0:2405:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1775773255.502381:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612382848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.502414:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612383104:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.502437:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612383360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.527244:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612383360:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.527261:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612383232:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773255.528777:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612382976:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773255.547742:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612382848:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773255.547770:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612383104:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773256.450159:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773257.473141:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773258.495965:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773259.520622:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773260.544179:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773260.607965:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612383488:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773260.607973:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612383616:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773260.608068:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612383744:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773260.608099:0:2403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612383872:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773260.608110:0:2402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612384000:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773261.568464:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773262.591938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773263.615951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773264.640835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773265.664948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773265.728423:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612384128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773265.728526:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612384256:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773265.728623:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612384384:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773265.728674:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612384512:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773265.729149:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612384640:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773266.687943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773267.711882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773268.735886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773269.759862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773270.783920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773270.847943:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612384768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773270.847955:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612384896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773270.848027:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612385152:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773270.848030:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385024:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773270.848071:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385280:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773271.809547:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773272.831897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773273.855877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773274.879893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773275.903889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775773275.967919:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612385408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773275.967922:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773275.968009:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612385664:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773275.968012:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385792:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773275.968040:0:2405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612385920:192.168.201.137@tcp:400:kworker.0 00010000:00010000:2.0:1775773276.927909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1775773276.991838:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773260/real 1775773260] req@ffff8de1c5682d80 x1862023612383616/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773276.991871:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5682d80 x1862023612383616/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773276.991882:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1775773276.991887:0:2403:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff8de1e006a000: Connection to lustre-MDT0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1775773276.991892:0:2403:0:(import.c:416:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00000400:1.0:1775773276.991921:0:2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773260/real 1775773260] req@ffff8de1c5681f80 x1862023612383872/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:0.0:1775773276.991927:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773260/real 1775773260] req@ffff8de1c5683b80 x1862023612384000/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773276.991947:0:2403:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5681f80 x1862023612383872/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773276.991954:0:2403:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1775773276.991955:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5683b80 x1862023612384000/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:02000400:1.0:1775773276.991962:0:2403:0:(import.c:181:ptlrpc_set_import_discon()) lustre-OST0000-osc-ffff8de1e006a000: Connection to lustre-OST0000 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1775773276.991969:0:2403:0:(import.c:416:ptlrpc_pinger_force()) lustre-OST0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1775773276.991970:0:2402:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1775773276.991977:0:2402:0:(import.c:181:ptlrpc_set_import_discon()) lustre-OST0001-osc-ffff8de1e006a000: Connection to lustre-OST0001 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1775773276.991983:0:2402:0:(import.c:416:ptlrpc_pinger_force()) lustre-OST0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1775773276.991989:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773276.991991:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612383616:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773276.991993:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773276.991996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000400:0.0:1775773276.992001:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773260/real 1775773260] req@ffff8de1c5680700 x1862023612383488/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773276.992008:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9211 00000100:00100000:0.0:1775773276.992019:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5680700 x1862023612383488/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773276.992019:0:2404:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612386048:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773276.992023:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775773276.992034:0:2402:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from FULL to DISCONN 00000008:00100000:2.0:1775773276.992038:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:02020000:0.0:1775773276.992039:0:2402:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.137@tcp: Connection to MGS (at 192.168.201.137@tcp) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1775773276.992044:0:2402:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.201.137@tcp for MGC192.168.201.137@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1775773276.992047:0:2402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1775773276.992051:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c5680700 x1862023612383488/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773276.992059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612386176/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773276.992064:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0e74a80 x1862023612384128/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773281 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773276.992081:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0e74380 x1862023612384768/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773286 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773276.992092:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1c7af5180 x1862023612385408/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 1775773291 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773276.992094:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773276.992102:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773276.992105:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773276.992110:0:2402:0:(client.c:3560:ptlrpc_abort_inflight()) @@@ inflight req@ffff8de1d0f2c700 x1862023612386048/t0(0) o400->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773276.992114:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9221 00000100:00080000:2.0:1775773276.992123:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 10000000:01000000:0.0:1775773276.992124:0:2402:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1775773276.992128:0:2402:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 00000008:00100000:2.0:1775773276.992128:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 10000000:01000000:0.0:1775773276.992129:0:2402:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1775773276.992133:0:2402:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1775773276.992144:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612386432/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000400:0.0:1775773276.992145:0:2402:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773260/real 1775773260] req@ffff8de1c5682300 x1862023612383744/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773276.992172:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773276.992178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386176:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773276.992179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773276.992182:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773276.992189:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9221 00000100:00080000:2.0:1775773276.992195:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773276.992198:0:2402:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c5682300 x1862023612383744/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775773276.992201:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773276.992210:0:2402:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1775773276.992214:0:2402:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-mdc-ffff8de1e006a000: Connection to lustre-MDT0001 (at 192.168.201.137@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1775773276.992219:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612386560/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773276.992220:0:2402:0:(import.c:416:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1775773276.992228:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386432:192.168.201.137@tcp:8:kworker.0 00000100:00080000:2.0:1775773276.992236:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775773276.992237:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2402:1862023612383488:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773276.992242:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773276.992246:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773276.992255:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9207 00000100:00100000:0.0:1775773276.992259:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612383744:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773276.992263:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773276.992266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386560:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773276.992276:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612384768:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773276.992278:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612386688/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773276.992288:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773276.992291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612386688:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773276.992292:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773276.992294:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773276.992298:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9186 00000100:00080000:2.0:1775773276.992303:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773276.992308:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773276.992318:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612386816/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773276.992354:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:0:1862023612386304:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773276.992366:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612385408:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773276.992375:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2405:1862023612384128:192.168.201.137@tcp:400:kworker.0 00000100:00100000:0.0:1775773276.992435:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386816:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773276.992445:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2404:1862023612386048:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773277.951883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773278.975881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773279.999865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773281.023891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1775773281.087842:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773265/real 1775773265] req@ffff8de1d0e77480 x1862023612384256/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1775773281.087855:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773265/real 1775773265] req@ffff8de1d0e74000 x1862023612384384/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773281.087874:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e77480 x1862023612384256/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773281.087885:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 32, was 31): CONNECTING 00000100:00000400:2.0:1775773281.087894:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773265/real 1775773265] req@ffff8de1d0e76680 x1862023612384512/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773281.087895:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e74000 x1862023612384384/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773281.087917:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 17, was 16): CONNECTING 00000100:00100000:2.0:1775773281.087919:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e76680 x1862023612384512/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773281.087928:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) osc: import ffff8de1c727b000 already not connected (conn 11, was 10): CONNECTING 00000100:00000400:3.0:1775773281.087928:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773265/real 1775773265] req@ffff8de1d0e74700 x1862023612384640/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773281.087948:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612384256:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773281.087951:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e74700 x1862023612384640/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773281.087961:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) osc: import ffff8de1c727b800 already not connected (conn 8, was 7): CONNECTING 00000100:00100000:3.0:1775773281.087974:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612384384:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773282.047917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773282.111823:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773282.111832:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773282.111836:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773282.111839:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773282.111842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773282.111846:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773282.111850:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773282.111854:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773282.111856:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773282.111860:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1775773283.071906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773284.095892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773285.119968:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773286.143956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1775773286.207874:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773270/real 1775773270] req@ffff8de1d0e76a00 x1862023612385024/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.207897:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773276/real 1775773276] req@ffff8de1d0f2e680 x1862023612386816/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1775773286.207897:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773270/real 1775773270] req@ffff8de1d0e75500 x1862023612384896/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773286.207929:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e76a00 x1862023612385024/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773286.207945:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1d0e75500 x1862023612384896/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773286.207984:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 17, was 16): CONNECTING 00000100:00000400:2.0:1775773286.207993:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773270/real 1775773270] req@ffff8de1c7af5f80 x1862023612385280/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208011:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612386816/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773286.208013:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7af5f80 x1862023612385280/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208040:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773276/real 1775773276] req@ffff8de1d0f2ca80 x1862023612386688/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773286.208099:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) osc: import ffff8de1c727b800 already not connected (conn 8, was 7): CONNECTING 00000100:00080000:3.0:1775773286.208110:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 32, was 31): CONNECTING 00000100:00000400:3.0:1775773286.208123:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773270/real 1775773270] req@ffff8de1c7af5880 x1862023612385152/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612386688/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773286.208137:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385024:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773286.208157:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7af5880 x1862023612385152/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773276/real 1775773276] req@ffff8de1d0f2f100 x1862023612386560/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773286.208205:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) osc: import ffff8de1c727b000 already not connected (conn 11, was 10): CONNECTING 00000100:00100000:1.0:1775773286.208224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612386560/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773286.208226:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612384896:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773286.208254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773276/real 1775773276] req@ffff8de1d0f2e300 x1862023612386176/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612386176/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773276/real 1775773276] req@ffff8de1d0f2df80 x1862023612386432/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773286.208284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612386432/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773286.208297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773286.208325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773286.208329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386816:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775773286.208336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773286.208352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773286.208355:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773286.208358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612386688:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773286.208374:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773286.208379:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773286.208389:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9253 00000100:00080000:1.0:1775773286.208417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773286.208429:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1775773286.208445:0:2402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2402:1862023612384000:192.168.201.137@tcp:400:kworker.0 00000100:00080000:1.0:1775773286.208446:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773286.208447:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773286.208453:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612384640:192.168.201.137@tcp:400:kworker.0 00000100:00100000:1.0:1775773286.208467:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386560:192.168.201.137@tcp:8:kworker.0 00000100:00080000:1.0:1775773286.208483:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775773286.208503:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612386944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773286.208504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773286.208517:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386176:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773286.208525:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385280:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773286.208546:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773286.208551:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773286.208552:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773286.208558:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773286.208570:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9253 00000100:00100000:3.0:1775773286.208573:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612384512:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773286.208579:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1775773286.208583:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773286.208589:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612386432:192.168.201.137@tcp:8:kworker.0 00000100:00080000:2.0:1775773286.208594:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773286.208599:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612385152:192.168.201.137@tcp:400:kworker.0 00000008:00100000:2.0:1775773286.208615:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773286.208636:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612387072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773286.208648:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775773286.208650:0:2403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2403:1862023612383872:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773286.208654:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773286.208658:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773286.208667:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612386944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773286.208668:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9253 00000100:00080000:2.0:1775773286.208683:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1775773286.208690:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773286.208697:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773286.208716:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612387200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773286.208757:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773286.208761:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773286.208765:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773286.208772:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9253 00000100:00080000:2.0:1775773286.208782:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1775773286.208790:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773286.208801:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773286.208808:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773286.208819:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612387328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773286.208834:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773286.208838:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773286.208840:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773286.208843:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387200:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773286.208856:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9253 00000100:00080000:2.0:1775773286.208865:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1775773286.208871:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773286.208881:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773286.208884:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773286.208903:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612387456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773286.208936:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773287.167901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773288.191869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773289.215884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773290.239892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773291.263843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773291.327861:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000400:2.0:1775773291.327865:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773275/real 1775773275] req@ffff8de1c7af7100 x1862023612385536/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1775773291.327865:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773275/real 1775773275] req@ffff8de1c7af7800 x1862023612385664/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773291.327867:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773291.327871:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773291.327877:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773291.327881:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773291.327892:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773291.327898:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773291.327904:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773291.327907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773291.327910:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1775773291.327922:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7af7800 x1862023612385664/t0(0) o400->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773291.327926:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7af7100 x1862023612385536/t0(0) o400->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773291.327947:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c7278800 already not connected (conn 18, was 16): CONNECTING 00000100:00080000:2.0:1775773291.327948:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) mdc: import ffff8de1c3008000 already not connected (conn 33, was 31): CONNECTING 00000100:00000400:2.0:1775773291.327959:0:2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773275/real 1775773275] req@ffff8de1c7af4a80 x1862023612385792/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1775773291.327961:0:2405:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773275/real 1775773275] req@ffff8de1c7af6d80 x1862023612385920/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773291.327991:0:2404:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7af4a80 x1862023612385792/t0(0) o400->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773291.327997:0:2405:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8de1c7af6d80 x1862023612385920/t0(0) o400->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 224/224 e 0 to 1 dl 1775773291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773291.328009:0:2404:0:(import.c:213:ptlrpc_set_import_discon()) osc: import ffff8de1c727b000 already not connected (conn 12, was 10): CONNECTING 00000100:00080000:3.0:1775773291.328017:0:2405:0:(import.c:213:ptlrpc_set_import_discon()) osc: import ffff8de1c727b800 already not connected (conn 9, was 7): CONNECTING 00000100:00100000:2.0:1775773291.328026:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385536:192.168.201.137@tcp:400:kworker.0 00000100:00100000:3.0:1775773291.328032:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612385664:192.168.201.137@tcp:400:kworker.0 00010000:00010000:3.0:1775773292.287917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773293.311840:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773294.335914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773295.359890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773296.383882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773296.447912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773296.447923:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773296.447928:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773296.447932:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773296.447936:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773296.447940:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773296.447944:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773296.447947:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773296.447950:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773296.447954:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1775773297.407947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773298.431888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773299.455955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773300.479914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773301.503979:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775773301.567863:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773286/real 1775773286] req@ffff8de1d0f2f100 x1862023612387456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773301.567863:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.567873:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1775773301.567879:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.567885:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1775773301.567889:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.567891:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1775773301.567893:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.567895:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1775773301.567897:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.567899:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1775773301.567914:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612387456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567924:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773286/real 1775773286] req@ffff8de1d0f2df80 x1862023612387200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567933:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612387200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567939:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773286/real 1775773286] req@ffff8de1d0f2e300 x1862023612387328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567946:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612387328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567952:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773286/real 1775773286] req@ffff8de1d0f2c700 x1862023612386944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567959:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612386944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567965:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773286/real 1775773286] req@ffff8de1d0f2d500 x1862023612387072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773301.567977:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612387072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773301.568004:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773301.568016:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773301.568020:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387456:192.168.201.137@tcp:8:kworker.0 00000100:00080000:1.0:1775773301.568025:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773301.568036:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773301.568039:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387200:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773301.568049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773301.568053:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773301.568054:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1775773301.568061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.568069:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1775773301.568070:0:2405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2405:1862023612385920:192.168.201.137@tcp:400:kworker.0 00000100:00080000:2.0:1775773301.568072:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773301.568074:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773301.568084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775773301.568088:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387328:192.168.201.137@tcp:8:kworker.0 00000100:00080000:2.0:1775773301.568106:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773301.568116:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773301.568118:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9263 00000100:00080000:1.0:1775773301.568134:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773301.568136:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1775773301.568140:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612386944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773301.568148:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773301.568150:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775773301.568162:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000008:00100000:2.0:1775773301.568166:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773301.568167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773301.568188:0:2404:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2404:1862023612385792:192.168.201.137@tcp:400:kworker.0 00000100:00100000:2.0:1775773301.568210:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612387584/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773301.568232:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.568236:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773301.568238:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773301.568243:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9263 00000100:00080000:2.0:1775773301.568247:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1775773301.568250:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773301.568255:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773301.568263:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612387712/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773301.568268:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387584:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773301.568274:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.568278:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773301.568279:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773301.568282:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9263 00000100:00080000:2.0:1775773301.568284:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1775773301.568286:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773301.568289:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773301.568300:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612387840/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773301.568310:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.568313:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773301.568314:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773301.568317:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9263 00000100:00080000:2.0:1775773301.568320:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1775773301.568322:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773301.568329:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612387968/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773301.568340:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773301.568342:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773301.568344:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773301.568346:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9263 00000100:00080000:2.0:1775773301.568349:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1775773301.568351:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773301.568354:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773301.568360:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612388096/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773301.568396:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387712:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773301.568417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387840:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773301.568447:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612387968:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773301.568476:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388096:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775773302.527890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773303.551982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773304.575894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000800:00000100:0.0:1775773305.471874:0:2393:0:(socklnd_cb.c:2376:ksocknal_find_timed_out_conn()) A connection with 12345-192.168.201.137@tcp (192.168.201.137:988) timed out; the network or node may be down. 00010000:00010000:2.0:1775773305.599899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773306.623875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773306.687828:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773306.687835:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773306.687837:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773306.687839:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773306.687841:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773306.687843:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773306.687845:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773306.687847:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773306.687848:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773306.687850:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1775773307.647942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773308.671864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773309.695901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773310.719852:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773311.743877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773311.807878:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773311.807886:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773311.807890:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773311.807894:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773311.807897:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773311.807901:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773311.807904:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773311.807908:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773311.807911:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773311.807914:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1775773312.767873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773313.791915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773314.815913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773315.839891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773316.863948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773316.927868:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773316.927875:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773316.927878:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773316.927880:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773316.927882:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773316.927884:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773316.927885:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773316.927887:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1775773316.927889:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773316.927891:0:168768:0:(pinger.c:247:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1775773317.887853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773318.911848:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773319.935864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773320.959873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775773321.023795:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773301/real 1775773301] req@ffff8de1d0f2e680 x1862023612387712/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023820:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612387712/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023827:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773301/real 1775773301] req@ffff8de1d0f2d500 x1862023612387840/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023835:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612387840/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023841:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773301/real 1775773301] req@ffff8de1d0f2c700 x1862023612387968/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023848:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612387968/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023854:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773301/real 1775773301] req@ffff8de1d0f2e300 x1862023612388096/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023862:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612388096/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023867:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775773301/real 1775773301] req@ffff8de1d0f2ca80 x1862023612387584/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773321.023874:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612387584/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773321 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773321.023895:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773321.023909:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773321.023912:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387712:192.168.201.137@tcp:8:kworker.0 00000100:00080000:3.0:1775773321.023916:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773321.023920:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773321.023922:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387840:192.168.201.137@tcp:8:kworker.0 00000100:00080000:3.0:1775773321.023924:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773321.023928:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773321.023930:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612387968:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773321.023934:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773321.023938:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773321.023942:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388096:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773321.023947:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773321.023954:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773321.023961:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773321.023962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773321.023966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773321.023966:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612387584:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773321.023976:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9278 00000100:00080000:2.0:1775773321.023987:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1775773321.023993:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773321.024019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612388224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773321.024039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773321.024042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773321.024043:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773321.024046:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9278 00000100:00080000:2.0:1775773321.024049:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1775773321.024052:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773321.024060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773321.024060:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612388224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773321.024075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612388352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773321.024083:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773321.024086:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773321.024087:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773321.024090:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9278 00000100:00080000:2.0:1775773321.024100:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1775773321.024103:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773321.024106:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773321.024114:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612388480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773321.024121:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773321.024123:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773321.024125:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773321.024128:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9278 00000100:00080000:2.0:1775773321.024133:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1775773321.024138:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773321.024142:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388352:192.168.201.137@tcp:38:kworker.0 00000008:00100000:2.0:1775773321.024147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773321.024163:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612388608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773321.024169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388480:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773321.024187:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773321.024191:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773321.024193:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773321.024196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388608:192.168.201.137@tcp:8:kworker.0 00000100:00080000:2.0:1775773321.024201:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9278 00000100:00080000:2.0:1775773321.024206:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1775773321.024210:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773321.024216:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773321.024241:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612388736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773321.024293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773321.983906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773322.880151:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.137:988 00000400:00000100:1.0:1775773322.880196:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773322.880214:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773322.880254:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773322.880263:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773322.880272:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773322.880283:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775773322.880296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773321/real 1775773322] req@ffff8de1d0f2e300 x1862023612388608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773322.880325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612388608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773322.880337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773322.880342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773322.880346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773322.880354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773321/real 1775773322] req@ffff8de1d0f2f100 x1862023612388352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773322.880365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612388352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773322.880380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773322.880383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773322.880386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773322.880393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773321/real 1775773322] req@ffff8de1d0f2ca80 x1862023612388480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773322.880403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612388480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773322.880410:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773322.880413:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773322.880416:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773322.880421:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773321/real 1775773322] req@ffff8de1d0f2df80 x1862023612388224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773322.880432:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612388224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773322.880439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773322.880442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773322.880445:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612388224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773322.880472:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773321/real 1775773322] req@ffff8de1d0f2c700 x1862023612388736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773322.880482:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612388736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773322.880490:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773322.880493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773322.880497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773323.007823:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773324.031842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773325.055875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773326.079903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773326.143852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773326.143867:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773326.143874:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773326.143889:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9297 00000100:00080000:2.0:1775773326.143918:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773326.143930:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773326.143976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612388864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773326.144014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773326.144019:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773326.144021:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773326.144027:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9297 00000100:00080000:2.0:1775773326.144031:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773326.144036:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773326.144048:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773326.144066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612388992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773326.144077:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773326.144082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773326.144085:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773326.144090:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9297 00000100:00080000:2.0:1775773326.144095:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773326.144102:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773326.144108:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773326.144126:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612389120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773326.144142:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773326.144145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612388864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773326.144147:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773326.144149:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773326.144162:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9297 00000100:00080000:2.0:1775773326.144168:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773326.144172:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773326.144179:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773326.144204:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612389248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773326.144214:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773326.144216:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773326.144217:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773326.144219:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9297 00000100:00080000:2.0:1775773326.144222:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773326.144226:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773326.144229:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773326.144238:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612389376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773326.144280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773326.144336:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773326.144372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773326.144401:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773327.103925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773328.127899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773329.024154:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.137:988 00000400:00000100:1.0:1775773329.024227:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773329.024250:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773329.024294:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773329.024306:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773329.024319:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773329.024330:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775773329.024343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773326/real 1775773329] req@ffff8de1d0f2c700 x1862023612389120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773329.024377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612389120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773329.024391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773329.024398:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773329.024402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773329.024412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773326/real 1775773329] req@ffff8de1d0f2df80 x1862023612389248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773329.024427:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612389248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773329.024435:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773329.024439:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773329.024443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773329.024450:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773326/real 1775773329] req@ffff8de1d0f2ca80 x1862023612389376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773329.024472:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612389376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773329.024481:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773329.024485:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773329.024488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389376:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773329.024496:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773326/real 1775773329] req@ffff8de1d0f2d500 x1862023612388864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773329.024511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612388864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773329.024519:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773329.024523:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773329.024527:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612388864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773329.024534:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773326/real 1775773329] req@ffff8de1d0f2e680 x1862023612388992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773329.024548:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612388992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773329.024556:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773329.024560:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773329.024562:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612388992:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775773329.151862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773330.175867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773331.199889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773331.263870:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773331.263884:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773331.263891:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773331.263905:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9303 00000100:00080000:1.0:1775773331.263922:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773331.263931:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773331.263984:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612389504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773331.264021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773331.264024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773331.264026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773331.264030:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9303 00000100:00080000:1.0:1775773331.264033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773331.264036:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773331.264050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773331.264062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612389632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773331.264070:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773331.264073:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773331.264075:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773331.264079:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9303 00000100:00080000:1.0:1775773331.264082:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775773331.264082:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612389504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773331.264086:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773331.264093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773331.264101:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612389760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773331.264108:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773331.264110:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773331.264111:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773331.264114:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9303 00000100:00080000:1.0:1775773331.264116:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773331.264119:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773331.264122:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773331.264129:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612389888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773331.264135:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773331.264137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773331.264138:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773331.264141:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9303 00000100:00080000:1.0:1775773331.264144:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773331.264146:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773331.264149:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773331.264156:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612390016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773331.264227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773331.264256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773331.264278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773331.264293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390016:192.168.201.137@tcp:8:kworker.0 00000400:00000100:2.0:1775773332.096228:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.137:988 00000400:00000100:2.0:1775773332.096289:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775773332.096308:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773332.096348:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773332.096360:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773332.096369:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773332.096381:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775773332.096408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773331/real 1775773332] req@ffff8de1c2e14380 x1862023612389632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773332.096437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612389632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773332.096451:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773332.096457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773332.096462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773332.096472:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773331/real 1775773332] req@ffff8de1c2e16680 x1862023612389760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773332.096487:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612389760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773332.096496:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773332.096500:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773332.096504:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773332.096531:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773331/real 1775773332] req@ffff8de1c2e17b80 x1862023612389888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773332.096544:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612389888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773332.096553:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773332.096556:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773332.096591:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612389888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773332.096602:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773331/real 1775773332] req@ffff8de1c2e17100 x1862023612390016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773332.096615:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612390016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773332.096623:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773332.096627:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773332.096640:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390016:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773332.096647:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773331/real 1775773332] req@ffff8de1c2e14a80 x1862023612389504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773332.096658:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612389504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773332.096666:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773332.096669:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773332.096672:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612389504:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775773332.223952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773333.247964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773334.271937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773335.295935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773336.319892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773336.383790:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773336.383809:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773336.383815:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773336.383825:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9308 00000100:00080000:3.0:1775773336.383836:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773336.383844:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773336.383877:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612390144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773336.383901:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773336.383904:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773336.383905:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773336.383908:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9308 00000100:00080000:3.0:1775773336.383911:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773336.383914:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773336.383922:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773336.383932:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612390272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773336.383938:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773336.383941:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773336.383942:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773336.383945:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9308 00000100:00080000:3.0:1775773336.383947:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773336.383953:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612390144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773336.383960:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773336.383964:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773336.383972:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612390400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773336.383979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773336.383982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773336.383983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773336.383986:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9308 00000100:00080000:3.0:1775773336.383988:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773336.383990:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773336.383993:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773336.384000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612390528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773336.384006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773336.384008:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773336.384010:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773336.384012:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9308 00000100:00080000:3.0:1775773336.384014:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773336.384016:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773336.384022:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773336.384029:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612390656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773336.384054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773336.384098:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773336.384125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773336.384149:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773337.343995:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775773338.240038:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.137:988 00000400:00000100:2.0:1775773338.240075:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775773338.240088:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773338.240116:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773338.240122:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773338.240128:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773338.240134:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775773338.240186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773336/real 1775773338] req@ffff8de1c7af7800 x1862023612390400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773338.240219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612390400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773338.240229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773338.240233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773338.240237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773338.240244:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773336/real 1775773338] req@ffff8de1c7af5880 x1862023612390528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773338.240254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612390528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773338.240263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773338.240267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773338.240277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773338.240285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773336/real 1775773338] req@ffff8de1c7af5f80 x1862023612390656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773338.240299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612390656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773338.240307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773338.240310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773338.240314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390656:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773338.240322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773336/real 1775773338] req@ffff8de1c7af4a80 x1862023612390144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773338.240335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612390144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773338.240343:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773338.240346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773338.240349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612390144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773338.240357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773336/real 1775773338] req@ffff8de1c7af6d80 x1862023612390272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773338.240368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612390272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773338.240375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773338.240378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773338.240381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390272:192.168.201.137@tcp:38:kworker.0 00010000:00010000:2.0:1775773338.367866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773339.391829:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773340.415879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773341.439882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773341.503810:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773341.503818:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773341.503822:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773341.503830:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9313 00000100:00080000:1.0:1775773341.503840:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773341.503845:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773341.503876:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612390784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773341.503900:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773341.503903:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773341.503904:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773341.503907:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9313 00000100:00080000:1.0:1775773341.503909:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773341.503912:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773341.503919:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773341.503927:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612390912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773341.503934:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773341.503937:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773341.503938:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773341.503941:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9313 00000100:00080000:1.0:1775773341.503942:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773341.503947:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773341.503948:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612390784:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775773341.503950:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773341.503961:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612391040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773341.503969:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773341.503971:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773341.503973:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773341.503975:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9313 00000100:00080000:1.0:1775773341.503978:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773341.503980:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773341.503983:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773341.503990:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612391168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773341.503996:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773341.503998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773341.504000:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773341.504002:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9313 00000100:00080000:1.0:1775773341.504005:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775773341.504008:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773341.504012:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773341.504016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773341.504024:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612391296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773341.504044:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773341/real 1775773341] req@ffff8de1c2e14700 x1862023612390784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773341.504059:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612390784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773341.504067:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773341.504070:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773341.504073:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612390784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773341.504078:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773341.504094:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773341.504101:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773341/real 1775773341] req@ffff8de1c2e17480 x1862023612390912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773341.504108:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612390912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773341.504113:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773341.504116:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773341.504118:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612390912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773341.504144:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773341.504168:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773341.504181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773341/real 1775773341] req@ffff8de1c2e17800 x1862023612391040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773341.504194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612391040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773341.504203:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773341.504206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773341.504210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773341.504224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773341.504240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773341.504247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773341/real 1775773341] req@ffff8de1c2e14e00 x1862023612391168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773341.504255:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612391168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773341.504260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773341.504262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773341.504264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773341.504268:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773341.504278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773341.504283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773341/real 1775773341] req@ffff8de1c2e15500 x1862023612391296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773341.504290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612391296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773341.504295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773341.504297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773341.504299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773342.463902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773343.487880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773344.511900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773345.535843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773346.559908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773346.623851:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773346.623859:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773346.623863:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773346.623871:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9318 00000100:00080000:0.0:1775773346.623881:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773346.623887:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773346.623928:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612391424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773346.623948:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773346.623950:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773346.623952:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773346.623955:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9318 00000100:00080000:0.0:1775773346.623957:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773346.623960:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773346.623968:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773346.623976:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612391552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773346.623984:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773346.623987:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773346.623988:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773346.623995:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9318 00000100:00080000:0.0:1775773346.624001:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775773346.624003:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612391424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773346.624006:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773346.624020:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773346.624029:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612391680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773346.624037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773346.624040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773346.624041:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773346.624044:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9318 00000100:00080000:0.0:1775773346.624046:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773346.624048:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773346.624052:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773346.624060:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612391808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773346.624065:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773346.624067:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773346.624069:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773346.624071:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9318 00000100:00080000:0.0:1775773346.624076:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773346.624078:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773346.624081:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773346.624094:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612391936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773346.624158:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773346.624192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773346.624210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773346.624233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391936:192.168.201.137@tcp:8:kworker.0 00000400:00000100:1.0:1775773347.456082:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.137:988 00000400:00000100:1.0:1775773347.456159:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773347.456178:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773347.456217:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773347.456227:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773347.456235:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773347.456245:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775773347.456277:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773346/real 1775773347] req@ffff8de1c5683b80 x1862023612391552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773347.456315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612391552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773347.456327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773347.456333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773347.456337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773347.456357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773346/real 1775773347] req@ffff8de1c5682300 x1862023612391680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773347.456379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612391680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773347.456387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773347.456391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773347.456394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773347.456400:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773346/real 1775773347] req@ffff8de1c5680700 x1862023612391808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773347.456413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612391808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773347.456421:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773347.456425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773347.456428:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773347.456435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773346/real 1775773347] req@ffff8de1c5681c00 x1862023612391936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773347.456447:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612391936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773347.456454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773347.456457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773347.456462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612391936:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773347.456468:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773346/real 1775773347] req@ffff8de1c5681f80 x1862023612391424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773347.456481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612391424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773347.456488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773347.456492:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773347.456495:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612391424:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775773347.583869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773348.607912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773349.631845:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773350.655896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773351.679892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773351.743780:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773351.743787:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773351.743791:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773351.743798:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9323 00000100:00080000:0.0:1775773351.743807:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773351.743812:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773351.743841:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612392064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773351.743868:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773351.743870:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773351.743872:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773351.743875:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9323 00000100:00080000:0.0:1775773351.743877:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773351.743879:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773351.743887:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773351.743895:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612392192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773351.743903:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773351.743905:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773351.743906:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773351.743912:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612392064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773351.743913:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9323 00000100:00080000:0.0:1775773351.743917:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773351.743922:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773351.743926:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773351.743933:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612392320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773351.743939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773351.743942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773351.743943:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773351.743945:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9323 00000100:00080000:0.0:1775773351.743948:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773351.743952:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773351.743958:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773351.743969:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612392448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773351.743978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773351.743982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773351.743984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773351.743988:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9323 00000800:00000100:3.0:1775773351.743994:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773351.743996:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773351.744002:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773351.744008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773351.744020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612392576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773351.744026:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773351/real 1775773351] req@ffff8de1c5682a00 x1862023612392064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773351.744042:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612392064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773351.744051:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773351.744054:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773351.744057:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612392064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773351.744075:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773351.744091:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773351.744099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773351/real 1775773351] req@ffff8de1c5680380 x1862023612392192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773351.744106:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612392192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773351.744112:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773351.744114:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773351.744117:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773351.744120:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773351.744130:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773351.744135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773351/real 1775773351] req@ffff8de1c5680000 x1862023612392320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773351.744142:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612392320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773351.744147:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773351.744149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773351.744150:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773351.744154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773351.744163:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773351.744168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773351/real 1775773351] req@ffff8de1c5683480 x1862023612392448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773351.744175:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612392448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773351.744180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773351.744181:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773351.744184:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773351.744187:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773351.744196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773351.744201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773351/real 1775773351] req@ffff8de1c5681500 x1862023612392576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773351.744228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612392576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773351.744234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773351.744236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773351.744239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773352.703911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773353.727973:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773354.751925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773355.775969:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773356.799974:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773356.863804:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773356.863814:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773356.863818:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773356.863826:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9328 00000100:00080000:0.0:1775773356.863835:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773356.863841:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773356.863870:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612392704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773356.863890:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773356.863897:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773356.863899:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773356.863903:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9328 00000100:00080000:0.0:1775773356.863908:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773356.863912:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773356.863922:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773356.863922:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612392704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773356.863942:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612392832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773356.863953:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773356.863956:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773356.863957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773356.863960:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9328 00000100:00080000:0.0:1775773356.863964:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773356.863966:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773356.863970:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773356.863981:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612392960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773356.863988:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773356.863993:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773356.863996:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773356.863998:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773356.864001:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9328 00000100:00080000:0.0:1775773356.864004:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773356.864007:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773356.864012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773356.864019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612393088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773356.864026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773356.864030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773356.864031:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773356.864031:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773356/real 1775773356] req@ffff8de1c5683800 x1862023612392704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773356.864037:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9328 00000100:00080000:0.0:1775773356.864042:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773356.864047:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773356.864054:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773356.864062:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612393216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773356.864069:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612392704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773356.864082:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773356.864088:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773356.864092:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612392704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773356.864115:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773356.864157:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773356.864170:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773356/real 1775773356] req@ffff8de1c5680e00 x1862023612392832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773356.864184:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612392832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773356.864192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773356.864196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773356.864199:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773356.864206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773356.864224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773356.864231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773356/real 1775773356] req@ffff8de1c5681880 x1862023612392960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773356.864239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612392960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773356.864245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773356.864247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773356.864249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612392960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773356.864253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773356.864263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773356.864268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773356/real 1775773356] req@ffff8de1c5681500 x1862023612393088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773356.864280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612393088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773356.864285:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773356.864287:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773356.864288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773356.864292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773356.864301:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773356.864306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773356/real 1775773356] req@ffff8de1c5683480 x1862023612393216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773356.864313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612393216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773356.864318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773356.864319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773356.864321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773357.823959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773358.847964:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773359.871945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773360.895845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773361.919920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773361.983808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773361.983815:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773361.983818:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773361.983825:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9333 00000100:00080000:0.0:1775773361.983834:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773361.983839:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773361.983866:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612393344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773361.983886:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773361.983888:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773361.983895:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773361.983903:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9333 00000100:00080000:0.0:1775773361.983908:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773361.983912:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773361.983923:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773361.983923:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612393344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773361.983941:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612393472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773361.983953:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773361.983956:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773361.983958:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773361.983962:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9333 00000100:00080000:0.0:1775773361.983968:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773361.983972:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773361.983976:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773361.983989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612393600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773361.983995:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773361.984006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773361.984010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773361.984012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773361.984018:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9333 00000100:00080000:0.0:1775773361.984022:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773361.984027:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773361.984032:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773361.984059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612393728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773361.984059:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773361/real 1775773361] req@ffff8de1c5680000 x1862023612393344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773361.984115:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773361.984117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773361.984119:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773361.984123:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9333 00000100:00080000:0.0:1775773361.984127:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775773361.984129:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612393344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773361.984133:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773361.984140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775773361.984150:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775773361.984154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612393856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773361.984159:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773361.984168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612393344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773361.984196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773361.984224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773361.984238:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773361/real 1775773361] req@ffff8de1c5680380 x1862023612393472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773361.984252:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612393472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773361.984261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773361.984265:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773361.984268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773361.984275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773361.984298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773361.984309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773361/real 1775773361] req@ffff8de1c5682a00 x1862023612393600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773361.984323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612393600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773361.984337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773361.984341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773361.984344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773361.984351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773361.984373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773361.984384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773361/real 1775773361] req@ffff8de1c5681f80 x1862023612393728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773361.984397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612393728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773361.984405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773361.984409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773361.984412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773361.984418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773361.984437:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773361.984448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773361/real 1775773361] req@ffff8de1c5681c00 x1862023612393856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773361.984473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612393856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773361.984481:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773361.984484:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773361.984488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612393856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773362.943870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773363.967893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773364.991858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773366.015909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773367.039844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773367.103834:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773367.103840:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773367.103844:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773367.103853:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9338 00000100:00080000:0.0:1775773367.103862:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773367.103868:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773367.103899:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612393984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773367.103922:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773367.103925:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773367.103927:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773367.103930:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9338 00000100:00080000:0.0:1775773367.103933:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773367.103935:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773367.103962:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773367.103975:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612394112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773367.103983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773367.103986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773367.103988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773367.103992:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9338 00000100:00080000:0.0:1775773367.103995:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773367.103999:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773367.104003:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773367.104012:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612393984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773367.104013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612394240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773367.104029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773367.104031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773367.104033:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773367.104036:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9338 00000100:00080000:0.0:1775773367.104039:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773367.104042:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773367.104046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773367.104055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612394368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773367.104062:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773367.104064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773367.104066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773367.104070:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9338 00000100:00080000:0.0:1775773367.104074:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773367.104077:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773367.104080:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773367.104087:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612394496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773367.104110:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773367.104150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773367.104165:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773367.104184:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773368.063916:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775773368.960110:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.137:988 00000400:00000100:2.0:1775773368.960160:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775773368.960176:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773368.960211:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773368.960224:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773368.960239:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773368.960249:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775773368.960265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773367/real 1775773368] req@ffff8de1c5683b80 x1862023612394240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773368.960297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612394240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773368.960308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773368.960313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773368.960316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773368.960324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773367/real 1775773368] req@ffff8de1c5682d80 x1862023612394368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773368.960335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612394368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773368.960342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773368.960345:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773368.960348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773368.960353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773367/real 1775773368] req@ffff8de1c5682680 x1862023612394496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773368.960365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612394496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773368.960371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773368.960374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773368.960377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394496:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773368.960383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773367/real 1775773368] req@ffff8de1c5680700 x1862023612393984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773368.960396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612393984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773368.960404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773368.960407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773368.960411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612393984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773368.960418:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773367/real 1775773368] req@ffff8de1c5682300 x1862023612394112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773368.960431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612394112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773368.960439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773368.960442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773368.960445:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394112:192.168.201.137@tcp:38:kworker.0 00010000:00010000:2.0:1775773369.087880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773370.111972:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773371.135861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773372.159846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773372.223835:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773372.223845:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773372.223850:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773372.223876:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9343 00000100:00080000:1.0:1775773372.223888:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773372.223896:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773372.223929:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612394624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773372.223952:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773372.223955:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773372.223957:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773372.223960:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9343 00000100:00080000:1.0:1775773372.223963:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773372.223965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773372.223973:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773372.223982:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612394752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773372.223987:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612394624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773372.223997:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773372.224000:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773372.224001:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773372.224004:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9343 00000100:00080000:1.0:1775773372.224006:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773372.224009:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773372.224012:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773372.224020:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612394880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773372.224027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773372.224030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773372.224031:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773372.224033:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9343 00000100:00080000:1.0:1775773372.224038:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773372.224040:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773372.224043:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775773372.224047:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773372.224054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612395008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773372.224064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773372.224068:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773372.224070:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773372.224074:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9343 00000100:00080000:1.0:1775773372.224079:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775773372.224084:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773372/real 1775773372] req@ffff8de1c2e15500 x1862023612394624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773372.224087:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773372.224095:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773372.224111:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612394624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773372.224119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612395136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773372.224129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773372.224135:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773372.224139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612394624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773372.224159:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773372.224179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773372.224188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773372/real 1775773372] req@ffff8de1c2e14e00 x1862023612394752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773372.224197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612394752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773372.224202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773372.224204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773372.224207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773372.224211:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773372.224222:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773372.224228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773372/real 1775773372] req@ffff8de1c2e17800 x1862023612394880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773372.224235:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612394880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773372.224240:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773372.224242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773372.224244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612394880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773372.224248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773372.224257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773372.224262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773372/real 1775773372] req@ffff8de1c2e17480 x1862023612395008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773372.224269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612395008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773372.224274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773372.224276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773372.224278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773372.224281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773372.224290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773372.224296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773372/real 1775773372] req@ffff8de1c2e14700 x1862023612395136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773372.224303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612395136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773372.224307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773372.224309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773372.224311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773373.183899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773374.207931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773375.231914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773376.255908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773377.279870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773377.343821:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773377.343829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773377.343833:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773377.343840:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9349 00000100:00080000:2.0:1775773377.343850:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773377.343855:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773377.343890:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612395264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773377.343908:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773377.343910:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773377.343912:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773377.343915:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9349 00000100:00080000:2.0:1775773377.343917:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773377.343920:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773377.343928:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773377.343935:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612395264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773377.343938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612395392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773377.343947:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773377.343951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773377.343952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773377.343955:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9349 00000100:00080000:2.0:1775773377.343957:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773377.343959:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773377.343962:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773377.343972:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612395520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773377.343977:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773377.343979:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773377.343980:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773377.343982:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9349 00000100:00080000:2.0:1775773377.343985:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773377.343987:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773377.343990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773377.343997:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612395648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773377.344003:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773377.344008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773377.344011:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773377.344013:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773377.344017:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9349 00000100:00080000:2.0:1775773377.344020:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773377.344022:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773377.344026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773377.344032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612395776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773377.344041:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773377/real 1775773377] req@ffff8de1d0f2f100 x1862023612395264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773377.344057:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612395264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773377.344065:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773377.344076:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773377.344079:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612395264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773377.344100:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773377.344118:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773377.344126:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773377/real 1775773377] req@ffff8de1d0f2e300 x1862023612395392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773377.344139:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612395392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773377.344144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773377.344146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773377.344149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773377.344153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773377.344163:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773377.344169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773377/real 1775773377] req@ffff8de1d0f2e680 x1862023612395520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773377.344176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612395520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773377.344181:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773377.344183:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773377.344185:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773377.344188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773377.344198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773377.344203:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773377/real 1775773377] req@ffff8de1d0f2d500 x1862023612395648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773377.344210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612395648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773377.344219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773377.344221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773377.344225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773377.344231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773377.344248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773377.344259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773377/real 1775773377] req@ffff8de1d0f2ca80 x1862023612395776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773377.344271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612395776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773377.344279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773377.344283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773377.344286:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612395776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773378.303920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773379.328052:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773380.351878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773381.375866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773382.399878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773382.463771:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773382.463780:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773382.463785:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773382.463795:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9354 00000100:00080000:2.0:1775773382.463806:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773382.463813:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773382.463845:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612395904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773382.463866:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773382.463868:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773382.463869:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773382.463872:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9354 00000100:00080000:2.0:1775773382.463876:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773382.463879:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773382.463888:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773382.463889:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612395904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773382.463900:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612396032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773382.463909:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773382.463911:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773382.463913:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773382.463916:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9354 00000100:00080000:2.0:1775773382.463918:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773382.463921:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773382.463925:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773382.463938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612396160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773382.463948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773382.463952:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773382.463957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775773382.463957:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773382.463965:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9354 00000100:00080000:2.0:1775773382.463971:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773382.463975:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773382.463980:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773382.463989:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773382/real 1775773382] req@ffff8de1d0f2df80 x1862023612395904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773382.463992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612396288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773382.464015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773382.464017:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773382.464019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773382.464022:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612395904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773382.464025:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9354 00000100:00080000:2.0:1775773382.464031:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773382.464037:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773382.464043:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775773382.464047:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775773382.464053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612396416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773382.464053:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773382.464060:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612395904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773382.464086:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773382.464103:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773382.464112:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773382/real 1775773382] req@ffff8de1d0f2c700 x1862023612396032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773382.464121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612396032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773382.464126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773382.464128:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773382.464130:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773382.464134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773382.464144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773382.464149:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773382/real 1775773382] req@ffff8de1d0f2ca80 x1862023612396160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773382.464157:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612396160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773382.464162:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773382.464164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773382.464166:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773382.464170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773382.464180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773382.464185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773382/real 1775773382] req@ffff8de1d0f2d500 x1862023612396288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773382.464193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612396288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773382.464197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773382.464199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773382.464201:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773382.464204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773382.464213:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773382.464218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773382/real 1775773382] req@ffff8de1d0f2e680 x1862023612396416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773382.464224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612396416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773382.464229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773382.464231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773382.464233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773383.423946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773384.447931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773385.471924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773386.495835:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773387.519877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773387.583799:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773387.583807:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773387.583810:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773387.583819:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9359 00000100:00080000:0.0:1775773387.583827:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773387.583833:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773387.583866:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612396544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773387.583888:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773387.583896:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773387.583898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773387.583903:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9359 00000100:00080000:0.0:1775773387.583907:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773387.583911:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773387.583920:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612396544:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775773387.583922:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773387.583941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612396672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773387.583955:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773387.583958:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773387.583959:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773387.583962:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9359 00000100:00080000:0.0:1775773387.583966:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773387.583968:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773387.583972:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773387.583981:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612396800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773387.583987:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773387.583989:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773387.583991:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773387.583995:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9359 00000800:00000100:3.0:1775773387.583996:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773387.583998:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773387.584002:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773387.584004:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773387.584011:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612396928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773387.584018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773387.584021:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773387.584022:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773387.584025:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9359 00000100:00080000:0.0:1775773387.584030:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775773387.584030:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773387/real 1775773387] req@ffff8de1c5682300 x1862023612396544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773387.584037:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773387.584044:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773387.584053:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612397056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773387.584057:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612396544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773387.584070:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773387.584073:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773387.584078:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612396544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773387.584096:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773387.584112:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773387.584121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773387/real 1775773387] req@ffff8de1c5680700 x1862023612396672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773387.584134:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612396672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773387.584143:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773387.584146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773387.584149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773387.584156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773387.584173:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773387.584180:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773387/real 1775773387] req@ffff8de1c5682680 x1862023612396800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773387.584193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612396800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773387.584199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773387.584201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773387.584203:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773387.584207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773387.584217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773387.584226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773387/real 1775773387] req@ffff8de1c5682d80 x1862023612396928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773387.584238:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612396928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773387.584245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773387.584249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773387.584253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612396928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773387.584259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773387.584278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773387.584286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773387/real 1775773387] req@ffff8de1c5683b80 x1862023612397056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773387.584294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612397056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773387.584304:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773387.584306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773387.584308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773388.543841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773389.567889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773390.591991:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773391.615902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773392.639848:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773392.703807:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773392.703814:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773392.703817:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773392.703825:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9364 00000100:00080000:1.0:1775773392.703835:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773392.703840:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773392.703878:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612397184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773392.703899:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773392.703903:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773392.703904:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773392.703908:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9364 00000100:00080000:1.0:1775773392.703912:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773392.703916:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773392.703925:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773392.703938:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612397312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773392.703951:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773392.703956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775773392.703957:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612397184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773392.703959:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773392.703968:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9364 00000100:00080000:1.0:1775773392.703972:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773392.703974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773392.703979:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773392.703988:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612397440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773392.703996:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773392.703998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773392.704000:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773392.704002:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9364 00000100:00080000:1.0:1775773392.704007:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773392.704009:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773392.704012:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775773392.704016:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773392.704021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612397568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773392.704028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773392.704031:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773392.704032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773392.704034:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9364 00000100:00080000:1.0:1775773392.704037:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773392.704039:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773392.704043:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773392.704047:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773392/real 1775773392] req@ffff8de1c2e14a80 x1862023612397184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773392.704052:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612397696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773392.704073:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612397184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773392.704082:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773392.704085:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773392.704088:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612397184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773392.704105:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773392.704121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773392.704129:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773392/real 1775773392] req@ffff8de1c2e17100 x1862023612397312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773392.704137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612397312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773392.704147:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773392.704150:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773392.704152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773392.704155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773392.704166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773392.704171:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773392/real 1775773392] req@ffff8de1c2e17b80 x1862023612397440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773392.704181:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612397440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773392.704189:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773392.704193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773392.704196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773392.704203:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773392.704224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773392.704236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773392/real 1775773392] req@ffff8de1c2e16680 x1862023612397568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773392.704249:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612397568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773392.704256:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773392.704260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773392.704264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773392.704271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773392.704302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773392.704313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773392/real 1775773392] req@ffff8de1c2e14380 x1862023612397696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773392.704326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612397696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773392.704334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773392.704337:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773392.704341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773393.663851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773394.687890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773395.711830:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773396.735854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773397.759834:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773397.823794:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773397.823802:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773397.823806:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773397.823814:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9369 00000100:00080000:1.0:1775773397.823824:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773397.823830:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773397.823865:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612397824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773397.823889:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773397.823892:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773397.823894:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773397.823897:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9369 00000100:00080000:1.0:1775773397.823900:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773397.823903:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773397.823911:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773397.823923:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612397824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773397.823924:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612397952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773397.823940:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773397.823942:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773397.823944:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773397.823947:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9369 00000100:00080000:1.0:1775773397.823951:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773397.823954:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773397.823957:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773397.823967:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612398080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773397.823974:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773397.823977:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773397.823979:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773397.823981:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9369 00000100:00080000:1.0:1775773397.823984:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775773397.823988:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773397.823990:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773397.823995:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773397.824005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612398208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773397.824013:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773397.824016:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773397.824017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773397.824020:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9369 00000100:00080000:1.0:1775773397.824023:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773397.824027:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773397/real 1775773397] req@ffff8de1c2e16a00 x1862023612397824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773397.824028:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773397.824034:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773397.824045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612398336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773397.824072:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612397824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773397.824084:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773397.824089:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773397.824093:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612397824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773397.824118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773397.824145:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773397.824156:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773397/real 1775773397] req@ffff8de1c2e14380 x1862023612397952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773397.824166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612397952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773397.824172:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773397.824174:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773397.824178:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612397952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773397.824182:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773397.824197:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773397.824203:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773397/real 1775773397] req@ffff8de1c2e16680 x1862023612398080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773397.824212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612398080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773397.824218:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773397.824220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773397.824222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773397.824227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773397.824238:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773397.824243:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773397/real 1775773397] req@ffff8de1c2e17b80 x1862023612398208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773397.824251:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612398208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773397.824256:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773397.824260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773397.824262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773397.824267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773397.824280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773397.824290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773397/real 1775773397] req@ffff8de1c2e17100 x1862023612398336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773397.824302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612398336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773397.824312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773397.824317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773397.824322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773398.783910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773399.807901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773400.831880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773401.855905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773402.879902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773402.943788:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773402.943795:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773402.943799:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773402.943807:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9374 00000100:00080000:1.0:1775773402.943816:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773402.943822:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773402.943850:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612398464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773402.943871:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773402.943876:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773402.943878:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773402.943880:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9374 00000100:00080000:1.0:1775773402.943883:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773402.943885:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773402.943893:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773402.943903:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612398592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773402.943913:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612398464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773402.943917:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773402.943921:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773402.943923:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773402.943928:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9374 00000100:00080000:1.0:1775773402.943932:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773402.943936:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773402.943942:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773402.943955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612398720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773402.943965:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773402.943969:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773402.943971:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773402.943974:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9374 00000100:00080000:1.0:1775773402.943978:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773402.943981:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773402.943986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773402.943996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612398848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773402.944006:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398592:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775773402.944006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773402.944014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773402.944016:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773402.944020:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9374 00000100:00080000:1.0:1775773402.944023:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773402.944025:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773402.944029:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773402.944041:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612398976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773402.944043:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773402.944072:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773402.944086:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773403.903869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773404.927841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773405.951835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775773406.015965:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775773406.016006:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775773406.016024:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773406.016084:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773406.016096:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773406.016105:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775773406.016113:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775773406.016195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773402/real 1775773406] req@ffff8de1c2e17800 x1862023612398848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773406.016219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612398848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773406.016240:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773406.016246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773406.016254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773406.016262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773402/real 1775773406] req@ffff8de1c2e14e00 x1862023612398976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773406.016293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612398976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773406.016300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773406.016303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773406.016306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398976:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773406.016312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773402/real 1775773406] req@ffff8de1c2e14700 x1862023612398592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773406.016324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612398592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773406.016331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773406.016334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773406.016338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773406.016345:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773402/real 1775773406] req@ffff8de1c2e17480 x1862023612398720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773406.016356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612398720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773406.016362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773406.016366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773406.016369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612398720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773406.016376:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773402/real 1775773406] req@ffff8de1c2e14a80 x1862023612398464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773406.016389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612398464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773406.016396:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773406.016399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773406.016402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612398464:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775773406.975845:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773407.999863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773408.063795:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773408.063805:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773408.063809:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773408.063819:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9379 00000100:00080000:1.0:1775773408.063829:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773408.063835:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773408.063869:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612399104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773408.063892:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773408.063896:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773408.063897:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773408.063900:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9379 00000100:00080000:1.0:1775773408.063904:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773408.063908:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773408.063919:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773408.063936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612399232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773408.063945:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612399104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773408.063959:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773408.063964:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773408.063967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773408.063973:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9379 00000100:00080000:1.0:1775773408.063977:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773408.063980:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773408.063986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773408.064002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612399360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773408.064014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773408.064020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:0.0:1775773408.064023:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773408.064024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773408.064033:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9379 00000100:00080000:1.0:1775773408.064040:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773408.064047:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773408.064054:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773408.064073:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612399488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773408.064076:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773408/real 1775773408] req@ffff8de1c2e15500 x1862023612399104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773408.064121:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775773408.064125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612399104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773408.064128:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773408.064132:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773408.064142:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9379 00000100:00080000:1.0:1775773408.064151:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773408.064153:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773408.064159:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775773408.064165:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:1.0:1775773408.064169:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773408.064173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612399104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773408.064190:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612399616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773408.064207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773408.064275:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773408.064298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773408/real 1775773408] req@ffff8de1c2e14a80 x1862023612399232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773408.064316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612399232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773408.064326:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773408.064331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773408.064335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773408.064346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773408.064373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773408.064387:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773408/real 1775773408] req@ffff8de1c2e17480 x1862023612399360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773408.064401:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612399360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773408.064410:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773408.064415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773408.064419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773408.064427:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773408.064452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773408.064464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773408/real 1775773408] req@ffff8de1c2e14700 x1862023612399488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773408.064478:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612399488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773408.064488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773408.064492:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773408.064496:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773408.064516:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773408.064541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773408.064553:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773408/real 1775773408] req@ffff8de1c2e14e00 x1862023612399616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773408.064567:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612399616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773408.064576:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773408.064580:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773408.064584:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773409.023886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773410.047843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773411.071880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773412.095928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773413.119962:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773413.183881:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773413.183891:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773413.183897:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773413.183908:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9384 00000100:00080000:2.0:1775773413.183923:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773413.183932:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773413.183976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612399744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773413.183999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773413.184002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773413.184003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773413.184007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9384 00000100:00080000:2.0:1775773413.184009:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773413.184011:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773413.184021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773413.184029:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612399872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773413.184037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773413.184039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773413.184041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773413.184044:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9384 00000100:00080000:2.0:1775773413.184046:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773413.184051:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773413.184054:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773413.184063:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612400000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773413.184070:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773413.184072:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773413.184074:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773413.184082:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9384 00000100:00080000:2.0:1775773413.184086:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773413.184089:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773413.184093:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612399744:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773413.184093:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773413.184104:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612400128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773413.184110:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773413.184112:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773413.184114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773413.184118:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9384 00000100:00080000:2.0:1775773413.184124:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773413.184126:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773413.184129:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773413.184138:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612400256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773413.184180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773413.184213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773413/real 1775773413] req@ffff8de1d0f2e300 x1862023612399744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773413.184228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612399744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773413.184244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773413.184247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773413.184250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612399744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773413.184256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773413.184276:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773413.184284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773413/real 1775773413] req@ffff8de1d0f2f100 x1862023612399872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773413.184297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612399872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773413.184303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773413.184305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773413.184307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612399872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773413.184326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773413.184337:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773413.184343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773413/real 1775773413] req@ffff8de1d0f2e680 x1862023612400000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773413.184351:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612400000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773413.184356:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773413.184358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773413.184359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773413.184363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773413.184373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773413.184378:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773413/real 1775773413] req@ffff8de1d0f2d500 x1862023612400128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773413.184385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612400128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773413.184394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773413.184396:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773413.184398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773413.184402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773413.184411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773413.184415:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773413/real 1775773413] req@ffff8de1d0f2ca80 x1862023612400256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773413.184422:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612400256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773413.184426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773413.184428:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773413.184430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773414.143919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773415.167863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773416.191869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773417.215880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773418.239946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773418.303849:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773418.303858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773418.303863:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773418.303873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9390 00000100:00080000:0.0:1775773418.303884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773418.303891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773418.303930:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612400384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773418.303968:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773418.303973:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773418.303976:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773418.303982:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9390 00000100:00080000:0.0:1775773418.303987:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773418.303993:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773418.304004:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773418.304019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612400512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773418.304031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773418.304034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773418.304036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773418.304040:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9390 00000100:00080000:0.0:1775773418.304043:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773418.304050:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773418.304073:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612400384:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775773418.304085:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773418.304099:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612400640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773418.304109:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773418.304113:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773418.304115:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773418.304118:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9390 00000100:00080000:0.0:1775773418.304122:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773418.304125:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773418.304131:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773418.304139:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612400768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773418.304148:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773418.304151:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773418.304153:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773418.304159:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9390 00000800:00000100:3.0:1775773418.304159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773418.304167:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773418.304170:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773418.304174:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773418.304185:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612400896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773418.304212:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773418/real 1775773418] req@ffff8de1c5681c00 x1862023612400384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773418.304231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612400384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773418.304241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773418.304245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773418.304249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612400384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773418.304255:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773418.304275:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773418.304285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773418/real 1775773418] req@ffff8de1c5681f80 x1862023612400512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773418.304295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612400512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773418.304302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773418.304304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773418.304307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773418.304329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773418.304342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773418.304349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773418/real 1775773418] req@ffff8de1c5682a00 x1862023612400640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773418.304358:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612400640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773418.304370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773418.304373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773418.304376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773418.304380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773418.304392:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773418.304398:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773418/real 1775773418] req@ffff8de1c5680380 x1862023612400768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773418.304407:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612400768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773418.304414:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773418.304416:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773418.304419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773418.304423:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773418.304434:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773418.304441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773418/real 1775773418] req@ffff8de1c5680000 x1862023612400896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773418.304450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612400896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773418.304469:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773418.304472:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773418.304475:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612400896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773419.263887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773420.287916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773421.311883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773422.335953:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773423.359933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773423.423925:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773423.423933:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773423.423944:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773423.423952:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9395 00000100:00080000:0.0:1775773423.423977:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773423.423985:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773423.424020:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612401024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773423.424046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773423.424049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773423.424051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773423.424054:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9395 00000100:00080000:0.0:1775773423.424058:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773423.424061:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773423.424069:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773423.424078:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612401152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773423.424087:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773423.424089:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773423.424091:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773423.424093:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9395 00000100:00080000:0.0:1775773423.424097:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773423.424099:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773423.424104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773423.424115:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612401280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773423.424118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612401024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773423.424141:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773423.424144:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773423.424145:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773423.424148:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9395 00000100:00080000:0.0:1775773423.424151:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773423.424153:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773423.424157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773423.424164:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612401408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773423.424175:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773423.424178:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773423.424179:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773423.424182:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9395 00000100:00080000:0.0:1775773423.424186:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773423.424189:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773423.424192:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773423.424216:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612401536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773423.424240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773423.424300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773423/real 1775773423] req@ffff8de1c5683480 x1862023612401024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773423.424332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612401024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773423.424342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773423.424346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773423.424351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612401024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773423.424357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773423.424375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773423.424383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773423/real 1775773423] req@ffff8de1c5681500 x1862023612401152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773423.424392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612401152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773423.424397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773423.424399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773423.424401:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773423.424429:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773423.424440:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773423.424446:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773423/real 1775773423] req@ffff8de1c5681880 x1862023612401280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773423.424454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612401280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773423.424459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773423.424461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773423.424462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773423.424467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773423.424477:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773423.424482:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773423/real 1775773423] req@ffff8de1c5680e00 x1862023612401408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773423.424489:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612401408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773423.424494:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773423.424496:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773423.424497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773423.424501:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773423.424510:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773423.424516:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773423/real 1775773423] req@ffff8de1c5683800 x1862023612401536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773423.424524:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612401536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773423.424529:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773423.424531:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773423.424532:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773424.384016:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773425.407923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773426.431896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773427.455951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773428.479920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773428.543852:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773428.543860:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773428.543864:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773428.543887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9400 00000100:00080000:1.0:1775773428.543901:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773428.543910:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773428.543954:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612401664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773428.543980:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773428.543983:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773428.543984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773428.543988:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9400 00000100:00080000:1.0:1775773428.543991:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773428.543994:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773428.544003:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773428.544014:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612401792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773428.544023:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773428.544026:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773428.544027:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773428.544030:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9400 00000100:00080000:1.0:1775773428.544032:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773428.544034:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773428.544039:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773428.544041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612401664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773428.544048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612401920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773428.544057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773428.544059:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773428.544061:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773428.544063:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9400 00000100:00080000:1.0:1775773428.544066:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773428.544069:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773428.544073:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773428.544081:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612402048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773428.544088:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773428.544091:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773428.544093:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773428.544095:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9400 00000100:00080000:1.0:1775773428.544098:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773428.544101:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773428.544105:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773428.544112:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612402176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773428.544121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773428.544158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773428/real 1775773428] req@ffff8de1c2e17800 x1862023612401664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773428.544186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612401664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773428.544195:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773428.544198:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773428.544202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612401664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773428.544208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773428.544228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773428.544237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773428/real 1775773428] req@ffff8de1c2e17100 x1862023612401792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773428.544246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612401792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773428.544252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773428.544255:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773428.544258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773428.544284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773428.544308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773428.544321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773428/real 1775773428] req@ffff8de1c2e17b80 x1862023612401920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773428.544335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612401920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773428.544345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773428.544348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773428.544352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612401920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773428.544360:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773428.544383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773428.544393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773428/real 1775773428] req@ffff8de1c2e16680 x1862023612402048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773428.544402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612402048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773428.544408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773428.544410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773428.544413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773428.544418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773428.544430:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773428.544436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773428/real 1775773428] req@ffff8de1c2e14380 x1862023612402176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773428.544444:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612402176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773428.544450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773428.544452:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773428.544454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773429.503929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773430.527914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773431.551936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773432.575919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773433.599995:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773433.663866:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773433.663880:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773433.663885:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773433.663898:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9405 00000100:00080000:0.0:1775773433.663913:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773433.663922:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773433.663970:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612402304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773433.664010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773433.664015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773433.664018:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773433.664023:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9405 00000100:00080000:0.0:1775773433.664029:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773433.664035:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773433.664052:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773433.664057:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612402304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773433.664076:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612402432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773433.664090:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773433.664093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773433.664095:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773433.664099:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9405 00000100:00080000:0.0:1775773433.664104:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773433.664108:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773433.664113:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773433.664125:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612402560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773433.664132:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773433.664135:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773433.664137:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773433.664139:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9405 00000100:00080000:0.0:1775773433.664142:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773433.664144:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773433.664147:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775773433.664153:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773433.664155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612402688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773433.664162:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773433.664165:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773433.664167:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773433.664170:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9405 00000100:00080000:0.0:1775773433.664173:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773433.664176:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773433.664179:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773433.664186:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612402816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773433.664208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773433/real 1775773433] req@ffff8de1c5683800 x1862023612402304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773433.664228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612402304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773433.664236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773433.664240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773433.664243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612402304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773433.664273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773433.664297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773433.664311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773433/real 1775773433] req@ffff8de1c5680e00 x1862023612402432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773433.664325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612402432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773433.664342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773433.664345:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773433.664348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773433.664353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773433.664369:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773433.664378:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773433/real 1775773433] req@ffff8de1c5681880 x1862023612402560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773433.664386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612402560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773433.664391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773433.664393:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773433.664395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773433.664399:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773433.664411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773433.664425:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773433/real 1775773433] req@ffff8de1c5681500 x1862023612402688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773433.664437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612402688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773433.664442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773433.664444:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773433.664448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773433.664453:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773433.664464:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773433.664469:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773433/real 1775773433] req@ffff8de1c5683480 x1862023612402816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773433.664483:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612402816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773433.664489:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773433.664490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773433.664494:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612402816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773434.623959:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773435.647959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773436.671940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773437.695934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773438.719878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773438.783844:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773438.783854:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773438.783859:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773438.783870:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9410 00000100:00080000:0.0:1775773438.783883:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773438.783890:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773438.783923:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612402944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773438.783951:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773438.783954:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773438.783955:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773438.783959:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9410 00000100:00080000:0.0:1775773438.783961:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773438.783964:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773438.783973:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773438.783983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612403072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773438.783991:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612402944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773438.784004:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773438.784007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773438.784008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773438.784012:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9410 00000100:00080000:0.0:1775773438.784014:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773438.784017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773438.784021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773438.784030:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612403200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773438.784036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773438.784038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773438.784040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773438.784042:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9410 00000100:00080000:0.0:1775773438.784044:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773438.784047:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773438.784050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775773438.784052:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773438.784065:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612403328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773438.784072:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773438.784074:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773438.784075:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773438.784078:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9410 00000100:00080000:0.0:1775773438.784081:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773438.784083:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773438.784088:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773438.784093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773438/real 1775773438] req@ffff8de1c5680000 x1862023612402944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773438.784096:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612403456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773438.784143:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612402944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773438.784151:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773438.784154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773438.784157:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612402944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773438.784176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773438.784194:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773438.784203:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773438/real 1775773438] req@ffff8de1c5680380 x1862023612403072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773438.784211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612403072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773438.784217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773438.784219:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773438.784221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773438.784225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773438.784234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773438.784240:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773438/real 1775773438] req@ffff8de1c5682a00 x1862023612403200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773438.784247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612403200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773438.784252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773438.784254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773438.784255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773438.784259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773438.784269:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773438.784274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773438/real 1775773438] req@ffff8de1c5681f80 x1862023612403328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773438.784281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612403328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773438.784286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773438.784289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773438.784292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773438.784298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773438.784316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773438.784327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773438/real 1775773438] req@ffff8de1c5681c00 x1862023612403456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773438.784340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612403456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773438.784348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773438.784352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773438.784354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773439.743917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773440.767881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773441.791952:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773442.815878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773443.839913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773443.903913:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773443.903924:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773443.903940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773443.903952:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9415 00000100:00080000:1.0:1775773443.903965:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773443.903972:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773443.904016:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612403584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773443.904046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773443.904049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773443.904051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773443.904054:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9415 00000100:00080000:1.0:1775773443.904056:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773443.904059:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773443.904069:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773443.904080:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612403712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773443.904088:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773443.904091:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773443.904094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773443.904095:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612403584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773443.904099:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9415 00000100:00080000:1.0:1775773443.904104:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773443.904106:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773443.904109:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773443.904117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612403840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773443.904123:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773443.904125:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773443.904127:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773443.904129:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9415 00000100:00080000:1.0:1775773443.904131:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773443.904134:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773443.904139:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773443.904145:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612403968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773443.904151:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773443.904153:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773443.904154:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773443.904156:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9415 00000100:00080000:1.0:1775773443.904161:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773443.904163:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773443.904167:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775773443.904174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773443.904176:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612404096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773443.904214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773443/real 1775773443] req@ffff8de1c2e16a00 x1862023612403584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773443.904230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612403584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773443.904259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773443.904263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773443.904268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612403584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773443.904298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773443.904324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773443.904338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773443/real 1775773443] req@ffff8de1c2e14380 x1862023612403712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773443.904352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612403712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773443.904361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773443.904364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773443.904366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773443.904371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773443.904387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773443.904394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773443/real 1775773443] req@ffff8de1c2e16680 x1862023612403840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773443.904402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612403840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773443.904407:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773443.904409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773443.904411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773443.904416:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773443.904427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773443.904432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773443/real 1775773443] req@ffff8de1c2e17b80 x1862023612403968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773443.904439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612403968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773443.904445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773443.904446:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773443.904448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612403968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773443.904451:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773443.904461:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773443.904465:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773443/real 1775773443] req@ffff8de1c2e17100 x1862023612404096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773443.904472:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612404096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773443.904477:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773443.904479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773443.904480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773444.863865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773445.887893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773446.911890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773447.935951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773448.959895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773449.023832:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773449.023840:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773449.023844:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773449.023852:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9420 00000100:00080000:2.0:1775773449.023861:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773449.023866:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773449.023904:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612404224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773449.023923:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773449.023925:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773449.023927:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773449.023929:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9420 00000100:00080000:2.0:1775773449.023932:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773449.023935:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773449.023942:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773449.023951:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612404352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773449.023959:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773449.023964:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773449.023965:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773449.023965:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612404224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773449.023974:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9420 00000100:00080000:2.0:1775773449.023978:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773449.023980:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773449.023982:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773449.023991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612404480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773449.023997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773449.024000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773449.024001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773449.024004:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9420 00000100:00080000:2.0:1775773449.024015:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773449.024018:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773449.024021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775773449.024028:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773449.024031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612404608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773449.024038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773449.024041:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773449.024042:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773449.024045:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9420 00000100:00080000:2.0:1775773449.024047:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773449.024050:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773449.024055:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773449.024061:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773449/real 1775773449] req@ffff8de1d0f2c700 x1862023612404224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773449.024063:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612404736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773449.024098:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612404224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773449.024106:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773449.024109:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773449.024112:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612404224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773449.024128:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773449.024143:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773449.024151:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773449/real 1775773449] req@ffff8de1d0f2df80 x1862023612404352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773449.024159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612404352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773449.024164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773449.024166:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773449.024168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773449.024172:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773449.024181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773449.024186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773449/real 1775773449] req@ffff8de1d0f2ca80 x1862023612404480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773449.024198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612404480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773449.024202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773449.024204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773449.024206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773449.024209:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773449.024218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773449.024223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773449/real 1775773449] req@ffff8de1d0f2d500 x1862023612404608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773449.024229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612404608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773449.024234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773449.024236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773449.024238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773449.024241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773449.024250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773449.024254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773449/real 1775773449] req@ffff8de1d0f2e680 x1862023612404736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773449.024260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612404736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773449.024270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773449.024272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773449.024274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773449.983914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773451.007886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773452.031940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773453.055888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773454.079828:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773454.143874:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773454.143882:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773454.143886:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773454.143894:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9425 00000100:00080000:0.0:1775773454.143904:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773454.143910:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773454.143943:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612404864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773454.143966:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773454.143968:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773454.143969:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773454.143972:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9425 00000100:00080000:0.0:1775773454.143975:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773454.143977:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773454.143984:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773454.143992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612404992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773454.143999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773454.144004:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773454.144005:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773454.144008:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9425 00000100:00080000:0.0:1775773454.144010:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773454.144012:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773454.144016:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773454.144019:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612404864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773454.144024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612405120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773454.144032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773454.144034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773454.144034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773454.144038:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9425 00000100:00080000:0.0:1775773454.144040:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773454.144042:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773454.144046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773454.144054:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612405248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773454.144060:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773454.144062:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773454.144063:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773454.144066:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9425 00000100:00080000:0.0:1775773454.144070:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773454.144072:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773454.144076:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775773454.144081:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773454.144085:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612405376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773454.144115:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773454/real 1775773454] req@ffff8de1c5683b80 x1862023612404864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773454.144129:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612404864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773454.144137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773454.144140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773454.144143:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612404864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773454.144147:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773454.144162:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773454.144169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773454/real 1775773454] req@ffff8de1c5682d80 x1862023612404992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773454.144176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612404992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773454.144185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773454.144188:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773454.144190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612404992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773454.144207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773454.144217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773454.144222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773454/real 1775773454] req@ffff8de1c5682680 x1862023612405120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773454.144229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612405120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773454.144234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773454.144236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773454.144238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773454.144242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773454.144251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773454.144256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773454/real 1775773454] req@ffff8de1c5680700 x1862023612405248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773454.144263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612405248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773454.144268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773454.144269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773454.144272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773454.144275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773454.144284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773454.144290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773454/real 1775773454] req@ffff8de1c5682300 x1862023612405376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773454.144302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612405376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773454.144309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773454.144312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773454.144315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773455.103937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773456.127849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773457.151988:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773458.175859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773459.199842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773459.263805:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773459.263813:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773459.263817:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773459.263825:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9431 00000100:00080000:0.0:1775773459.263835:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773459.263841:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773459.263876:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612405504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773459.263902:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773459.263905:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773459.263906:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773459.263909:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9431 00000100:00080000:0.0:1775773459.263912:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773459.263915:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773459.263922:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773459.263932:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612405632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773459.263944:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773459.263949:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775773459.263951:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612405504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773459.263952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773459.263979:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9431 00000100:00080000:0.0:1775773459.263984:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773459.263989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773459.263995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773459.264010:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612405760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773459.264021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773459.264025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773459.264028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773459.264032:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9431 00000100:00080000:0.0:1775773459.264035:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773459.264039:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775773459.264045:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773459.264046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773459.264058:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612405888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773459.264066:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773459.264069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773459.264070:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773459.264073:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9431 00000100:00080000:0.0:1775773459.264076:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773459.264079:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773459.264082:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773459.264092:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612406016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773459.264093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773459/real 1775773459] req@ffff8de1c5682300 x1862023612405504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773459.264142:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612405504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773459.264151:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773459.264155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773459.264158:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612405504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773459.264178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773459.264197:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773459.264206:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773459/real 1775773459] req@ffff8de1c5680700 x1862023612405632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773459.264215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612405632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773459.264227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773459.264230:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773459.264232:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773459.264236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773459.264248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773459.264255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773459/real 1775773459] req@ffff8de1c5682680 x1862023612405760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773459.264262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612405760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773459.264267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773459.264269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773459.264271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773459.264275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773459.264288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773459.264298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773459/real 1775773459] req@ffff8de1c5682d80 x1862023612405888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773459.264319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612405888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773459.264328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773459.264332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773459.264352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612405888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773459.264359:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773459.264383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773459.264396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773459/real 1775773459] req@ffff8de1c5683b80 x1862023612406016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773459.264409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612406016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773459.264418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773459.264421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773459.264425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773460.223947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773461.247908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773462.271861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773463.295917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773464.320007:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773464.383952:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773464.383962:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773464.383967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773464.383977:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9436 00000100:00080000:1.0:1775773464.383990:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773464.383997:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773464.384040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612406144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773464.384073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773464.384077:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773464.384079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773464.384095:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9436 00000100:00080000:1.0:1775773464.384100:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773464.384104:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773464.384115:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773464.384128:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612406272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773464.384142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773464.384149:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775773464.384150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612406144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773464.384164:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773464.384176:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9436 00000100:00080000:1.0:1775773464.384180:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773464.384183:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773464.384188:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773464.384202:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612406400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773464.384213:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773464.384227:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773464.384230:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773464.384233:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9436 00000100:00080000:1.0:1775773464.384239:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773464.384242:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773464.384271:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773464.384300:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612406528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773464.384300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773464.384324:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773464.384328:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773464.384330:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773464.384335:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9436 00000100:00080000:1.0:1775773464.384340:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773464.384344:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773464.384350:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773464.384356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773464/real 1775773464] req@ffff8de1c2e17800 x1862023612406144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773464.384373:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612406656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773464.384443:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612406144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773464.384458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773464.384464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773464.384469:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612406144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773464.384504:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773464.384531:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773464.384544:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773464/real 1775773464] req@ffff8de1c2e14e00 x1862023612406272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773464.384558:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612406272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773464.384567:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773464.384571:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773464.384574:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773464.384580:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773464.384597:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773464.384605:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773464/real 1775773464] req@ffff8de1c2e14700 x1862023612406400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773464.384617:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612406400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773464.384632:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773464.384635:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773464.384639:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773464.384663:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773464.384684:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773464.384694:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773464/real 1775773464] req@ffff8de1c2e17480 x1862023612406528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773464.384708:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612406528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773464.384717:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773464.384721:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773464.384724:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773464.384730:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773464.384815:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773464.384828:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773464/real 1775773464] req@ffff8de1c2e14a80 x1862023612406656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773464.384841:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612406656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773464.384849:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773464.384852:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773464.384856:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773465.343915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773466.367888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773467.392021:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773468.415881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773469.439915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773469.503896:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773469.503905:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773469.503908:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773469.503917:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9441 00000100:00080000:1.0:1775773469.503934:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773469.503941:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773469.503991:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612406784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773469.504017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773469.504020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773469.504022:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773469.504029:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9441 00000100:00080000:1.0:1775773469.504033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773469.504037:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773469.504047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773469.504061:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612406912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773469.504066:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612406784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773469.504072:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773469.504074:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773469.504075:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773469.504079:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9441 00000100:00080000:1.0:1775773469.504082:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773469.504084:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773469.504088:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773469.504104:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612407040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773469.504110:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773469.504112:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773469.504114:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773469.504117:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9441 00000100:00080000:1.0:1775773469.504126:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773469.504130:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773469.504134:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773469.504142:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612407168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773469.504150:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773469.504152:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773469.504154:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773469.504170:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9441 00000100:00080000:1.0:1775773469.504173:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773469.504177:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773469.504182:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773469.504190:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773469.504195:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612407296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773469.504245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773469.504277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773469.504302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773470.463896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773471.487880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773472.511822:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1775773472.575979:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:3.0:1775773472.576022:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1775773472.576039:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773472.576076:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773472.576086:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773472.576093:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773472.576116:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775773472.576157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773469/real 1775773472] req@ffff8de1c2e14e00 x1862023612407296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773472.576184:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612407296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773472.576196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773472.576202:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773472.576206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407296:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773472.576215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773469/real 1775773472] req@ffff8de1c2e14a80 x1862023612406912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773472.576227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612406912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773472.576235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773472.576239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773472.576242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612406912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773472.576249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773469/real 1775773472] req@ffff8de1c2e17480 x1862023612407040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773472.576261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612407040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773472.576269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773472.576272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773472.576275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773472.576282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773469/real 1775773472] req@ffff8de1c2e14700 x1862023612407168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773472.576293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612407168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773472.576300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773472.576303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773472.576306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773472.576313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773469/real 1775773472] req@ffff8de1c2e15500 x1862023612406784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773472.576323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612406784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773472.576332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773472.576335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773472.576338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612406784:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775773473.535850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773474.559851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773474.623821:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773474.623829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773474.623833:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773474.623840:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9446 00000100:00080000:0.0:1775773474.623850:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773474.623856:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773474.623884:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612407424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773474.623908:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773474.623911:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773474.623912:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773474.623915:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9446 00000100:00080000:0.0:1775773474.623917:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773474.623919:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773474.623927:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773474.623935:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612407552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773474.623942:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773474.623947:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775773474.623947:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612407424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773474.623949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773474.623956:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9446 00000100:00080000:0.0:1775773474.623959:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773474.623961:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773474.623964:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773474.623973:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612407680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773474.623979:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773474.623982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773474.623983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773474.623986:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9446 00000100:00080000:0.0:1775773474.623987:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773474.623990:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773474.623993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773474.623999:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612407808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773474.624004:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773474.624007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773474.624008:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773474.624010:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9446 00000100:00080000:0.0:1775773474.624013:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773474.624019:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775773474.624019:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773474.624025:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773474.624031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612407936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773474.624079:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773474/real 1775773474] req@ffff8de1c5681c00 x1862023612407424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773474.624100:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612407424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773474.624111:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773474.624115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773474.624119:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612407424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773474.624142:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773474.624167:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773474.624180:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773474/real 1775773474] req@ffff8de1c5681f80 x1862023612407552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773474.624192:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612407552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773474.624200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773474.624203:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773474.624206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773474.624211:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773474.624231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773474.624241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773474/real 1775773474] req@ffff8de1c5682a00 x1862023612407680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773474.624252:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612407680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773474.624259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773474.624269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773474.624272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773474.624278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773474.624297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773474.624308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773474/real 1775773474] req@ffff8de1c5680380 x1862023612407808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773474.624320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612407808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773474.624328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773474.624332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773474.624335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773474.624342:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773474.624361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773474.624372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773474/real 1775773474] req@ffff8de1c5680000 x1862023612407936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773474.624384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612407936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773474.624392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773474.624396:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773474.624399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612407936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773475.583825:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773476.607834:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773477.631897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773478.655866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773479.679936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773479.743899:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773479.743909:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773479.743914:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773479.743925:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9451 00000100:00080000:1.0:1775773479.743938:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773479.743946:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773479.744016:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612408064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773479.744047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773479.744050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773479.744052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773479.744055:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9451 00000100:00080000:1.0:1775773479.744058:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773479.744061:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773479.744072:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773479.744082:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612408192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773479.744095:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773479.744098:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773479.744099:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773479.744102:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9451 00000100:00080000:1.0:1775773479.744104:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773479.744106:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773479.744109:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773479.744118:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612408320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773479.744126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773479.744129:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773479.744131:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773479.744138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612408064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773479.744139:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9451 00000100:00080000:1.0:1775773479.744144:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773479.744155:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773479.744162:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773479.744178:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612408448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773479.744189:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773479.744193:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773479.744195:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773479.744201:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9451 00000100:00080000:1.0:1775773479.744207:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773479.744212:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773479.744218:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773479.744231:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612408576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773479.744245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773479.744285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773479/real 1775773479] req@ffff8de1c2e17800 x1862023612408064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773479.744302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612408064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773479.744310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773479.744314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773479.744317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612408064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773479.744323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773479.744339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773479.744347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773479/real 1775773479] req@ffff8de1c2e17100 x1862023612408192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773479.744355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612408192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773479.744360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773479.744362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773479.744365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773479.744386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773479.744397:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773479.744403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773479/real 1775773479] req@ffff8de1c2e17b80 x1862023612408320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773479.744411:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612408320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773479.744419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773479.744423:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773479.744426:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773479.744432:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773479.744453:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773479.744465:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773479/real 1775773479] req@ffff8de1c2e16680 x1862023612408448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773479.744478:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612408448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773479.744486:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773479.744490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773479.744492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773479.744497:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773479.744512:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773479.744519:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773479/real 1775773479] req@ffff8de1c2e14380 x1862023612408576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773479.744526:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612408576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773479.744531:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773479.744533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773479.744535:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773480.703937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773481.727876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773482.751963:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773483.775872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773484.799969:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773484.863918:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773484.863930:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773484.863935:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773484.863946:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9456 00000100:00080000:2.0:1775773484.863957:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773484.863963:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773484.863994:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612408704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773484.864024:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773484.864028:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773484.864030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773484.864034:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9456 00000100:00080000:2.0:1775773484.864039:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773484.864043:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773484.864059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773484.864068:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612408704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773484.864075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612408832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773484.864086:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773484.864090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773484.864092:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773484.864096:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9456 00000100:00080000:2.0:1775773484.864099:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773484.864103:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773484.864108:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773484.864120:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612408960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773484.864129:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773484.864132:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773484.864135:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775773484.864137:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773484.864142:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9456 00000100:00080000:2.0:1775773484.864147:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773484.864151:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773484.864156:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773484.864167:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612409088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773484.864177:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775773484.864181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773484/real 1775773484] req@ffff8de1d0f2f100 x1862023612408704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773484.864182:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773484.864186:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773484.864196:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9456 00000100:00080000:2.0:1775773484.864201:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773484.864206:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773484.864208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612408704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775773484.864214:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775773484.864218:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773484.864223:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773484.864227:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612409216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773484.864228:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612408704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773484.864258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773484.864284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773484.864306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773484/real 1775773484] req@ffff8de1d0f2e300 x1862023612408832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773484.864319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612408832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773484.864328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773484.864331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773484.864334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773484.864340:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773484.864361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773484.864372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773484/real 1775773484] req@ffff8de1d0f2e680 x1862023612408960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773484.864383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612408960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773484.864397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773484.864401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773484.864404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612408960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773484.864410:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773484.864429:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773484.864439:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773484/real 1775773484] req@ffff8de1d0f2d500 x1862023612409088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773484.864450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612409088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773484.864458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773484.864461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773484.864464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773484.864470:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773484.864490:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773484.864501:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773484/real 1775773484] req@ffff8de1d0f2ca80 x1862023612409216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773484.864514:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612409216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773484.864522:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773484.864525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773484.864529:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773485.823848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773486.847931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773487.871944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773488.895922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773489.920014:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773489.983842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773489.983851:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773489.983855:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773489.983864:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9461 00000100:00080000:3.0:1775773489.983875:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773489.983882:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773489.983917:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612409344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773489.983953:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773489.983956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773489.983957:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773489.983964:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9461 00000100:00080000:3.0:1775773489.983968:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773489.983971:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773489.983980:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773489.983991:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612409472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773489.983997:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612409344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773489.984002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773489.984005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773489.984006:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773489.984009:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9461 00000100:00080000:3.0:1775773489.984012:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773489.984015:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773489.984018:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773489.984027:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612409600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773489.984034:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773489.984036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773489.984037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773489.984040:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9461 00000100:00080000:3.0:1775773489.984042:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773489.984044:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773489.984047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773489.984054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612409728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773489.984060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775773489.984064:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773489.984066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773489.984068:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773489.984071:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9461 00000100:00080000:3.0:1775773489.984074:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773489.984077:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773489.984080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773489.984086:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612409856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773489.984108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773489/real 1775773489] req@ffff8de1c7af7b80 x1862023612409344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773489.984125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612409344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773489.984132:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773489.984135:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773489.984138:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612409344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773489.984156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773489.984172:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773489.984179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773489/real 1775773489] req@ffff8de1c7af4e00 x1862023612409472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773489.984187:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612409472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773489.984192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773489.984194:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773489.984196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773489.984200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773489.984212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773489.984217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773489/real 1775773489] req@ffff8de1c7af4380 x1862023612409600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773489.984224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612409600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773489.984229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773489.984231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773489.984233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773489.984236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773489.984247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773489.984252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773489/real 1775773489] req@ffff8de1c7af4000 x1862023612409728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773489.984259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612409728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773489.984264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773489.984266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773489.984268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773489.984271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773489.984280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773489.984285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773489/real 1775773489] req@ffff8de1c7af7480 x1862023612409856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773489.984296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612409856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773489.984301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773489.984302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773489.984304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612409856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773490.943900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773491.967917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773492.991936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773494.015928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773495.039908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773495.103880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773495.103891:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773495.103897:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773495.103918:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9466 00000100:00080000:3.0:1775773495.103934:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773495.103943:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773495.103993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612409984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773495.104025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773495.104029:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773495.104030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773495.104034:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9466 00000100:00080000:3.0:1775773495.104038:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773495.104041:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773495.104054:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773495.104072:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612410112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773495.104076:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612409984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773495.104093:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773495.104097:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773495.104100:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773495.104105:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9466 00000100:00080000:3.0:1775773495.104109:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773495.104112:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773495.104117:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773495.104131:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612410240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773495.104141:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773495.104146:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773495.104148:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773495.104152:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9466 00000100:00080000:3.0:1775773495.104156:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775773495.104162:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773495.104164:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773495.104172:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773495.104185:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612410368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773495.104192:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773495.104195:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773495.104196:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773495.104200:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9466 00000100:00080000:3.0:1775773495.104203:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773495.104206:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773495.104211:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773495.104214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773495/real 1775773495] req@ffff8de1c7af5500 x1862023612409984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773495.104222:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612410496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773495.104237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612409984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773495.104246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773495.104250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773495.104256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612409984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773495.104290:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773495.104313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773495.104323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773495/real 1775773495] req@ffff8de1c7af5c00 x1862023612410112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773495.104332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612410112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773495.104338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773495.104341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773495.104343:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773495.104348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773495.104359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773495.104364:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773495/real 1775773495] req@ffff8de1c7af6300 x1862023612410240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773495.104372:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612410240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773495.104377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773495.104378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773495.104380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773495.104384:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773495.104394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773495.104399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773495/real 1775773495] req@ffff8de1c7af4700 x1862023612410368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773495.104406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612410368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773495.104411:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773495.104412:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773495.104415:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773495.104419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773495.104429:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773495.104434:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773495/real 1775773495] req@ffff8de1c7af6680 x1862023612410496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773495.104441:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612410496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773495.104446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773495.104448:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773495.104450:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773496.063855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773497.087906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773498.111884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773499.135918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773500.159899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773500.223880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773500.223891:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773500.223897:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773500.223907:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9471 00000100:00080000:3.0:1775773500.223927:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773500.223934:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773500.223979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612410624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773500.224007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773500.224010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773500.224012:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773500.224015:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9471 00000100:00080000:3.0:1775773500.224018:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773500.224020:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773500.224030:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773500.224043:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612410752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773500.224052:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773500.224055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773500.224056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773500.224060:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9471 00000100:00080000:3.0:1775773500.224063:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773500.224066:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773500.224069:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773500.224077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612410880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773500.224085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773500.224090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773500.224093:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773500.224095:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612410624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773500.224098:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9471 00000100:00080000:3.0:1775773500.224107:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773500.224113:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773500.224116:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773500.224125:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612411008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773500.224130:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773500.224133:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773500.224135:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773500.224138:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9471 00000100:00080000:3.0:1775773500.224140:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773500.224143:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773500.224145:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773500.224153:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612411136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773500.224189:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773500.224231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773500/real 1775773500] req@ffff8de1c7af6a00 x1862023612410624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773500.224246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612410624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773500.224254:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773500.224258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773500.224262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612410624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773500.224274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773500.224318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773500.224332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773500/real 1775773500] req@ffff8de1c7af6680 x1862023612410752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773500.224346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612410752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773500.224354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773500.224358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773500.224361:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773500.224384:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773500.224406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773500.224414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773500/real 1775773500] req@ffff8de1c7af4700 x1862023612410880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773500.224424:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612410880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773500.224432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773500.224436:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773500.224439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612410880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773500.224445:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773500.224467:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773500.224479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773500/real 1775773500] req@ffff8de1c7af6300 x1862023612411008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773500.224491:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612411008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773500.224499:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773500.224502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773500.224506:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773500.224513:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773500.224535:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773500.224547:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773500/real 1775773500] req@ffff8de1c7af5c00 x1862023612411136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773500.224561:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612411136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773500.224570:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773500.224573:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773500.224577:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773501.183898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773502.207944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773503.231857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773504.255912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773505.279882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773505.343949:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773505.343957:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773505.343962:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773505.343973:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9477 00000100:00080000:3.0:1775773505.343984:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773505.343990:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773505.344019:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612411264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773505.344041:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773505.344044:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773505.344046:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773505.344050:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9477 00000100:00080000:3.0:1775773505.344053:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773505.344055:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773505.344064:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773505.344075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612411392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773505.344084:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775773505.344089:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612411264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773505.344089:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773505.344090:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773505.344100:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9477 00000100:00080000:3.0:1775773505.344103:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773505.344105:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773505.344110:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773505.344119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612411520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773505.344126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773505.344128:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773505.344130:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773505.344132:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9477 00000100:00080000:3.0:1775773505.344135:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773505.344137:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773505.344140:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773505.344146:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612411648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773505.344151:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773505.344155:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773505.344158:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773505.344159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773505.344164:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9477 00000100:00080000:3.0:1775773505.344167:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773505.344169:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773505.344173:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773505.344180:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612411776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773505.344197:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773505/real 1775773505] req@ffff8de1c7af5500 x1862023612411264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773505.344212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612411264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773505.344221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773505.344224:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773505.344227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612411264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773505.344249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773505.344280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773505.344292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773505/real 1775773505] req@ffff8de1c7af7480 x1862023612411392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773505.344304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612411392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773505.344311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773505.344316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773505.344319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773505.344325:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773505.344354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773505.344370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773505/real 1775773505] req@ffff8de1c7af4000 x1862023612411520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773505.344385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612411520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773505.344393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773505.344397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773505.344400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773505.344406:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773505.344427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773505.344439:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773505/real 1775773505] req@ffff8de1c7af4380 x1862023612411648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773505.344452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612411648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773505.344460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773505.344463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773505.344465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773505.344470:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773505.344487:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773505.344498:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773505/real 1775773505] req@ffff8de1c7af4e00 x1862023612411776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773505.344508:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612411776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773505.344514:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773505.344516:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773505.344519:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612411776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773506.303887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773507.327923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773508.351909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773509.375999:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773510.399983:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773510.463868:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773510.463882:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773510.463889:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773510.463902:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9482 00000100:00080000:3.0:1775773510.463917:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773510.463927:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773510.463978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612411904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773510.464020:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773510.464025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773510.464029:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773510.464035:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9482 00000100:00080000:3.0:1775773510.464042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773510.464048:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773510.464062:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773510.464102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612411904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773510.464102:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612412032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773510.464121:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773510.464126:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773510.464129:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773510.464135:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9482 00000100:00080000:3.0:1775773510.464142:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773510.464164:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773510.464171:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773510.464185:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612412160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773510.464198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773510.464199:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773510.464204:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773510.464206:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773510.464212:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9482 00000100:00080000:3.0:1775773510.464217:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773510.464222:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773510.464229:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773510.464243:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773510/real 1775773510] req@ffff8de1c7af7b80 x1862023612411904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773510.464243:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612412288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773510.464259:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773510.464264:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773510.464267:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773510.464272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612411904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773510.464272:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9482 00000100:00080000:3.0:1775773510.464278:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773510.464283:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775773510.464289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:3.0:1775773510.464290:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773510.464296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773510.464303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612411904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773510.464303:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612412416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773510.464337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773510.464375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773510.464397:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773510/real 1775773510] req@ffff8de1c7af6d80 x1862023612412032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773510.464413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612412032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773510.464422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773510.464425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773510.464429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773510.464436:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773510.464497:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773510.464509:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773510/real 1775773510] req@ffff8de1c7af4a80 x1862023612412160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773510.464528:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612412160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773510.464535:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773510.464539:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773510.464542:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773510.464547:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773510.464563:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773510.464571:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773510/real 1775773510] req@ffff8de1c7af5f80 x1862023612412288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773510.464582:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612412288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773510.464589:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773510.464592:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773510.464595:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773510.464600:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773510.464613:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773510.464621:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773510/real 1775773510] req@ffff8de1c7af5880 x1862023612412416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773510.464631:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612412416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773510.464644:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773510.464648:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773510.464651:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773511.423876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773512.447882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773513.471861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773514.495908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773515.519964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773515.583786:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773515.583796:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773515.583801:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773515.583811:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9487 00000100:00080000:3.0:1775773515.583823:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773515.583829:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773515.583879:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612412544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773515.583903:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773515.583906:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773515.583907:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773515.583911:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9487 00000100:00080000:3.0:1775773515.583914:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773515.583916:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773515.583926:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773515.583937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612412672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773515.583946:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773515.583948:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773515.583950:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773515.583955:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612412544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773515.583956:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9487 00000100:00080000:3.0:1775773515.583961:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773515.583965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773515.583969:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773515.583976:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612412800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773515.583983:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773515.583985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773515.583987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773515.583990:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9487 00000100:00080000:3.0:1775773515.583992:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773515.583994:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773515.583997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773515.584005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612412928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773515.584010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773515.584012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773515.584013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773515.584015:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9487 00000100:00080000:3.0:1775773515.584019:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773515.584021:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773515.584024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773515.584031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612413056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773515.584037:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773515.584084:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773515/real 1775773515] req@ffff8de1c7af7800 x1862023612412544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773515.584117:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612412544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773515.584126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773515.584130:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773515.584133:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612412544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773515.584156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773515.584175:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773515.584184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773515/real 1775773515] req@ffff8de1c7af7100 x1862023612412672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773515.584193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612412672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773515.584198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773515.584201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773515.584203:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773515.584207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773515.584218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773515.584224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773515/real 1775773515] req@ffff8de1c7af5180 x1862023612412800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773515.584231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612412800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773515.584236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773515.584238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773515.584239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773515.584243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773515.584253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773515.584258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773515/real 1775773515] req@ffff8de1c7af5880 x1862023612412928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773515.584265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612412928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773515.584270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773515.584271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773515.584273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612412928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773515.584276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773515.584287:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773515.584292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773515/real 1775773515] req@ffff8de1c7af5f80 x1862023612413056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773515.584300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612413056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773515.584305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773515.584306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773515.584308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773516.543912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773517.567912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773518.591888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773519.615915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773520.639872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773520.703884:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773520.703892:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773520.703897:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773520.703908:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9492 00000100:00080000:0.0:1775773520.703919:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773520.703926:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773520.703960:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612413184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773520.703987:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773520.703991:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773520.703993:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773520.703997:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9492 00000100:00080000:0.0:1775773520.704001:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773520.704005:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773520.704015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773520.704025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612413184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773520.704030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612413312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773520.704041:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773520.704044:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773520.704046:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773520.704049:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9492 00000100:00080000:0.0:1775773520.704054:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773520.704057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773520.704062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773520.704071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612413440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773520.704081:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:3.0:1775773520.704083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773520.704087:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773520.704089:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773520.704094:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9492 00000100:00080000:0.0:1775773520.704099:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773520.704103:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773520.704108:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773520.704121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773520/real 1775773520] req@ffff8de1c5683480 x1862023612413184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773520.704131:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612413568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773520.704137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612413184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773520.704147:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773520.704151:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773520.704152:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773520.704157:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773520.704159:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773520.704167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612413184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773520.704168:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9492 00000100:00080000:0.0:1775773520.704176:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773520.704181:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773520.704185:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773520.704196:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612413696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773520.704201:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773520.704235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773520.704250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773520/real 1775773520] req@ffff8de1c5681500 x1862023612413312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773520.704280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612413312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773520.704287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773520.704289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773520.704291:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773520.704296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773520.704342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773520.704355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773520/real 1775773520] req@ffff8de1c5681880 x1862023612413440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773520.704369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612413440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773520.704377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773520.704379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773520.704382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773520.704386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773520.704403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773520.704410:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773520/real 1775773520] req@ffff8de1c5680e00 x1862023612413568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773520.704418:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612413568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773520.704423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773520.704425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773520.704427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773520.704438:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773520.704449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773520.704454:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773520/real 1775773520] req@ffff8de1c5683800 x1862023612413696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773520.704466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612413696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773520.704470:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773520.704482:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773520.704484:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773521.663885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773522.687873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773523.711905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773524.735895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773525.759994:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773525.823860:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773525.823871:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773525.823877:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773525.823888:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9497 00000100:00080000:0.0:1775773525.823902:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773525.823913:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773525.823982:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612413824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773525.824025:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773525.824029:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773525.824031:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773525.824036:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9497 00000100:00080000:0.0:1775773525.824041:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773525.824045:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773525.824057:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773525.824073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612413952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773525.824086:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773525.824093:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773525.824095:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775773525.824095:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612413824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773525.824104:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9497 00000100:00080000:0.0:1775773525.824111:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773525.824115:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773525.824120:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773525.824132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612414080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773525.824141:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773525.824145:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773525.824147:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773525.824151:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9497 00000100:00080000:0.0:1775773525.824154:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773525.824157:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773525.824162:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773525.824191:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612414208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773525.824219:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773525.824223:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773525.824226:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773525.824238:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9497 00000800:00000100:3.0:1775773525.824240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773525.824245:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773525.824252:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773525.824260:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773525.824288:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612414336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773525.824345:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773525/real 1775773525] req@ffff8de1c5683800 x1862023612413824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773525.824370:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612413824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773525.824398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773525.824402:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773525.824406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612413824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773525.824431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773525.824480:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773525.824495:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773525/real 1775773525] req@ffff8de1c5680e00 x1862023612413952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773525.824533:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612413952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773525.824542:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773525.824545:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773525.824549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612413952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773525.824555:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773525.824574:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773525.824583:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773525/real 1775773525] req@ffff8de1c5681880 x1862023612414080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773525.824595:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612414080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773525.824603:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773525.824606:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773525.824609:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773525.824614:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773525.824630:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773525.824643:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773525/real 1775773525] req@ffff8de1c5681500 x1862023612414208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773525.824663:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612414208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773525.824687:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773525.824693:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773525.824698:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773525.824728:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773525.824771:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773525.824791:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773525/real 1775773525] req@ffff8de1c5683480 x1862023612414336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773525.824807:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612414336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773525.824817:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773525.824820:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773525.824891:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773526.783987:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773527.808038:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773528.831924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773529.855897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773530.879926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773530.943874:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773530.943881:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773530.943885:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773530.943893:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9502 00000100:00080000:0.0:1775773530.943903:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773530.943908:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773530.943940:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612414464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773530.943965:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773530.943968:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773530.943969:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773530.943972:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9502 00000100:00080000:0.0:1775773530.943974:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773530.943976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773530.943986:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773530.943995:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612414592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773530.944003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773530.944005:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773530.944007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773530.944009:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9502 00000100:00080000:0.0:1775773530.944011:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773530.944016:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773530.944018:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612414464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775773530.944019:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773530.944030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612414720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773530.944037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773530.944039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773530.944040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773530.944043:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9502 00000100:00080000:0.0:1775773530.944045:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773530.944047:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773530.944050:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773530.944057:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612414848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773530.944063:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773530.944065:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773530.944067:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773530.944069:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9502 00000100:00080000:0.0:1775773530.944072:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773530.944074:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773530.944078:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773530.944096:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612414976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773530.944104:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773530.944147:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773530/real 1775773530] req@ffff8de1c5680000 x1862023612414464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773530.944171:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612414464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773530.944178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773530.944182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773530.944185:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612414464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773530.944191:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773530.944210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773530.944219:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773530/real 1775773530] req@ffff8de1c5680380 x1862023612414592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773530.944227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612414592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773530.944232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773530.944234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773530.944237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773530.944254:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773530.944265:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773530.944271:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773530/real 1775773530] req@ffff8de1c5682a00 x1862023612414720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773530.944278:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612414720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773530.944284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773530.944286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773530.944288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773530.944291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773530.944302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773530.944307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773530/real 1775773530] req@ffff8de1c5681f80 x1862023612414848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773530.944314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612414848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773530.944321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773530.944324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773530.944327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773530.944333:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773530.944351:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773530.944361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773530/real 1775773530] req@ffff8de1c5681c00 x1862023612414976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773530.944374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612414976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773530.944383:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773530.944386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773530.944389:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612414976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773531.903925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773532.927908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773533.951930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773534.975930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773535.999881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773536.063839:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773536.063846:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773536.063850:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773536.063858:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9507 00000100:00080000:0.0:1775773536.063867:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773536.063873:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773536.063905:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612415104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773536.063930:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773536.063934:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773536.063936:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773536.063940:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9507 00000100:00080000:0.0:1775773536.063944:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773536.063948:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773536.063958:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773536.063975:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612415104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773536.063977:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612415232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773536.064013:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773536.064017:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773536.064019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773536.064024:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9507 00000100:00080000:0.0:1775773536.064029:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773536.064033:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773536.064038:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773536.064053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612415360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773536.064077:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773536.064082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773536.064084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773536.064090:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9507 00000100:00080000:0.0:1775773536.064096:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773536.064102:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773536.064107:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415232:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775773536.064112:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773536.064157:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612415488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773536.064160:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415360:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775773536.064177:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773536.064180:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773536.064181:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773536.064186:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9507 00000100:00080000:0.0:1775773536.064191:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773536.064194:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773536.064199:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773536.064205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773536.064212:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612415616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773536.064238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773537.023933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773538.047843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773539.071953:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773539.136105:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775773539.136154:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773539.136184:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773539.136228:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773539.136241:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773539.136255:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773539.136276:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775773539.136411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773536/real 1775773539] req@ffff8de1c5682300 x1862023612415616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773539.136457:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612415616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773539.136470:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773539.136475:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773539.136480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415616:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773539.136489:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773536/real 1775773539] req@ffff8de1c5680700 x1862023612415488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773539.136502:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612415488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773539.136510:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773539.136513:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773539.136517:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773539.136524:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773536/real 1775773539] req@ffff8de1c5682d80 x1862023612415232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773539.136542:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612415232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773539.136548:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773539.136552:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773539.136555:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773539.136562:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773536/real 1775773539] req@ffff8de1c5682680 x1862023612415360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773539.136574:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612415360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773539.136580:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773539.136584:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773539.136587:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773539.136594:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773536/real 1775773539] req@ffff8de1c5683b80 x1862023612415104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773539.136607:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612415104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773539.136614:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773539.136618:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773539.136621:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612415104:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775773540.095812:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773541.119851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773541.183842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773541.183853:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773541.183857:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773541.183869:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9512 00000100:00080000:0.0:1775773541.183881:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773541.183888:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773541.183945:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612415744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773541.183980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773541.183986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773541.183988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773541.183993:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9512 00000100:00080000:0.0:1775773541.183998:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773541.184002:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773541.184013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773541.184027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612415872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773541.184039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773541.184042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773541.184044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773541.184049:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9512 00000100:00080000:0.0:1775773541.184052:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773541.184056:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773541.184060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773541.184074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612416000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773541.184084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773541.184087:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773541.184089:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773541.184094:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9512 00000100:00080000:0.0:1775773541.184098:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773541.184103:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773541.184109:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773541.184120:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612416128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773541.184130:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773541.184134:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773541.184136:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773541.184141:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9512 00000100:00080000:0.0:1775773541.184147:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775773541.184152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612415744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773541.184155:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773541.184165:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773541.184179:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612416256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775773541.184234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773541.184275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773541/real 1775773541] req@ffff8de1c5683b80 x1862023612415744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773541.184298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612415744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773541.184311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773541.184316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773541.184320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612415744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773541.184326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773541.184351:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773541.184366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773541/real 1775773541] req@ffff8de1c5682680 x1862023612415872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773541.184380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612415872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773541.184389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773541.184393:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773541.184397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612415872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773541.184404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773541.184427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773541.184439:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773541/real 1775773541] req@ffff8de1c5682d80 x1862023612416000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773541.184454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612416000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773541.184463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773541.184467:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773541.184470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773541.184477:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773541.184509:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773541.184521:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773541/real 1775773541] req@ffff8de1c5680700 x1862023612416128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773541.184533:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612416128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773541.184553:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773541.184557:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773541.184560:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773541.184590:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773541.184613:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773541.184625:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773541/real 1775773541] req@ffff8de1c5682300 x1862023612416256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773541.184638:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612416256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773541.184648:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773541.184651:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773541.184653:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773542.143827:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773543.167883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773544.191909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773545.215899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773546.240032:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773546.303787:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773546.303796:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773546.303800:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773546.303808:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9518 00000100:00080000:0.0:1775773546.303829:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773546.303851:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773546.303890:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612416384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773546.303912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773546.303914:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773546.303915:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773546.303918:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9518 00000100:00080000:0.0:1775773546.303921:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773546.303924:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773546.303932:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773546.303940:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612416512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773546.303961:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773546.303965:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775773546.303965:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612416384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773546.303968:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773546.303976:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9518 00000100:00080000:0.0:1775773546.303978:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773546.303981:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773546.303985:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773546.303994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612416640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773546.304000:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773546.304003:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773546.304004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773546.304006:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9518 00000100:00080000:0.0:1775773546.304009:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773546.304011:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773546.304014:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773546.304022:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612416768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775773546.304029:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773546.304032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773546.304035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773546.304036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773546.304039:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9518 00000100:00080000:0.0:1775773546.304043:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773546.304046:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773546.304049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773546.304055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612416896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773546.304076:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773546/real 1775773546] req@ffff8de1c5681c00 x1862023612416384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773546.304097:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612416384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773546.304108:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773546.304113:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773546.304117:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612416384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773546.304139:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773546.304166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773546.304175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773546/real 1775773546] req@ffff8de1c5681f80 x1862023612416512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773546.304183:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612416512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773546.304189:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773546.304191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773546.304193:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773546.304197:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773546.304208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773546.304213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773546/real 1775773546] req@ffff8de1c5682a00 x1862023612416640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773546.304220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612416640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773546.304225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773546.304226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773546.304228:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773546.304232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773546.304241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773546.304246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773546/real 1775773546] req@ffff8de1c5680380 x1862023612416768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773546.304254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612416768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773546.304258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773546.304260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773546.304262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773546.304265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773546.304274:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773546.304278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773546/real 1775773546] req@ffff8de1c5680000 x1862023612416896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773546.304285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612416896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773546.304290:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773546.304292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773546.304293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612416896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773547.263984:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773548.287929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773549.311940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773550.335928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773551.359989:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773551.423905:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773551.423915:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773551.423920:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773551.423932:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9523 00000100:00080000:2.0:1775773551.423946:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773551.423954:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773551.423999:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612417024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773551.424026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773551.424029:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773551.424031:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773551.424035:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9523 00000100:00080000:2.0:1775773551.424038:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773551.424041:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773551.424051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773551.424061:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612417152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773551.424070:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612417024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773551.424072:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773551.424079:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773551.424082:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773551.424085:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9523 00000100:00080000:2.0:1775773551.424088:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773551.424093:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773551.424098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773551.424113:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612417280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773551.424124:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773551.424129:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773551.424131:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773551.424136:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9523 00000100:00080000:2.0:1775773551.424141:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773551.424146:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773551.424152:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773551.424167:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612417408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773551.424177:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773551.424188:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773551.424192:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773551.424195:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773551.424204:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9523 00000100:00080000:2.0:1775773551.424212:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773551.424216:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773551.424221:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773551.424242:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612417536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773551.424253:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773551/real 1775773551] req@ffff8de1d0f2df80 x1862023612417024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773551.424285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612417024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773551.424299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773551.424307:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773551.424313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612417024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773551.424349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773551.424372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773551.424396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773551/real 1775773551] req@ffff8de1d0f2c700 x1862023612417152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773551.424405:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612417152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773551.424416:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773551.424419:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773551.424424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773551.424429:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773551.424442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773551.424448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773551/real 1775773551] req@ffff8de1d0f2ca80 x1862023612417280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773551.424455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612417280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773551.424460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773551.424462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773551.424463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773551.424467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773551.424491:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773551.424498:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773551/real 1775773551] req@ffff8de1d0f2d500 x1862023612417408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773551.424506:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612417408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773551.424511:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773551.424513:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773551.424516:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773551.424519:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773551.424531:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773551.424535:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773551/real 1775773551] req@ffff8de1d0f2e680 x1862023612417536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773551.424543:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612417536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773551.424552:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773551.424555:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773551.424559:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773552.383931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773553.407940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773554.431835:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773555.455881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773556.479904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773556.543823:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773556.543833:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773556.543837:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773556.543847:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9528 00000100:00080000:2.0:1775773556.543858:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773556.543904:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773556.543939:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612417664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773556.543971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773556.543978:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773556.543980:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773556.543983:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9528 00000100:00080000:2.0:1775773556.543986:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773556.543989:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773556.543997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773556.544006:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612417792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773556.544015:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612417664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773556.544015:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773556.544024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773556.544026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773556.544029:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9528 00000100:00080000:2.0:1775773556.544032:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773556.544034:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773556.544037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773556.544046:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612417920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773556.544052:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773556.544055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773556.544056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773556.544058:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9528 00000100:00080000:2.0:1775773556.544060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773556.544063:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773556.544067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773556.544075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612418048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773556.544079:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773556.544087:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773556.544090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773556.544091:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773556.544095:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9528 00000100:00080000:2.0:1775773556.544099:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773556.544102:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773556.544107:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773556.544119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612418176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773556.544123:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773556/real 1775773556] req@ffff8de1d0f2e300 x1862023612417664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773556.544152:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612417664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773556.544160:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773556.544164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773556.544168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612417664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773556.544186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773556.544204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773556.544212:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773556/real 1775773556] req@ffff8de1d0f2f100 x1862023612417792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773556.544224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612417792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773556.544246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773556.544250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773556.544253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773556.544260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773556.544282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773556.544292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773556/real 1775773556] req@ffff8de1d0f2e680 x1862023612417920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773556.544300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612417920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773556.544305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773556.544307:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773556.544309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612417920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773556.544313:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773556.544335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773556.544344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773556/real 1775773556] req@ffff8de1d0f2d500 x1862023612418048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773556.544356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612418048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773556.544362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773556.544364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773556.544366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773556.544369:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773556.544379:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773556.544384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773556/real 1775773556] req@ffff8de1d0f2ca80 x1862023612418176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773556.544391:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612418176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773556.544398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773556.544401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773556.544404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773557.503874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773558.527908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773559.551871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773560.575925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773561.599854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773561.663851:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773561.663858:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773561.663863:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773561.663870:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9533 00000100:00080000:3.0:1775773561.663880:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773561.663885:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773561.663916:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612418304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773561.663936:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773561.663939:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773561.663940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773561.663943:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9533 00000100:00080000:3.0:1775773561.663945:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773561.663947:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773561.663955:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773561.663963:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612418432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773561.663975:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773561.663978:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773561.663980:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773561.663984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612418304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773561.663984:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9533 00000100:00080000:3.0:1775773561.663989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773561.663993:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773561.663996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773561.664003:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612418560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773561.664009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773561.664011:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773561.664013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773561.664015:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9533 00000100:00080000:3.0:1775773561.664018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773561.664020:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773561.664023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773561.664029:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612418688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773561.664034:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773561.664036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773561.664038:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773561.664040:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9533 00000100:00080000:3.0:1775773561.664043:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773561.664046:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773561.664050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773561.664051:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773561.664060:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612418816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773561.664093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773561/real 1775773561] req@ffff8de1c7af4a80 x1862023612418304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773561.664112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612418304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773561.664120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773561.664123:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773561.664126:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612418304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773561.664153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773561.664172:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773561.664181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773561/real 1775773561] req@ffff8de1c7af6d80 x1862023612418432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773561.664188:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612418432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773561.664194:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773561.664196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773561.664198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773561.664202:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773561.664212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773561.664224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773561/real 1775773561] req@ffff8de1c7af7b80 x1862023612418560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773561.664232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612418560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773561.664242:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773561.664244:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773561.664246:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773561.664250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773561.664260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773561.664266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773561/real 1775773561] req@ffff8de1c7af4e00 x1862023612418688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773561.664272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612418688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773561.664277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773561.664279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773561.664281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773561.664284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773561.664294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773561.664299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773561/real 1775773561] req@ffff8de1c7af4380 x1862023612418816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773561.664306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612418816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773561.664310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773561.664312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773561.664314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612418816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773562.623926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773563.647941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773564.671923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773565.695908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773566.719897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773566.783824:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773566.783833:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773566.783837:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773566.783846:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9538 00000100:00080000:3.0:1775773566.783856:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773566.783862:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773566.783895:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612418944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773566.783919:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773566.783922:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773566.783923:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773566.783926:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9538 00000100:00080000:3.0:1775773566.783928:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773566.783931:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773566.783939:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773566.783949:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612419072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773566.783958:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773566.783960:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773566.783962:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773566.783964:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9538 00000100:00100000:0.0:1775773566.783969:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612418944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773566.783969:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773566.783974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773566.783979:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773566.783986:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612419200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773566.783992:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773566.783995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773566.783997:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773566.783999:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9538 00000100:00080000:3.0:1775773566.784002:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773566.784005:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773566.784008:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773566.784014:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612419328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773566.784019:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773566.784021:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773566.784023:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773566.784027:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773566.784031:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9538 00000100:00080000:3.0:1775773566.784034:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773566.784037:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773566.784040:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773566.784048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612419456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773566.784064:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773566/real 1775773566] req@ffff8de1c7af4000 x1862023612418944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773566.784083:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612418944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773566.784091:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773566.784094:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773566.784098:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612418944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773566.784103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773566.784118:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773566.784125:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773566/real 1775773566] req@ffff8de1c7af7480 x1862023612419072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773566.784133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612419072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773566.784138:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773566.784139:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773566.784141:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773566.784160:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773566.784170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773566.784176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773566/real 1775773566] req@ffff8de1c7af5500 x1862023612419200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773566.784183:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612419200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773566.784187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773566.784189:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773566.784191:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773566.784194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773566.784204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773566.784209:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773566/real 1775773566] req@ffff8de1c7af5c00 x1862023612419328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773566.784215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612419328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773566.784220:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773566.784222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773566.784224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773566.784227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773566.784236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773566.784241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773566/real 1775773566] req@ffff8de1c7af6300 x1862023612419456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773566.784253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612419456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773566.784257:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773566.784259:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773566.784261:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773567.743983:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773568.767915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773569.791882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773570.815907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773571.839958:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773571.903848:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773571.903861:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773571.903867:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773571.903878:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9543 00000100:00080000:1.0:1775773571.903890:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773571.903898:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773571.903940:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612419584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773571.903967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773571.903970:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773571.903971:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773571.903975:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9543 00000100:00080000:1.0:1775773571.903978:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773571.903981:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773571.903991:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773571.904003:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612419712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773571.904011:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773571.904014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773571.904016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773571.904018:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9543 00000100:00080000:1.0:1775773571.904021:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773571.904024:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773571.904029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612419584:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775773571.904030:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773571.904040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612419840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773571.904047:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773571.904050:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773571.904051:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773571.904054:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9543 00000100:00080000:1.0:1775773571.904056:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773571.904058:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773571.904062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773571.904070:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612419968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773571.904081:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773571.904084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773571.904086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773571.904089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9543 00000100:00080000:1.0:1775773571.904103:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773571.904107:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773571.904113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773571.904115:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773571.904130:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612420096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773571.904176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773571/real 1775773571] req@ffff8de1c2e16a00 x1862023612419584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773571.904193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612419584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773571.904202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773571.904205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773571.904208:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612419584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773571.904214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773571.904234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773571.904246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773571/real 1775773571] req@ffff8de1c2e14380 x1862023612419712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773571.904266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612419712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773571.904275:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773571.904279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773571.904283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773571.904316:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773571.904340:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773571.904378:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773571/real 1775773571] req@ffff8de1c2e16680 x1862023612419840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773571.904393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612419840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773571.904402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773571.904405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773571.904409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773571.904426:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773571.904448:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773571.904460:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773571/real 1775773571] req@ffff8de1c2e17b80 x1862023612419968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773571.904473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612419968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773571.904489:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773571.904493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773571.904496:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612419968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773571.904503:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773571.904524:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773571.904535:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773571/real 1775773571] req@ffff8de1c2e17100 x1862023612420096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773571.904547:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612420096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773571.904556:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773571.904559:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773571.904563:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773572.863880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773573.887975:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773574.911941:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773575.935892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773576.959888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773577.023881:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773577.023890:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773577.023895:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773577.023905:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9548 00000100:00080000:1.0:1775773577.023928:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773577.023936:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773577.023981:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612420224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773577.024020:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773577.024026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773577.024028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773577.024045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9548 00000100:00080000:1.0:1775773577.024051:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773577.024057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773577.024071:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773577.024080:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612420224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773577.024097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612420352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773577.024116:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773577.024121:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773577.024124:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773577.024132:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9548 00000100:00080000:1.0:1775773577.024139:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773577.024144:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775773577.024151:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775773577.024155:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773577.024172:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612420480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773577.024183:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773577.024187:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773577.024190:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775773577.024195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773577/real 1775773577] req@ffff8de1c2e17800 x1862023612420224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773577.024197:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9548 00000100:00080000:1.0:1775773577.024205:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773577.024220:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773577.024227:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773577.024236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612420224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773577.024241:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612420608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773577.024302:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773577.024307:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773577.024307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773577.024325:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773577.024330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:1.0:1775773577.024334:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9548 00000100:00080000:1.0:1775773577.024339:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775773577.024340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612420224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773577.024345:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773577.024350:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773577.024360:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612420736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773577.024398:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773577.024426:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773577.024438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773577/real 1775773577] req@ffff8de1c2e15500 x1862023612420352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773577.024450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612420352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773577.024458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773577.024470:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773577.024473:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773577.024479:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773577.024498:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773577.024507:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773577/real 1775773577] req@ffff8de1c2e14700 x1862023612420480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773577.024518:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612420480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773577.024526:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773577.024529:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773577.024532:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773577.024537:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773577.024551:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773577.024560:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773577/real 1775773577] req@ffff8de1c2e17480 x1862023612420608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773577.024571:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612420608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773577.024578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773577.024581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773577.024585:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773577.024592:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773577.024619:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773577.024633:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773577/real 1775773577] req@ffff8de1c2e14a80 x1862023612420736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773577.024648:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612420736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773577.024657:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773577.024661:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773577.024664:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773577.983910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773579.007932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773580.031911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773581.055895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773582.079935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773582.143856:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773582.143865:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773582.143870:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773582.143880:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9553 00000100:00080000:3.0:1775773582.143891:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773582.143898:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773582.143936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612420864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773582.143967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773582.143971:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773582.143973:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773582.143977:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9553 00000100:00080000:3.0:1775773582.143981:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773582.143985:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773582.143996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773582.144010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612420992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773582.144023:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773582.144027:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773582.144029:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775773582.144034:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612420864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773582.144036:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9553 00000100:00080000:3.0:1775773582.144042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773582.144047:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773582.144052:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773582.144066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612421120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773582.144077:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773582.144081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773582.144082:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773582.144086:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9553 00000100:00080000:3.0:1775773582.144091:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773582.144095:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773582.144100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775773582.144107:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773582.144116:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612421248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773582.144126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773582.144130:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773582.144132:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773582.144137:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9553 00000100:00080000:3.0:1775773582.144141:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775773582.144146:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773582/real 1775773582] req@ffff8de1c7af4700 x1862023612420864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773582.144148:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773582.144155:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773582.144169:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612421376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773582.144219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612420864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773582.144233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773582.144238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773582.144243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612420864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773582.144271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773582.144300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773582.144314:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773582/real 1775773582] req@ffff8de1c7af6680 x1862023612420992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773582.144328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612420992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773582.144338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773582.144342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773582.144346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612420992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773582.144353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773582.144379:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773582.144393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773582/real 1775773582] req@ffff8de1c7af6a00 x1862023612421120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773582.144407:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612421120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773582.144423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773582.144427:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773582.144431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773582.144438:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773582.144463:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773582.144476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773582/real 1775773582] req@ffff8de1c7af6300 x1862023612421248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773582.144489:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612421248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773582.144496:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773582.144499:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773582.144503:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773582.144509:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773582.144528:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773582.144538:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773582/real 1775773582] req@ffff8de1c7af5c00 x1862023612421376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773582.144550:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612421376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773582.144558:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773582.144561:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773582.144565:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773583.103962:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773584.127910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773585.151915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773586.175902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773587.199892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773587.263962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773587.263980:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773587.263988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773587.264004:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9559 00000100:00080000:0.0:1775773587.264022:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773587.264034:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773587.264110:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612421504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773587.264164:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773587.264169:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773587.264172:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773587.264178:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9559 00000100:00080000:0.0:1775773587.264183:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773587.264190:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773587.264206:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773587.264226:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612421632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773587.264238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612421504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773587.264262:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773587.264267:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773587.264270:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773587.264279:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9559 00000100:00080000:0.0:1775773587.264286:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773587.264291:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773587.264300:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773587.264319:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612421760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775773587.264327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773587.264344:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773587.264351:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773587.264365:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773587.264374:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9559 00000100:00080000:0.0:1775773587.264381:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773587.264389:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773587.264401:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773587/real 1775773587] req@ffff8de1c5683480 x1862023612421504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775773587.264407:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773587.264446:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612421888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773587.264450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612421504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773587.264497:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773587.264500:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773587.264509:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773587.264512:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773587.264519:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9559 00000100:00080000:0.0:1775773587.264528:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773587.264532:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:0.0:1775773587.264549:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773587.264550:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612421504:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775773587.264574:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773587.264597:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612422016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773587.264601:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773587.264658:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773587.264677:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773587/real 1775773587] req@ffff8de1c5681500 x1862023612421632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773587.264691:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612421632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773587.264700:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773587.264704:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773587.264707:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773587.264713:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773587.264775:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773587.264787:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773587/real 1775773587] req@ffff8de1c5681880 x1862023612421760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773587.264799:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612421760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773587.264807:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773587.264810:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773587.264814:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773587.264822:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773587.264852:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773587.264869:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773587/real 1775773587] req@ffff8de1c5680e00 x1862023612421888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773587.264888:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612421888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773587.264901:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773587.264906:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773587.264909:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612421888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773587.264939:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773587.264963:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773587.264974:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773587/real 1775773587] req@ffff8de1c5683800 x1862023612422016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773587.264993:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612422016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773587.265001:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773587.265004:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773587.265007:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773588.223900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773589.247911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773590.271904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773591.295913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773592.319955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773592.383909:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773592.383924:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773592.383931:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773592.383941:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9564 00000100:00080000:3.0:1775773592.383955:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773592.383962:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773592.384022:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612422144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773592.384048:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773592.384052:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773592.384053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773592.384057:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9564 00000100:00080000:3.0:1775773592.384060:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773592.384064:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773592.384075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773592.384088:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612422272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773592.384096:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773592.384099:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773592.384101:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773592.384105:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9564 00000100:00080000:3.0:1775773592.384108:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773592.384119:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773592.384124:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773592.384137:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612422400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773592.384147:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612422144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773592.384155:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773592.384160:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773592.384162:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773592.384168:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9564 00000100:00080000:3.0:1775773592.384172:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773592.384176:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773592.384181:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773592.384192:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612422528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773592.384198:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773592.384202:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773592.384203:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773592.384206:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9564 00000100:00080000:3.0:1775773592.384209:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773592.384211:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773592.384214:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773592.384221:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612422656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775773592.384244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773592.384286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773592/real 1775773592] req@ffff8de1c7af5500 x1862023612422144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773592.384306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612422144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773592.384317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773592.384322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773592.384326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612422144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773592.384335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773592.384359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773592.384370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773592/real 1775773592] req@ffff8de1c7af7480 x1862023612422272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773592.384389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612422272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773592.384397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773592.384400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773592.384404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773592.384430:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773592.384452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773592.384464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773592/real 1775773592] req@ffff8de1c7af4000 x1862023612422400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773592.384476:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612422400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773592.384484:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773592.384488:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773592.384491:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773592.384498:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773592.384516:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773592.384526:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773592/real 1775773592] req@ffff8de1c7af4380 x1862023612422528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773592.384537:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612422528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773592.384551:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773592.384554:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773592.384558:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773592.384564:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773592.384582:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773592.384591:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773592/real 1775773592] req@ffff8de1c7af4e00 x1862023612422656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773592.384603:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612422656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773592.384611:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773592.384614:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773592.384617:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773593.343908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773594.367894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773595.391923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773596.415840:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773597.439951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773597.503880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773597.503892:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773597.503898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773597.503910:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9569 00000100:00080000:2.0:1775773597.503962:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773597.503970:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773597.504008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612422784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773597.504043:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773597.504046:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773597.504048:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773597.504052:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9569 00000100:00080000:2.0:1775773597.504055:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773597.504058:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773597.504067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773597.504076:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612422912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773597.504085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773597.504088:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773597.504089:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773597.504093:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9569 00000100:00080000:2.0:1775773597.504095:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773597.504097:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773597.504100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773597.504109:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612423040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773597.504118:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773597.504120:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773597.504122:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773597.504128:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9569 00000100:00100000:0.0:1775773597.504129:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612422784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773597.504131:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773597.504139:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773597.504146:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773597.504174:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612423168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773597.504183:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773597.504186:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773597.504187:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773597.504190:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9569 00000100:00080000:2.0:1775773597.504194:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773597.504196:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773597.504200:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773597.504208:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612423296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773597.504223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773597.504278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773597/real 1775773597] req@ffff8de1d0f2c700 x1862023612422784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773597.504300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612422784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773597.504324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773597.504329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773597.504333:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612422784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773597.504342:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773597.504380:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773597.504396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773597/real 1775773597] req@ffff8de1d0f2df80 x1862023612422912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773597.504411:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612422912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773597.504420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773597.504424:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773597.504429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612422912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773597.504457:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773597.504482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773597.504496:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773597/real 1775773597] req@ffff8de1d0f2ca80 x1862023612423040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773597.504511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612423040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773597.504521:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773597.504525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773597.504529:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773597.504537:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773597.504558:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773597.504570:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773597/real 1775773597] req@ffff8de1d0f2d500 x1862023612423168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773597.504593:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612423168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773597.504602:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773597.504606:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773597.504610:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773597.504617:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773597.504640:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773597.504652:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773597/real 1775773597] req@ffff8de1d0f2e680 x1862023612423296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773597.504667:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612423296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773597.504678:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773597.504682:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773597.504686:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773598.463840:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773599.487988:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773600.511963:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773601.535951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773602.559943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773602.623858:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773602.623867:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773602.623871:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773602.623881:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9574 00000100:00080000:3.0:1775773602.623893:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773602.623900:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773602.623939:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612423424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773602.623965:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773602.623969:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773602.623970:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773602.623974:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9574 00000100:00080000:3.0:1775773602.623978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773602.623981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773602.623991:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773602.624004:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612423552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773602.624014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773602.624017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773602.624018:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773602.624022:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9574 00000100:00080000:3.0:1775773602.624024:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773602.624028:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773602.624034:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612423424:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773602.624034:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773602.624051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612423680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773602.624060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773602.624063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773602.624064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773602.624068:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9574 00000100:00080000:3.0:1775773602.624072:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773602.624075:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773602.624087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773602.624098:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612423808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773602.624112:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773602.624115:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773602.624116:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773602.624119:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9574 00000100:00080000:3.0:1775773602.624123:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773602.624126:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773602.624131:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773602.624142:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612423936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773602.624151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773602.624208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773602.624242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773602.624275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773603.583915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773604.607829:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773605.631849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775773605.696129:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775773605.696179:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775773605.696207:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775773605.696257:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775773605.696269:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775773605.696283:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775773605.696294:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775773605.696388:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773602/real 1775773605] req@ffff8de1c7af4a80 x1862023612423680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773605.696417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612423680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773605.696431:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773605.696438:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773605.696443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773605.696452:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773602/real 1775773605] req@ffff8de1c7af5f80 x1862023612423808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773605.696475:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612423808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773605.696483:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773605.696489:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773605.696492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773605.696499:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773602/real 1775773605] req@ffff8de1c7af5880 x1862023612423936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773605.696512:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612423936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773605.696520:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773605.696526:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773605.696530:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423936:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773605.696538:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773602/real 1775773605] req@ffff8de1c7af7b80 x1862023612423424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773605.696554:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612423424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773605.696562:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773605.696565:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773605.696568:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612423424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773605.696575:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773602/real 1775773605] req@ffff8de1c7af6d80 x1862023612423552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773605.696585:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612423552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773605.696591:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773605.696595:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773605.696597:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612423552:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775773606.655853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773607.679850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773607.743790:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773607.743797:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773607.743801:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773607.743809:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9579 00000100:00080000:3.0:1775773607.743819:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773607.743825:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773607.743864:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612424064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773607.743884:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773607.743886:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773607.743888:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773607.743892:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9579 00000100:00080000:3.0:1775773607.743895:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773607.743898:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773607.743906:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773607.743919:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612424192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773607.743927:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612424064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773607.743934:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773607.743939:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773607.743941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773607.743946:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9579 00000100:00080000:3.0:1775773607.743950:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773607.743954:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773607.743959:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773607.743973:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612424320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773607.743983:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773607.743986:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773607.743988:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773607.743993:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9579 00000800:00000100:2.0:1775773607.743999:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773607.744001:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773607.744007:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773607.744013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773607.744025:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612424448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773607.744035:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773607/real 1775773607] req@ffff8de1c7af5180 x1862023612424064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773607.744038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773607.744051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773607.744058:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773607.744064:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9579 00000100:00080000:3.0:1775773607.744068:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775773607.744070:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612424064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773607.744074:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773607.744083:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775773607.744090:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773607.744097:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773607.744099:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612424576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773607.744106:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612424064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773607.744138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773607.744164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773607.744188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773607/real 1775773607] req@ffff8de1c7af7100 x1862023612424192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773607.744207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612424192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773607.744216:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773607.744220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773607.744223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773607.744229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773607.744252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773607.744263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773607/real 1775773607] req@ffff8de1c7af7800 x1862023612424320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773607.744276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612424320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773607.744284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773607.744288:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773607.744291:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773607.744298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773607.744319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773607.744330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773607/real 1775773607] req@ffff8de1c7af6d80 x1862023612424448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773607.744343:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612424448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773607.744352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773607.744355:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773607.744359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773607.744366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773607.744383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773607.744393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773607/real 1775773607] req@ffff8de1c7af7b80 x1862023612424576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773607.744404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612424576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773607.744412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773607.744415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773607.744418:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773608.703826:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773609.727861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773610.751902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773611.775906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773612.799901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773612.863954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773612.863962:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773612.863967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773612.863979:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9584 00000100:00080000:3.0:1775773612.863991:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773612.863998:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773612.864036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612424704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773612.864073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773612.864078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773612.864080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773612.864086:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9584 00000100:00080000:3.0:1775773612.864092:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773612.864098:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773612.864110:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773612.864121:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612424704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773612.864137:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612424832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773612.864150:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773612.864155:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773612.864157:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773612.864161:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9584 00000100:00080000:3.0:1775773612.864174:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773612.864178:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775773612.864184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775773612.864186:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773612.864202:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612424960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773612.864212:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775773612.864213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773612/real 1775773612] req@ffff8de1c7af5880 x1862023612424704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773612.864227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612424704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773612.864235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773612.864239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773612.864243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612424704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773612.864267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424832:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773612.864284:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773612.864286:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773612.864294:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9584 00000800:00000100:2.0:1775773612.864295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773612.864302:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773612.864308:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773612.864312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773612/real 1775773612] req@ffff8de1c7af5f80 x1862023612424832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775773612.864315:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773612.864327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612424832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773612.864333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773612.864335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773612.864338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773612.864345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773612.864359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773612.864366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773612/real 1775773612] req@ffff8de1c7af4a80 x1862023612424960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773612.864374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612424960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773612.864379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773612.864382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773612.864384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612424960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773612.864461:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612425088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773612.864487:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773612.864490:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773612.864492:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773612.864496:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9584 00000100:00080000:3.0:1775773612.864500:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773612.864503:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773612.864525:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773612.864553:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773612.864566:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773612/real 1775773612] req@ffff8de1c7af4e00 x1862023612425088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775773612.864579:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773612.864583:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612425088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773612.864591:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773612.864594:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773612.864597:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773612.864601:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612425216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773612.864643:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773612.864676:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773612.864688:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773612/real 1775773612] req@ffff8de1c7af4380 x1862023612425216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773612.864704:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612425216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773612.864714:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773612.864720:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773612.864767:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773613.823855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773614.847972:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773615.871863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773616.895982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773617.919893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773617.983819:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773617.983828:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773617.983832:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773617.983841:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9589 00000100:00080000:3.0:1775773617.983851:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773617.983857:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773617.983892:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612425344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773617.983929:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773617.983933:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773617.983936:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773617.983943:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9589 00000100:00080000:3.0:1775773617.983948:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773617.983952:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773617.983964:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773617.983997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612425472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773617.984001:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612425344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773617.984017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773617.984020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773617.984022:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773617.984027:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9589 00000100:00080000:3.0:1775773617.984030:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773617.984034:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773617.984041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773617.984056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612425600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773617.984069:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775773617.984071:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773617.984077:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773617.984080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773617.984087:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9589 00000100:00080000:3.0:1775773617.984093:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773617.984098:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773617.984105:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773617.984119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612425728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773617.984127:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773617/real 1775773617] req@ffff8de1c7af4000 x1862023612425344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773617.984135:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773617.984143:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773617.984147:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773617.984153:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9589 00000100:00080000:3.0:1775773617.984157:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775773617.984178:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612425344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773617.984182:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773617.984190:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775773617.984195:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775773617.984203:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612425856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773617.984204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773617.984215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612425344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773617.984267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773617.984300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773617.984317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773617/real 1775773617] req@ffff8de1c7af7480 x1862023612425472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773617.984333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612425472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773617.984345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773617.984350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773617.984355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773617.984363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773617.984384:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773617.984393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773617/real 1775773617] req@ffff8de1c7af5500 x1862023612425600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773617.984403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612425600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773617.984426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773617.984428:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773617.984431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773617.984435:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773617.984449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773617.984456:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773617/real 1775773617] req@ffff8de1c7af5c00 x1862023612425728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773617.984465:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612425728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773617.984471:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773617.984489:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773617.984492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773617.984496:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773617.984510:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773617.984517:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773617/real 1775773617] req@ffff8de1c7af6300 x1862023612425856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773617.984526:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612425856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773617.984532:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773617.984534:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773617.984537:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612425856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773618.943899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773619.967872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773620.992017:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773622.016006:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773623.039963:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773623.103850:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773623.103860:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773623.103865:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773623.103874:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9594 00000100:00080000:0.0:1775773623.103886:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773623.103893:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773623.103946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612425984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773623.103984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773623.103988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773623.103990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773623.103993:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9594 00000100:00080000:0.0:1775773623.103997:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773623.104000:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773623.104010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773623.104022:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612426112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773623.104031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773623.104034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773623.104036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773623.104039:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9594 00000100:00080000:0.0:1775773623.104042:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773623.104045:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773623.104048:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773623.104066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612426240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773623.104076:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773623.104080:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773623.104081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773623.104091:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9594 00000100:00100000:2.0:1775773623.104093:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612425984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773623.104095:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773623.104105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773623.104111:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773623.104125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612426368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773623.104136:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773623.104140:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773623.104142:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773623.104146:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9594 00000100:00080000:0.0:1775773623.104150:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773623.104153:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773623.104158:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773623.104170:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612426496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775773623.104181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773623.104226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773623/real 1775773623] req@ffff8de1c5683800 x1862023612425984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773623.104246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612425984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773623.104263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773623.104268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773623.104272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612425984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773623.104280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773623.104302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773623.104312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773623/real 1775773623] req@ffff8de1c5680e00 x1862023612426112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773623.104324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612426112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773623.104332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773623.104335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773623.104338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773623.104343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773623.104358:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773623.104366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773623/real 1775773623] req@ffff8de1c5681880 x1862023612426240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773623.104376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612426240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773623.104384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773623.104386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773623.104389:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773623.104417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773623.104433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773623.104441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773623/real 1775773623] req@ffff8de1c5681500 x1862023612426368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773623.104452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612426368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773623.104459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773623.104462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773623.104465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773623.104494:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773623.104512:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773623.104521:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773623/real 1775773623] req@ffff8de1c5683480 x1862023612426496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773623.104532:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612426496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773623.104540:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773623.104543:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773623.104546:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773624.063994:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773625.087979:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773626.111912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773627.135861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773628.159893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773628.223852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773628.223870:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773628.223877:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773628.223891:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9599 00000100:00080000:0.0:1775773628.223914:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773628.223923:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773628.223978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612426624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773628.224021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773628.224026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773628.224028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773628.224032:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9599 00000100:00080000:0.0:1775773628.224036:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773628.224041:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773628.224054:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773628.224069:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612426752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773628.224084:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612426624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773628.224087:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773628.224105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773628.224107:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773628.224112:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9599 00000100:00080000:0.0:1775773628.224116:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773628.224120:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773628.224124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773628.224136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612426880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773628.224146:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773628.224150:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773628.224151:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773628.224156:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9599 00000100:00080000:0.0:1775773628.224160:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773628.224164:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773628.224169:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773628.224179:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612427008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775773628.224193:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773628.224199:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773628.224203:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773628.224205:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773628.224209:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9599 00000100:00080000:0.0:1775773628.224215:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773628.224219:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773628.224225:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773628.224234:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612427136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773628.224252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773628/real 1775773628] req@ffff8de1c5680000 x1862023612426624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773628.224276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612426624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773628.224285:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773628.224299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773628.224302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612426624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773628.224325:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773628.224348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773628.224358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773628/real 1775773628] req@ffff8de1c5680380 x1862023612426752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773628.224367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612426752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773628.224409:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773628.224415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773628.224420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773628.224441:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773628.224470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773628.224486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773628/real 1775773628] req@ffff8de1c5682a00 x1862023612426880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773628.224502:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612426880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773628.224535:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773628.224539:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773628.224544:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612426880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773628.224551:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773628.224581:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773628.224591:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773628/real 1775773628] req@ffff8de1c5681f80 x1862023612427008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773628.224600:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612427008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773628.224606:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773628.224609:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773628.224611:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773628.224616:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773628.224629:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773628.224635:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773628/real 1775773628] req@ffff8de1c5681c00 x1862023612427136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773628.224643:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612427136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773628.224648:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773628.224650:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773628.224653:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773629.183998:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773630.207989:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773631.231995:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773632.256055:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773633.279847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773633.343821:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773633.343828:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773633.343833:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773633.343841:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9605 00000100:00080000:2.0:1775773633.343851:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773633.343856:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773633.343888:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612427264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773633.343924:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773633.343928:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773633.343930:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773633.343936:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9605 00000100:00080000:2.0:1775773633.343942:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773633.343947:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773633.343956:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773633.343958:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612427264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773633.343969:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612427392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773633.343978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773633.343981:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773633.343982:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773633.343985:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9605 00000100:00080000:2.0:1775773633.343988:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773633.343992:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773633.343995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773633.344014:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612427520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773633.344023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773633.344027:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:0.0:1775773633.344030:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773633.344031:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773633.344039:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9605 00000100:00080000:2.0:1775773633.344043:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773633.344048:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773633.344055:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773633.344078:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612427648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773633.344085:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773633/real 1775773633] req@ffff8de1d0f2f100 x1862023612427264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773633.344096:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773633.344100:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773633.344102:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773633.344106:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9605 00000100:00080000:2.0:1775773633.344109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773633.344112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612427264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773633.344115:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773633.344122:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773633.344133:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775773633.344134:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612427776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773633.344142:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773633.344149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612427264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773633.344169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773633.344191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773633.344204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773633/real 1775773633] req@ffff8de1d0f2e300 x1862023612427392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773633.344218:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612427392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773633.344226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773633.344231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773633.344234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773633.344241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773633.344256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773633.344263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773633/real 1775773633] req@ffff8de1d0f2e680 x1862023612427520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773633.344271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612427520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773633.344276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773633.344278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773633.344280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773633.344284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773633.344322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773633.344329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773633/real 1775773633] req@ffff8de1d0f2d500 x1862023612427648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773633.344337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612427648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773633.344342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773633.344344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773633.344346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773633.344350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773633.344360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773633.344365:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773633/real 1775773633] req@ffff8de1d0f2ca80 x1862023612427776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773633.344372:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612427776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773633.344377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773633.344379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773633.344380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612427776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773634.303899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773635.327915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773636.351946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773637.375867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773638.399935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773638.463911:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773638.463924:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773638.463932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773638.463947:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9610 00000100:00080000:3.0:1775773638.463964:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773638.463974:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773638.464028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612427904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773638.464081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773638.464089:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773638.464092:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773638.464100:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9610 00000100:00080000:3.0:1775773638.464107:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773638.464114:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773638.464130:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773638.464156:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612428032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773638.464168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612427904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773638.464220:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773638.464229:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773638.464233:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773638.464243:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9610 00000100:00080000:3.0:1775773638.464253:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773638.464261:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773638.464274:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775773638.464302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773638.464304:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612428160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773638.464330:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773638.464338:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773638.464342:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773638.464351:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9610 00000100:00100000:0.0:1775773638.464360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773638/real 1775773638] req@ffff8de1c7af6a00 x1862023612427904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773638.464363:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773638.464381:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773638.464396:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773638.464402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612427904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773638.464420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775773638.464426:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612428288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773638.464433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773638.464446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612427904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773638.464470:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773638.464477:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773638.464480:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773638.464492:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428032:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773638.464494:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9610 00000100:00080000:3.0:1775773638.464511:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773638.464521:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773638.464532:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773638.464541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773638.464563:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612428416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773638.464565:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773638/real 1775773638] req@ffff8de1c7af6680 x1862023612428032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773638.464630:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612428032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773638.464643:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773638.464649:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773638.464653:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773638.464662:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773638.464686:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773638.464698:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773638/real 1775773638] req@ffff8de1c7af4700 x1862023612428160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773638.464763:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612428160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773638.464774:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773638.464778:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773638.464783:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773638.464791:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773638.464816:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773638.464829:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773638/real 1775773638] req@ffff8de1c7af6300 x1862023612428288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773638.464859:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612428288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773638.464869:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773638.464873:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773638.464877:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773638.464898:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773638.464930:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773638.464944:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773638/real 1775773638] req@ffff8de1c7af5c00 x1862023612428416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773638.464958:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612428416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773638.464976:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773638.464980:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773638.464987:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773639.423996:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773640.447860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773641.472013:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773642.495878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773643.520088:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773643.583875:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773643.583886:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773643.583902:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773643.583914:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9615 00000100:00080000:2.0:1775773643.583928:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773643.583937:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773643.583978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612428544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773643.584018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773643.584022:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773643.584024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773643.584027:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9615 00000100:00080000:2.0:1775773643.584031:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773643.584035:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773643.584044:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773643.584056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612428672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773643.584066:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773643.584069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773643.584071:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773643.584074:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9615 00000100:00080000:2.0:1775773643.584076:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773643.584082:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773643.584085:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612428544:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773643.584087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773643.584101:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612428800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773643.584135:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773643.584138:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773643.584139:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773643.584143:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9615 00000100:00080000:2.0:1775773643.584146:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773643.584149:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773643.584154:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773643.584174:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612428928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773643.584182:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773643.584185:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773643.584186:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773643.584191:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9615 00000800:00000100:0.0:1775773643.584195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773643.584197:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773643.584203:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773643.584207:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773643.584216:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612429056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773643.584258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773643/real 1775773643] req@ffff8de1d0f2df80 x1862023612428544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773643.584283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612428544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773643.584297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773643.584303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773643.584308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612428544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773643.584318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773643.584348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773643.584363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773643/real 1775773643] req@ffff8de1d0f2c700 x1862023612428672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773643.584380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612428672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773643.584400:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773643.584405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773643.584409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773643.584446:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773643.584470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773643.584482:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773643/real 1775773643] req@ffff8de1d0f2ca80 x1862023612428800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773643.584499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612428800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773643.584510:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773643.584525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773643.584530:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773643.584537:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773643.584558:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773643.584570:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773643/real 1775773643] req@ffff8de1d0f2d500 x1862023612428928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773643.584606:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612428928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773643.584617:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773643.584622:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773643.584627:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612428928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773643.584635:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773643.584657:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773643.584670:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773643/real 1775773643] req@ffff8de1d0f2e680 x1862023612429056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773643.584687:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612429056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773643.584697:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773643.584702:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773643.584706:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773644.543914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773645.567941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773646.591904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773647.616010:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773648.639970:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773648.703895:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773648.703906:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773648.703912:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773648.703924:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9620 00000100:00080000:2.0:1775773648.703939:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773648.703947:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773648.703992:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612429184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773648.704052:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773648.704058:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773648.704061:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773648.704066:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9620 00000100:00080000:2.0:1775773648.704073:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773648.704079:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773648.704093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773648.704116:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612429184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773648.704117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612429312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773648.704144:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773648.704148:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773648.704151:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773648.704157:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9620 00000100:00080000:2.0:1775773648.704161:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773648.704166:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773648.704173:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773648.704188:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612429440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773648.704201:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773648.704207:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773648.704213:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773648.704214:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773648.704226:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9620 00000100:00080000:2.0:1775773648.704233:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773648.704239:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773648.704246:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773648.704263:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612429568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773648.704275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773648/real 1775773648] req@ffff8de1d0f2e300 x1862023612429184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773648.704282:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773648.704297:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773648.704302:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773648.704317:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9620 00000100:00080000:2.0:1775773648.704323:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773648.704331:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773648.704332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612429184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775773648.704340:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773648.704359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775773648.704361:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612429696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773648.704375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773648.704387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612429184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773648.704422:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773648.704456:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773648.704471:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773648/real 1775773648] req@ffff8de1d0f2f100 x1862023612429312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773648.704490:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612429312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773648.704501:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773648.704507:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773648.704511:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773648.704519:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773648.704547:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773648.704558:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773648/real 1775773648] req@ffff8de1d0f2e680 x1862023612429440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773648.704574:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612429440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773648.704585:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773648.704590:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773648.704595:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773648.704604:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773648.704635:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773648.704653:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773648/real 1775773648] req@ffff8de1d0f2d500 x1862023612429568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773648.704677:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612429568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773648.704687:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773648.704691:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773648.704695:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773648.704704:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773648.704777:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773648.704794:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773648/real 1775773648] req@ffff8de1d0f2ca80 x1862023612429696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773648.704811:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612429696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773648.704825:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773648.704831:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773648.704838:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773649.663880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773650.687864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773651.712028:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773652.735862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773653.759893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773653.823822:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773653.823829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773653.823834:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773653.823842:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9625 00000100:00080000:2.0:1775773653.823851:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773653.823857:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773653.823889:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612429824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773653.823922:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773653.823926:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773653.823928:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773653.823947:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9625 00000100:00080000:2.0:1775773653.823951:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773653.823955:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773653.823966:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773653.823981:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612429952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773653.823990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612429824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773653.823991:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773653.823998:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773653.823999:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773653.824003:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9625 00000100:00080000:2.0:1775773653.824006:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773653.824009:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773653.824013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773653.824024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612430080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773653.824030:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773653.824032:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773653.824033:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773653.824035:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9625 00000100:00080000:2.0:1775773653.824040:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773653.824044:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773653.824049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773653.824054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773653.824063:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612430208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773653.824074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773653.824078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773653.824080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773653.824085:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773653/real 1775773653] req@ffff8de1d0f2c700 x1862023612429824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773653.824086:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9625 00000100:00080000:2.0:1775773653.824093:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773653.824112:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773653.824113:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612429824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775773653.824121:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773653.824125:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773653.824129:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773653.824134:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612430336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773653.824135:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612429824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773653.824156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773653.824175:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773653.824184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773653/real 1775773653] req@ffff8de1d0f2df80 x1862023612429952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773653.824191:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612429952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773653.824197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773653.824199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773653.824201:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612429952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773653.824204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773653.824214:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773653.824219:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773653/real 1775773653] req@ffff8de1d0f2ca80 x1862023612430080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773653.824226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612430080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773653.824235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773653.824237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773653.824239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773653.824242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773653.824251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773653.824256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773653/real 1775773653] req@ffff8de1d0f2d500 x1862023612430208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773653.824262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612430208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773653.824267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773653.824269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773653.824271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773653.824274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773653.824283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773653.824287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773653/real 1775773653] req@ffff8de1d0f2e680 x1862023612430336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773653.824294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612430336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773653.824298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773653.824300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773653.824302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773654.783885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773655.807940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773656.831854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773657.855948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773658.879859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773658.943880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773658.943891:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773658.943896:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773658.943907:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9630 00000100:00080000:2.0:1775773658.943921:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773658.943929:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773658.943974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612430464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773658.944003:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773658.944008:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773658.944010:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773658.944013:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9630 00000100:00080000:2.0:1775773658.944016:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773658.944019:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773658.944030:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773658.944041:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612430592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773658.944054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612430464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773658.944055:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773658.944068:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773658.944082:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773658.944088:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9630 00000100:00080000:2.0:1775773658.944091:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773658.944095:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773658.944100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773658.944114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612430720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773658.944121:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773658.944124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773658.944126:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773658.944128:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9630 00000100:00080000:2.0:1775773658.944131:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773658.944134:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775773658.944140:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:2.0:1775773658.944142:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773658.944155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612430848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773658.944163:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773658.944166:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773658.944167:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773658.944173:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9630 00000100:00080000:2.0:1775773658.944175:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773658.944181:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773658.944182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773658/real 1775773658] req@ffff8de1d0f2f100 x1862023612430464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775773658.944187:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773658.944203:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612430976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773658.944210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612430464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773658.944224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773658.944228:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773658.944231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612430464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773658.944259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773658.944286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773658.944299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773658/real 1775773658] req@ffff8de1d0f2e300 x1862023612430592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773658.944322:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612430592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773658.944331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773658.944334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773658.944336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773658.944341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773658.944357:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773658.944365:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773658/real 1775773658] req@ffff8de1d0f2e680 x1862023612430720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773658.944373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612430720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773658.944377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773658.944380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773658.944381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773658.944385:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773658.944395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773658.944410:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773658/real 1775773658] req@ffff8de1d0f2d500 x1862023612430848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773658.944418:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612430848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773658.944423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773658.944426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773658.944428:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773658.944431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773658.944442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773658.944447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773658/real 1775773658] req@ffff8de1d0f2ca80 x1862023612430976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773658.944459:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612430976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773658.944464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773658.944466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773658.944468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612430976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773659.903938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773660.927927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773661.951912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773662.975920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773664.000007:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773664.063857:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773664.063868:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773664.063873:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773664.063885:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9635 00000100:00080000:0.0:1775773664.063907:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773664.063914:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773664.063959:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612431104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773664.063986:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773664.063989:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773664.063990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773664.063994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9635 00000100:00080000:0.0:1775773664.063997:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773664.064000:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773664.064010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773664.064020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612431232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773664.064029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612431104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773664.064031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773664.064038:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773664.064041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773664.064044:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9635 00000100:00080000:0.0:1775773664.064046:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773664.064048:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773664.064051:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773664.064059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612431360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773664.064066:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773664.064070:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773664.064072:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773664.064077:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9635 00000100:00080000:0.0:1775773664.064081:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773664.064086:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773664.064092:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773664.064104:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612431488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773664.064115:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775773664.064121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773664.064122:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773664.064125:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773664.064132:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9635 00000100:00080000:0.0:1775773664.064137:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773664.064142:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773664.064148:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773664.064162:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612431616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773664.064167:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773664/real 1775773664] req@ffff8de1c5682300 x1862023612431104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773664.064192:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612431104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773664.064205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773664.064211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773664.064215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612431104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773664.064247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773664.064267:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773664.064277:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773664/real 1775773664] req@ffff8de1c5680700 x1862023612431232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773664.064285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612431232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773664.064291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773664.064293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773664.064296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773664.064299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773664.064311:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773664.064316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773664/real 1775773664] req@ffff8de1c5682d80 x1862023612431360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773664.064323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612431360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773664.064328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773664.064330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773664.064332:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773664.064335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773664.064345:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773664.064350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773664/real 1775773664] req@ffff8de1c5682680 x1862023612431488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773664.064368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612431488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773664.064377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773664.064380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773664.064384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773664.064391:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773664.064412:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773664.064422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773664/real 1775773664] req@ffff8de1c5683b80 x1862023612431616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773664.064430:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612431616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773664.064435:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773664.064437:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773664.064439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773665.023921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773666.047903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773667.071879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773668.095869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773669.119833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773669.183826:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773669.183837:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773669.183841:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773669.183852:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9640 00000100:00080000:2.0:1775773669.183864:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773669.183871:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773669.183906:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612431744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773669.183938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773669.183942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773669.183945:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773669.183950:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9640 00000100:00080000:2.0:1775773669.183956:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773669.183960:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773669.183967:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612431744:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773669.183971:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773669.183990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612431872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773669.184003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773669.184007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773669.184010:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773669.184014:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9640 00000100:00080000:2.0:1775773669.184028:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773669.184033:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773669.184039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773669.184053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612432000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773669.184064:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773669.184069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773669.184071:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773669.184074:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431872:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773669.184079:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9640 00000100:00080000:2.0:1775773669.184085:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773669.184090:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773669.184097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773669.184111:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612432128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773669.184114:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432000:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773669.184132:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773669.184136:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773669.184138:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773669.184144:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9640 00000100:00100000:0.0:1775773669.184148:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432128:192.168.201.137@tcp:8:kworker.0 00000100:00080000:2.0:1775773669.184148:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773669.184157:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773669.184164:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773669.184178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612432256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773669.184221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773670.143890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773671.167835:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773672.191845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773672.255967:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775773672.256003:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773672.256017:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773672.256047:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773672.256054:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773672.256059:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773672.256065:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775773672.256099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773669/real 1775773672] req@ffff8de1d0f2e680 x1862023612432256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773672.256123:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612432256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773672.256134:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773672.256138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773672.256141:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432256:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773672.256149:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773669/real 1775773672] req@ffff8de1d0f2d500 x1862023612432128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773672.256162:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612432128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773672.256169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773672.256172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773672.256176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773672.256182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773669/real 1775773672] req@ffff8de1d0f2c700 x1862023612431872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773672.256194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612431872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773672.256202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773672.256206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773672.256210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612431872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773672.256216:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773669/real 1775773672] req@ffff8de1d0f2ca80 x1862023612432000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773672.256229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612432000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773672.256238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773672.256242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773672.256245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773672.256252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773669/real 1775773672] req@ffff8de1d0f2df80 x1862023612431744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773672.256265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612431744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773672.256273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773672.256276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773672.256280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612431744:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775773673.215830:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773674.239908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773674.303911:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773674.303919:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773674.303922:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773674.303929:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9646 00000100:00080000:1.0:1775773674.303938:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773674.303943:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773674.303972:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612432384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773674.303998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773674.304001:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773674.304003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773674.304006:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9646 00000100:00080000:1.0:1775773674.304008:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773674.304010:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773674.304018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773674.304027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612432512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773674.304034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773674.304037:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773674.304038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773674.304040:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9646 00000100:00080000:1.0:1775773674.304042:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773674.304044:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773674.304047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773674.304056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612432384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773674.304056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612432640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773674.304070:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773674.304072:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773674.304074:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773674.304076:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9646 00000100:00080000:1.0:1775773674.304079:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773674.304082:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773674.304084:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773674.304094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612432768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773674.304101:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773674.304104:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773674.304106:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773674.304109:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9646 00000100:00080000:1.0:1775773674.304113:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773674.304116:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773674.304121:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773674.304122:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773674.304137:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612432896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773674.304157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773674/real 1775773674] req@ffff8de1c2e14e00 x1862023612432384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773674.304174:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612432384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773674.304185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773674.304189:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773674.304193:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612432384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773674.304201:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773674.304228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773674.304245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773674/real 1775773674] req@ffff8de1c2e14a80 x1862023612432512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773674.304256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612432512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773674.304264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773674.304267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773674.304270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773674.304297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773674.304318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773674.304329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773674/real 1775773674] req@ffff8de1c2e17480 x1862023612432640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773674.304364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612432640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773674.304373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773674.304377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773674.304380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773674.304387:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773674.304410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773674.304422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773674/real 1775773674] req@ffff8de1c2e14700 x1862023612432768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773674.304434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612432768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773674.304442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773674.304446:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773674.304450:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773674.304458:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773674.304478:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773674.304488:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773674/real 1775773674] req@ffff8de1c2e15500 x1862023612432896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773674.304500:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612432896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773674.304508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773674.304512:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773674.304515:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612432896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773675.263839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773676.287896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773677.311929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773678.335916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773679.359873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773679.423873:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773679.423881:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773679.423885:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773679.423893:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9651 00000100:00080000:0.0:1775773679.423902:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773679.423908:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773679.423942:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612433024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773679.423969:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773679.423972:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773679.423973:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773679.423976:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9651 00000100:00080000:0.0:1775773679.423979:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773679.423982:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773679.423990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773679.423998:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612433152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773679.424006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773679.424009:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773679.424010:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773679.424012:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9651 00000100:00080000:0.0:1775773679.424014:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775773679.424018:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612433024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773679.424019:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773679.424025:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773679.424032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612433280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773679.424039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773679.424042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773679.424043:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773679.424045:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9651 00000100:00080000:0.0:1775773679.424047:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773679.424049:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773679.424052:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773679.424059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612433408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773679.424070:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773679.424072:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773679.424073:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773679.424075:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9651 00000100:00080000:0.0:1775773679.424077:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773679.424081:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775773679.424086:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773679.424087:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773679.424096:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612433536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773679.424129:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773679/real 1775773679] req@ffff8de1c5683b80 x1862023612433024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773679.424145:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612433024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773679.424152:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773679.424155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773679.424159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612433024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773679.424164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773679.424182:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773679.424191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773679/real 1775773679] req@ffff8de1c5682680 x1862023612433152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773679.424199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612433152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773679.424204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773679.424206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773679.424210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773679.424234:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773679.424255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773679.424265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773679/real 1775773679] req@ffff8de1c5682d80 x1862023612433280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773679.424277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612433280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773679.424283:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773679.424285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773679.424287:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773679.424292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773679.424306:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773679.424323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773679/real 1775773679] req@ffff8de1c5680700 x1862023612433408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773679.424331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612433408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773679.424336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773679.424338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773679.424340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773679.424344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773679.424355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773679.424360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773679/real 1775773679] req@ffff8de1c5682300 x1862023612433536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773679.424367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612433536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773679.424372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773679.424373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773679.424375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773680.383895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773681.407884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773682.431894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773683.455920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773684.479851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773684.543817:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773684.543828:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773684.543832:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773684.543843:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9656 00000100:00080000:0.0:1775773684.543853:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773684.543859:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773684.543890:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612433664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773684.543914:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773684.543917:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773684.543919:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773684.543923:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9656 00000100:00080000:0.0:1775773684.543926:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773684.543930:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773684.543938:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773684.543948:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612433664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773684.543951:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612433792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773684.543962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773684.543964:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773684.543965:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773684.543968:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9656 00000100:00080000:0.0:1775773684.543970:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773684.543973:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773684.543976:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773684.543987:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612433920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773684.543994:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773684.543997:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773684.544000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773684.544003:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9656 00000100:00080000:0.0:1775773684.544006:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773684.544011:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775773684.544013:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773684.544016:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773684.544025:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612434048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773684.544032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773684.544036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773684.544038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773684.544043:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9656 00000100:00080000:0.0:1775773684.544047:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773684.544052:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773684.544058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773684.544065:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773684/real 1775773684] req@ffff8de1c5681c00 x1862023612433664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773684.544071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612434176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773684.544102:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612433664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773684.544114:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773684.544118:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773684.544121:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612433664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773684.544140:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773684.544160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773684.544171:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773684/real 1775773684] req@ffff8de1c5681f80 x1862023612433792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773684.544180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612433792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773684.544185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773684.544187:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773684.544190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773684.544193:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773684.544210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773684.544220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773684/real 1775773684] req@ffff8de1c5682a00 x1862023612433920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773684.544232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612433920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773684.544240:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773684.544243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773684.544247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612433920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773684.544253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773684.544274:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773684.544284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773684/real 1775773684] req@ffff8de1c5680380 x1862023612434048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773684.544296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612434048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773684.544302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773684.544304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773684.544306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773684.544310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773684.544323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773684.544330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773684/real 1775773684] req@ffff8de1c5680000 x1862023612434176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773684.544337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612434176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773684.544342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773684.544344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773684.544346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773685.503903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773686.527908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773687.551890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773688.575954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773689.599954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773689.663918:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773689.663933:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773689.663940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773689.663953:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9661 00000100:00080000:2.0:1775773689.663968:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773689.663978:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773689.664028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612434304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773689.664066:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773689.664078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773689.664081:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773689.664088:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9661 00000100:00080000:2.0:1775773689.664094:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773689.664099:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773689.664112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773689.664130:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612434304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773689.664131:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612434432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773689.664156:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773689.664162:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773689.664176:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773689.664185:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9661 00000100:00080000:2.0:1775773689.664191:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773689.664195:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773689.664203:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775773689.664208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773689.664223:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612434560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773689.664242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773689/real 1775773689] req@ffff8de1d0f2e300 x1862023612434304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773689.664246:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773689.664267:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773689.664270:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773689.664276:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9661 00000100:00100000:1.0:1775773689.664279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612434304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773689.664286:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773689.664293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773689.664299:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775773689.664318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773689.664321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612434304:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773689.664338:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773689.664346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773689.664360:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612434688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775773689.664372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773689.664378:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773689.664384:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773689.664386:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773689.664389:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773689/real 1775773689] req@ffff8de1d0f2f100 x1862023612434432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773689.664400:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9661 00000100:00100000:1.0:1775773689.664411:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612434432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773689.664417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773689.664420:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773689.664421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773689.664431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434432:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773689.664433:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773689.664445:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773689.664449:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773689.664468:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612434816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775773689.664482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773689.664500:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773689/real 1775773689] req@ffff8de1d0f2df80 x1862023612434560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773689.664509:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612434560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773689.664517:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773689.664520:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773689.664522:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773689.664535:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773689.664556:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773689.664562:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773689/real 1775773689] req@ffff8de1d0f2ca80 x1862023612434688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773689.664570:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612434688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773689.664575:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773689.664578:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773689.664580:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773689.664583:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773689.664593:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773689.664598:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773689/real 1775773689] req@ffff8de1d0f2c700 x1862023612434816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773689.664606:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612434816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773689.664611:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773689.664613:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773689.664614:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612434816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773690.623971:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773691.647856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773692.671887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773693.695840:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773694.719933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773694.783876:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773694.783888:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773694.783892:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773694.783903:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9666 00000100:00080000:0.0:1775773694.783916:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773694.783923:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773694.783959:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612434944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773694.783989:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773694.783993:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773694.783995:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773694.784007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9666 00000100:00080000:0.0:1775773694.784016:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773694.784021:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773694.784032:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773694.784042:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612434944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773694.784049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612435072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773694.784065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773694.784068:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773694.784070:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773694.784073:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9666 00000100:00080000:0.0:1775773694.784091:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773694.784094:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773694.784099:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775773694.784100:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773694.784112:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612435200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773694.784120:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773694.784122:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773694.784123:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773694.784127:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9666 00000100:00080000:0.0:1775773694.784130:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773694.784133:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773694.784137:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773694/real 1775773694] req@ffff8de1c5683480 x1862023612434944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775773694.784138:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773694.784149:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612435328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773694.784156:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773694.784158:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612434944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773694.784160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773694.784163:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773694.784172:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9666 00000100:00080000:0.0:1775773694.784177:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773694.784183:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773694.784190:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775773694.784192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775773694.784199:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612435456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773694.784200:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773694.784208:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612434944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773694.784254:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773694.784274:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773694.784284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773694/real 1775773694] req@ffff8de1c5681500 x1862023612435072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773694.784293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612435072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773694.784302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773694.784306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773694.784309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773694.784315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773694.784335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773694.784347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773694/real 1775773694] req@ffff8de1c5681880 x1862023612435200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773694.784361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612435200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773694.784370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773694.784374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773694.784377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773694.784385:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773694.784403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773694.784411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773694/real 1775773694] req@ffff8de1c5680e00 x1862023612435328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773694.784419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612435328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773694.784425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773694.784427:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773694.784429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773694.784433:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773694.784443:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773694.784449:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773694/real 1775773694] req@ffff8de1c5683800 x1862023612435456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773694.784456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612435456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773694.784461:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773694.784463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773694.784465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773695.743864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773696.767879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773697.791883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773698.815963:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773699.839915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773699.903862:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773699.903871:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773699.903876:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773699.903885:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9671 00000100:00080000:2.0:1775773699.903896:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773699.903903:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773699.903937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612435584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773699.903963:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773699.903966:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773699.903967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773699.903970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9671 00000100:00080000:2.0:1775773699.903973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773699.903976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773699.903984:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773699.903993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612435712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773699.904001:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773699.904004:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773699.904006:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773699.904008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9671 00000100:00080000:2.0:1775773699.904011:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773699.904015:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612435584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773699.904016:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773699.904023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773699.904035:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612435840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773699.904062:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773699.904066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773699.904069:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773699.904074:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9671 00000100:00080000:2.0:1775773699.904078:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773699.904082:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773699.904089:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775773699.904096:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773699.904105:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612435968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773699.904118:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773699.904137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773699.904140:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773699.904145:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773699/real 1775773699] req@ffff8de1d0f2d500 x1862023612435584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773699.904150:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9671 00000100:00080000:2.0:1775773699.904159:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773699.904181:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773699.904188:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612435584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775773699.904188:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775773699.904202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775773699.904207:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612436096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773699.904210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773699.904218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612435584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773699.904231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773699.904253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773699.904268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773699/real 1775773699] req@ffff8de1d0f2e680 x1862023612435712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773699.904277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612435712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773699.904284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773699.904286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773699.904288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773699.904308:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773699.904321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773699.904328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773699/real 1775773699] req@ffff8de1d0f2c700 x1862023612435840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773699.904336:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612435840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773699.904365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773699.904367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773699.904370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773699.904375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773699.904389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773699.904396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773699/real 1775773699] req@ffff8de1d0f2ca80 x1862023612435968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773699.904405:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612435968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773699.904412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773699.904414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773699.904417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612435968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773699.904421:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773699.904433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773699.904440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773699/real 1775773699] req@ffff8de1d0f2df80 x1862023612436096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773699.904465:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612436096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773699.904471:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773699.904472:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773699.904475:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773700.863965:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773701.887902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773702.911908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773703.935908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773704.959926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773705.023859:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773705.023867:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773705.023871:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773705.023880:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9676 00000100:00080000:3.0:1775773705.023890:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773705.023900:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773705.023931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612436224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773705.023952:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773705.023955:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773705.023957:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773705.023960:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9676 00000100:00080000:3.0:1775773705.023962:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773705.023965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773705.023972:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773705.023983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612436352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773705.023992:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773705.023997:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612436224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773705.023997:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773705.023998:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773705.024008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9676 00000100:00080000:3.0:1775773705.024010:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773705.024012:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773705.024016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773705.024028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612436480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773705.024067:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775773705.024073:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773705.024076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773705.024079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773705.024084:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9676 00000100:00080000:3.0:1775773705.024090:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773705.024096:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773705.024104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773705.024116:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773705/real 1775773705] req@ffff8de1c7af5500 x1862023612436224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773705.024121:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612436608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773705.024138:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773705.024142:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612436224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773705.024142:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773705.024147:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773705.024155:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9676 00000100:00080000:1.0:1775773705.024159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773705.024160:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773705.024167:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775773705.024169:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773705.024174:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612436224:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773705.024174:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773705.024189:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612436736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773705.024202:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773705.024221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773705.024229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773705/real 1775773705] req@ffff8de1c7af7480 x1862023612436352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773705.024237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612436352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773705.024242:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773705.024245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773705.024247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773705.024251:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773705.024260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773705.024266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773705/real 1775773705] req@ffff8de1c7af4000 x1862023612436480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773705.024274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612436480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773705.024278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773705.024280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773705.024282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773705.024286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773705.024296:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773705.024301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773705/real 1775773705] req@ffff8de1c7af4380 x1862023612436608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773705.024309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612436608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773705.024313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773705.024315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773705.024317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773705.024320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773705.024329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773705.024334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773705/real 1775773705] req@ffff8de1c7af4e00 x1862023612436736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773705.024341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612436736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773705.024346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773705.024348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773705.024350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773705.983922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773707.007881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773708.032071:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773709.056046:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773710.079882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773710.143832:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773710.143839:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773710.143843:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773710.143851:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9681 00000100:00080000:2.0:1775773710.143860:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773710.143865:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773710.143900:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612436864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773710.143935:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773710.143939:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773710.143941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773710.143969:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9681 00000100:00080000:2.0:1775773710.143974:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773710.143979:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773710.143989:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773710.143999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612436864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773710.144005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612436992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773710.144017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773710.144019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773710.144022:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773710.144024:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9681 00000100:00080000:2.0:1775773710.144027:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773710.144030:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773710.144034:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773710.144044:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612437120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773710.144050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773710.144053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773710.144054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775773710.144058:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773710.144059:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9681 00000100:00080000:2.0:1775773710.144070:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773710.144074:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773710.144078:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773710.144087:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612437248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773710.144093:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773710.144096:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773710/real 1775773710] req@ffff8de1d0f2f100 x1862023612436864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773710.144097:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773710.144100:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773710.144107:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9681 00000100:00080000:2.0:1775773710.144112:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773710.144115:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773710.144118:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773710.144121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612436864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773710.144127:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612437376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773710.144131:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773710.144138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773710.144143:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612436864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773710.144163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773710.144177:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773710.144185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773710/real 1775773710] req@ffff8de1d0f2e300 x1862023612436992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773710.144193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612436992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773710.144198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773710.144200:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773710.144202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612436992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773710.144207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773710.144216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773710.144222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773710/real 1775773710] req@ffff8de1d0f2df80 x1862023612437120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773710.144229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612437120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773710.144233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773710.144235:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773710.144237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773710.144240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773710.144250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773710.144255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773710/real 1775773710] req@ffff8de1d0f2ca80 x1862023612437248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773710.144262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612437248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773710.144267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773710.144268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773710.144270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773710.144273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773710.144282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773710.144287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773710/real 1775773710] req@ffff8de1d0f2c700 x1862023612437376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773710.144294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612437376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773710.144299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773710.144300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773710.144302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773711.103866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773712.127949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773713.151881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773714.175917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773715.199909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773715.263842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773715.263850:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773715.263868:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773715.263876:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9687 00000100:00080000:1.0:1775773715.263887:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773715.263892:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773715.263923:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612437504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773715.263948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773715.263951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773715.263952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773715.263955:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9687 00000100:00080000:1.0:1775773715.263958:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773715.263961:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773715.263968:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773715.263982:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612437632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773715.263995:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773715.263999:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773715.264000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775773715.264000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612437504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773715.264007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9687 00000100:00080000:1.0:1775773715.264011:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773715.264014:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773715.264017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773715.264026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612437760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773715.264032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773715.264035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773715.264036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773715.264038:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9687 00000100:00080000:1.0:1775773715.264040:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773715.264042:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773715.264046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773715.264052:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612437888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773715.264058:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773715.264060:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773715.264061:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773715.264063:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9687 00000100:00080000:1.0:1775773715.264066:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773715.264072:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775773715.264072:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775773715.264075:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773715.264084:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612438016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773715.264111:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773715/real 1775773715] req@ffff8de1c2e17800 x1862023612437504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773715.264130:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612437504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773715.264140:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773715.264144:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773715.264148:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612437504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773715.264169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773715.264193:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773715.264205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773715/real 1775773715] req@ffff8de1c2e17100 x1862023612437632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773715.264218:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612437632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773715.264227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773715.264230:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773715.264234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773715.264240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773715.264259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773715.264270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773715/real 1775773715] req@ffff8de1c2e17b80 x1862023612437760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773715.264283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612437760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773715.264291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773715.264293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773715.264295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773715.264299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773715.264315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773715.264322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773715/real 1775773715] req@ffff8de1c2e16680 x1862023612437888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773715.264329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612437888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773715.264334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773715.264336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773715.264338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612437888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773715.264342:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773715.264351:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773715.264356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773715/real 1775773715] req@ffff8de1c2e14380 x1862023612438016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773715.264362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612438016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773715.264371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773715.264373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773715.264375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773716.223923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773717.247905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773718.271954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773719.295918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773720.319940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773720.383850:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773720.383858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773720.383862:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773720.383870:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9692 00000100:00080000:0.0:1775773720.383879:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773720.383885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773720.383918:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612438144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773720.383943:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773720.383946:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773720.383947:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773720.383950:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9692 00000100:00080000:0.0:1775773720.383953:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773720.383955:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773720.383963:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773720.383974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612438272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773720.383983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773720.383988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773720.383990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775773720.383990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612438144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773720.383997:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9692 00000100:00080000:0.0:1775773720.384001:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773720.384004:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773720.384009:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773720.384019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612438400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773720.384026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773720.384029:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773720.384030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773720.384033:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9692 00000100:00080000:0.0:1775773720.384038:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773720.384041:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773720.384045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775773720.384053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773720.384055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612438528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773720.384063:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773720.384066:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773720.384068:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773720.384072:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9692 00000100:00080000:0.0:1775773720.384075:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773720.384078:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773720.384082:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773720.384093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773720/real 1775773720] req@ffff8de1c5683800 x1862023612438144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773720.384094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612438656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775773720.384134:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612438144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773720.384142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773720.384147:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773720.384150:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612438144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773720.384170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773720.384185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773720.384192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773720/real 1775773720] req@ffff8de1c5680e00 x1862023612438272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773720.384200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612438272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773720.384205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773720.384208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773720.384210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773720.384214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773720.384227:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773720.384237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773720/real 1775773720] req@ffff8de1c5681880 x1862023612438400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773720.384250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612438400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773720.384258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773720.384261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773720.384264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773720.384270:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773720.384291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773720.384302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773720/real 1775773720] req@ffff8de1c5681500 x1862023612438528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773720.384314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612438528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773720.384322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773720.384324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773720.384326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773720.384330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773720.384345:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773720.384352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773720/real 1775773720] req@ffff8de1c5683480 x1862023612438656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773720.384360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612438656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773720.384365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773720.384367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773720.384369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773721.343927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773722.367929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773723.391958:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773724.415964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773725.439880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773725.503816:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773725.503825:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773725.503829:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773725.503838:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9697 00000100:00080000:3.0:1775773725.503848:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773725.503854:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773725.503886:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612438784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773725.503907:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773725.503911:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773725.503913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773725.503918:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9697 00000100:00080000:3.0:1775773725.503922:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773725.503926:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773725.503936:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773725.503949:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612438784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773725.503949:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612438912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773725.503960:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773725.503963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773725.503965:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773725.503969:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9697 00000100:00080000:3.0:1775773725.503972:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773725.503975:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773725.503979:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773725.503988:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612439040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773725.503996:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773725.504000:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773725.504001:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773725.504005:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9697 00000100:00080000:3.0:1775773725.504007:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775773725.504008:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773725.504011:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773725.504015:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773725.504023:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612439168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773725.504032:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773725.504035:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773725.504037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775773725.504040:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773725/real 1775773725] req@ffff8de1c7af4a80 x1862023612438784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773725.504040:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9697 00000100:00080000:3.0:1775773725.504043:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773725.504047:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773725.504051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773725.504059:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612438784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773725.504059:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612439296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773725.504070:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773725.504074:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773725.504078:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612438784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773725.504101:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773725.504140:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773725.504154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773725/real 1775773725] req@ffff8de1c7af5f80 x1862023612438912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773725.504166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612438912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773725.504173:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773725.504176:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773725.504178:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612438912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773725.504199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775773725.504214:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773725.504224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773725/real 1775773725] req@ffff8de1c7af5880 x1862023612439040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773725.504233:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612439040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773725.504238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773725.504240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773725.504242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773725.504246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773725.504256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773725.504262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773725/real 1775773725] req@ffff8de1c7af7b80 x1862023612439168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773725.504269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612439168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773725.504275:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773725.504277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773725.504280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775773725.504283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775773725.504293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773725.504298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773725/real 1775773725] req@ffff8de1c7af6d80 x1862023612439296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773725.504309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612439296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773725.504317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773725.504320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775773725.504323:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773726.463937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773727.487925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773728.511879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773729.535914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773730.559880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773730.623853:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773730.623864:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773730.623868:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773730.623879:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9702 00000100:00080000:2.0:1775773730.623892:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773730.623899:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773730.623938:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612439424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773730.623978:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773730.623982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773730.623984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773730.623989:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9702 00000100:00080000:2.0:1775773730.623993:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773730.623999:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773730.624009:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773730.624018:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612439424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773730.624026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612439552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773730.624039:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773730.624043:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773730.624045:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773730.624049:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9702 00000100:00080000:2.0:1775773730.624055:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773730.624059:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773730.624065:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775773730.624078:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773730.624080:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612439680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773730.624091:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773730.624095:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773730.624098:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773730.624102:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9702 00000100:00080000:2.0:1775773730.624115:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773730.624119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773730/real 1775773730] req@ffff8de1d0f2e680 x1862023612439424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773730.624123:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773730.624133:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773730.624145:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612439424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773730.624148:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612439808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773730.624162:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773730.624167:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773730.624169:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773730.624175:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775773730.624176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612439424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773730.624180:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773730.624186:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9702 00000100:00080000:2.0:1775773730.624190:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773730.624194:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773730.624199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773730.624204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775773730.624211:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612439936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775773730.624234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773730.624249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773730/real 1775773730] req@ffff8de1d0f2d500 x1862023612439552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773730.624259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612439552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773730.624272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773730.624275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773730.624278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773730.624282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773730.624296:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773730.624303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773730/real 1775773730] req@ffff8de1d0f2c700 x1862023612439680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773730.624310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612439680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773730.624315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773730.624317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773730.624319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773730.624322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773730.624332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773730.624337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773730/real 1775773730] req@ffff8de1d0f2ca80 x1862023612439808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773730.624344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612439808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773730.624349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773730.624350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773730.624352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773730.624362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773730.624371:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773730.624377:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773730/real 1775773730] req@ffff8de1d0f2df80 x1862023612439936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773730.624385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612439936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773730.624390:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773730.624392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773730.624393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612439936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773731.583905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773732.607855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773733.631913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773734.655940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773735.679970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773735.743873:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773735.743881:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773735.743884:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773735.743892:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9707 00000100:00080000:2.0:1775773735.743903:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773735.743908:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773735.743940:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612440064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773735.743967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773735.743970:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773735.743971:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773735.743974:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9707 00000100:00080000:2.0:1775773735.743976:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773735.743978:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773735.743986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773735.743995:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612440192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773735.744002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773735.744004:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773735.744005:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773735.744008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9707 00000100:00080000:2.0:1775773735.744009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773735.744011:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773735.744014:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773735.744019:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612440320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773735.744026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773735.744028:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773735.744030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773735.744033:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9707 00000100:00080000:2.0:1775773735.744036:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773735.744039:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773735.744042:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773735.744048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612440448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773735.744055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612440064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773735.744056:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773735.744063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773735.744065:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773735.744067:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9707 00000100:00080000:2.0:1775773735.744069:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773735.744071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773735.744075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773735.744085:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612440576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773735.744141:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773735.744160:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773735.744181:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773735.744204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773736.703881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773737.727880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773738.751849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1775773738.816007:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:3.0:1775773738.816048:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1775773738.816065:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773738.816103:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773738.816111:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773738.816117:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775773738.816122:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775773738.816157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773735/real 1775773738] req@ffff8de1d0f2ca80 x1862023612440448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773738.816199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612440448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773738.816210:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773738.816214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773738.816219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773738.816227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773735/real 1775773738] req@ffff8de1d0f2c700 x1862023612440576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773738.816240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612440576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773738.816259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773738.816261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773738.816264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440576:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773738.816269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773735/real 1775773738] req@ffff8de1d0f2e300 x1862023612440064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773738.816280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612440064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773738.816288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773738.816291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773738.816295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612440064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773738.816302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773735/real 1775773738] req@ffff8de1d0f2f100 x1862023612440192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773738.816313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612440192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773738.816320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773738.816324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773738.816327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773738.816333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773735/real 1775773738] req@ffff8de1d0f2df80 x1862023612440320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773738.816345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612440320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773738.816352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773738.816355:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773738.816359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440320:192.168.201.137@tcp:38:kworker.0 00010000:00010000:2.0:1775773739.775851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773740.799847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773740.863821:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773740.863831:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773740.863836:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773740.863846:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9712 00000100:00080000:2.0:1775773740.863857:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773740.863864:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773740.863898:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612440704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773740.863934:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773740.863939:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773740.863940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773740.863945:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9712 00000100:00080000:2.0:1775773740.863949:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773740.863953:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773740.863964:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773740.863978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612440832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773740.863979:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612440704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773740.863995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773740.863999:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773740.864001:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773740.864006:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9712 00000100:00080000:2.0:1775773740.864010:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773740.864015:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773740.864021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773740.864034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612440960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775773740.864038:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773740.864050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773740.864055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773740.864056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773740.864062:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9712 00000100:00080000:2.0:1775773740.864067:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773740.864072:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773740/real 1775773740] req@ffff8de1d0f2d500 x1862023612440704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773740.864073:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773740.864081:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773740.864095:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612441088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773740.864102:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612440704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773740.864112:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773740.864120:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773740.864123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773740.864124:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773740.864129:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9712 00000100:00080000:1.0:1775773740.864131:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775773740.864135:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773740.864138:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612440704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773740.864143:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773740.864151:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773740.864165:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612441216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773740.864168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773740.864198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773740.864210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773740/real 1775773740] req@ffff8de1d0f2e680 x1862023612440832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773740.864219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612440832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773740.864229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773740.864232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773740.864235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773740.864241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773740.864269:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773740.864280:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773740/real 1775773740] req@ffff8de1d0f2df80 x1862023612440960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773740.864292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612440960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773740.864301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773740.864304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773740.864307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612440960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773740.864314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773740.864335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773740.864347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773740/real 1775773740] req@ffff8de1d0f2f100 x1862023612441088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773740.864361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612441088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773740.864369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773740.864372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773740.864376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773740.864392:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773740.864442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773740.864451:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773740/real 1775773740] req@ffff8de1d0f2e300 x1862023612441216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773740.864462:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612441216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773740.864469:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773740.864472:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773740.864475:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773741.823866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773742.847865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773743.871851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773744.895959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773745.919868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773745.983895:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773745.983906:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773745.983912:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773745.983923:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9717 00000100:00080000:0.0:1775773745.983936:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773745.983943:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773745.983989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612441344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773745.984021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773745.984024:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773745.984026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773745.984029:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9717 00000100:00080000:0.0:1775773745.984031:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773745.984033:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773745.984043:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773745.984052:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612441472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773745.984060:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773745.984063:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773745.984065:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773745.984067:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9717 00000100:00080000:0.0:1775773745.984070:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773745.984073:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773745.984076:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773745.984087:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612441600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773745.984093:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773745.984099:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773745.984101:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773745.984102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612441344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773745.984106:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9717 00000100:00080000:0.0:1775773745.984116:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773745.984123:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773745.984126:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773745.984132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612441728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773745.984138:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773745.984141:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773745.984141:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773745.984144:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9717 00000100:00080000:0.0:1775773745.984148:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773745.984151:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773745.984154:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773745.984163:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612441856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775773745.984204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773745.984245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773745/real 1775773745] req@ffff8de1c5680000 x1862023612441344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773745.984262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612441344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773745.984271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773745.984274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773745.984277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612441344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773745.984283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773745.984300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773745.984308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773745/real 1775773745] req@ffff8de1c5680380 x1862023612441472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773745.984331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612441472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773745.984339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773745.984342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773745.984344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773745.984371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773745.984386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773745.984393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773745/real 1775773745] req@ffff8de1c5682a00 x1862023612441600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773745.984402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612441600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773745.984407:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773745.984409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773745.984411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773745.984415:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773745.984425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773745.984431:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773745/real 1775773745] req@ffff8de1c5681f80 x1862023612441728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773745.984438:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612441728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773745.984443:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773745.984445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773745.984448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773745.984451:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773745.984460:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773745.984465:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773745/real 1775773745] req@ffff8de1c5681c00 x1862023612441856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773745.984472:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612441856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773745.984477:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773745.984479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773745.984480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612441856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773746.943941:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773747.967879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773748.991918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773750.015911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773751.040004:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773751.103919:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773751.103930:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773751.103934:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773751.103944:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9722 00000100:00080000:0.0:1775773751.103958:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773751.103966:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773751.104008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612441984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773751.104038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773751.104044:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773751.104047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773751.104053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9722 00000100:00080000:0.0:1775773751.104058:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773751.104066:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773751.104080:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773751.104094:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612441984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773751.104104:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612442112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773751.104151:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773751.104155:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773751.104157:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773751.104161:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9722 00000100:00080000:0.0:1775773751.104166:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773751.104170:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775773751.104176:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773751.104181:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773751.104199:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612442240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773751.104211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773751/real 1775773751] req@ffff8de1c5682300 x1862023612441984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773751.104213:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773751.104225:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773751.104243:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773751.104248:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9722 00000100:00080000:0.0:1775773751.104256:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773751.104261:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773751.104266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612441984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775773751.104269:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775773751.104284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775773751.104286:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612442368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773751.104294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:0.0:1775773751.104302:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775773751.104306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612441984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773751.104307:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773751.104309:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773751.104317:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9722 00000100:00080000:0.0:1775773751.104320:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773751.104323:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773751.104326:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773751.104333:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612442496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773751.104342:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773751.104370:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773751.104381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773751/real 1775773751] req@ffff8de1c5680700 x1862023612442112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773751.104392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612442112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773751.104398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773751.104400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773751.104403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773751.104408:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773751.104426:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773751.104438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773751/real 1775773751] req@ffff8de1c5682d80 x1862023612442240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773751.104452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612442240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773751.104462:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773751.104466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773751.104470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773751.104477:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773751.104498:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773751.104507:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773751/real 1775773751] req@ffff8de1c5682680 x1862023612442368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773751.104516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612442368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773751.104522:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773751.104525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773751.104527:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773751.104541:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773751.104553:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773751.104560:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773751/real 1775773751] req@ffff8de1c5683b80 x1862023612442496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773751.104568:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612442496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773751.104574:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773751.104576:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773751.104578:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773752.063845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773753.087981:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773754.111899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773755.136022:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773756.159866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773756.223855:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773756.223863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773756.223867:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773756.223876:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9727 00000100:00080000:3.0:1775773756.223885:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773756.223890:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773756.223922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612442624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773756.223959:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773756.223962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773756.223964:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773756.223969:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9727 00000100:00080000:3.0:1775773756.223974:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773756.223980:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773756.223990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773756.223995:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612442624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773756.224008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612442752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773756.224022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773756.224027:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773756.224029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773756.224035:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9727 00000100:00080000:3.0:1775773756.224039:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773756.224045:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775773756.224053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775773756.224053:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773756.224073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612442880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773756.224085:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773756.224089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773756.224092:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773756.224093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773756/real 1775773756] req@ffff8de1c7af7800 x1862023612442624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773756.224102:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9727 00000100:00080000:3.0:1775773756.224110:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773756.224115:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773756.224118:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612442624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775773756.224124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773756.224128:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773756.224133:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773756.224160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612442624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773756.224183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773756.224208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773756.224231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773756/real 1775773756] req@ffff8de1c7af7100 x1862023612442752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773756.224248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612442752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773756.224254:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612443008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773756.224265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773756.224274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775773756.224277:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775773756.224282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442752:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773756.224284:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773756.224289:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773756.224294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773756.224329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773756.224340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773756/real 1775773756] req@ffff8de1c7af5180 x1862023612442880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773756.224354:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612442880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773756.224370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773756.224375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773756.224380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612442880:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775773756.224413:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9727 00000100:00100000:0.0:1775773756.224419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443008:192.168.201.137@tcp:8:kworker.0 00000100:00080000:3.0:1775773756.224420:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773756.224429:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773756.224437:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773756.224449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773756.224454:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612443136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773756.224464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773756/real 1775773756] req@ffff8de1c7af6d80 x1862023612443008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773756.224481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612443008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773756.224491:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773756.224497:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773756.224501:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773756.224548:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773756.224581:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773756.224598:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773756/real 1775773756] req@ffff8de1c7af7b80 x1862023612443136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773756.224611:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612443136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773756.224618:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773756.224621:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773756.224623:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773757.183997:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773758.207914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773759.231942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773760.256002:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773761.279918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773761.343945:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773761.343955:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773761.343961:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773761.343972:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9733 00000100:00080000:3.0:1775773761.343985:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773761.343993:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773761.344035:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612443264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773761.344108:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773761.344113:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773761.344116:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773761.344121:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9733 00000100:00080000:3.0:1775773761.344127:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773761.344131:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773761.344143:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773761.344159:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612443392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773761.344171:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773761.344175:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773761.344177:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773761.344181:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9733 00000100:00080000:3.0:1775773761.344184:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773761.344188:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773761.344194:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773761.344208:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612443520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773761.344229:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773761.344236:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:0.0:1775773761.344238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612443264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773761.344255:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773761.344267:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9733 00000100:00080000:3.0:1775773761.344271:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773761.344274:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773761.344280:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773761.344294:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612443648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773761.344304:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773761.344307:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773761.344310:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773761.344313:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9733 00000100:00080000:3.0:1775773761.344316:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773761.344319:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773761.344324:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773761.344334:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612443776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773761.344342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773761.344393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773761/real 1775773761] req@ffff8de1c7af7b80 x1862023612443264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773761.344413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612443264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773761.344425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773761.344429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773761.344433:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612443264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773761.344441:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773761.344461:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773761.344472:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773761/real 1775773761] req@ffff8de1c7af5880 x1862023612443392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773761.344484:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612443392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773761.344491:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773761.344494:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773761.344497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773761.344522:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773761.344538:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773761.344546:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773761/real 1775773761] req@ffff8de1c7af5f80 x1862023612443520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773761.344557:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612443520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773761.344565:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773761.344568:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773761.344571:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773761.344576:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773761.344590:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773761.344598:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773761/real 1775773761] req@ffff8de1c7af4a80 x1862023612443648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773761.344609:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612443648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773761.344616:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773761.344619:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773761.344622:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773761.344627:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773761.344640:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773761.344648:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773761/real 1775773761] req@ffff8de1c7af4e00 x1862023612443776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773761.344657:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612443776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773761.344665:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773761.344668:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773761.344671:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612443776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773762.303938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773763.327936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773764.352018:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773765.375893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773766.400049:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773766.463828:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773766.463842:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773766.463849:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773766.463863:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9738 00000100:00080000:3.0:1775773766.463879:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773766.463888:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773766.463938:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612443904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773766.464007:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773766.464011:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773766.464014:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773766.464019:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9738 00000100:00080000:3.0:1775773766.464023:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773766.464027:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773766.464041:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773766.464061:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612444032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773766.464072:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773766.464077:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773766.464079:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773766.464084:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9738 00000100:00080000:3.0:1775773766.464089:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773766.464098:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773766.464099:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612443904:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773766.464106:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773766.464123:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612444160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773766.464144:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773766.464149:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773766.464151:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773766.464156:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9738 00000100:00080000:3.0:1775773766.464160:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773766.464165:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773766.464172:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773766.464180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773766.464187:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612444288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773766.464199:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773766.464204:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773766.464207:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773766.464212:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9738 00000100:00080000:3.0:1775773766.464218:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773766.464222:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773766.464228:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773766.464236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773766/real 1775773766] req@ffff8de1c7af4380 x1862023612443904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773766.464243:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612444416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773766.464289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612443904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773766.464302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773766.464306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773766.464311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612443904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773766.464317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773766.464338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773766.464347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773766/real 1775773766] req@ffff8de1c7af4000 x1862023612444032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773766.464366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612444032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773766.464371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773766.464373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773766.464375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773766.464396:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773766.464406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773766.464412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773766/real 1775773766] req@ffff8de1c7af7480 x1862023612444160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773766.464419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612444160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773766.464424:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773766.464426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773766.464428:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773766.464433:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773766.464443:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773766.464448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773766/real 1775773766] req@ffff8de1c7af5500 x1862023612444288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773766.464456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612444288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773766.464460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773766.464463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773766.464464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773766.464468:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773766.464477:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773766.464481:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773766/real 1775773766] req@ffff8de1c7af5c00 x1862023612444416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773766.464488:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612444416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773766.464492:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773766.464494:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773766.464496:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773767.423877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773768.447961:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773769.471871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773770.495955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773771.519898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773771.583928:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773771.583938:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773771.583943:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773771.583953:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9743 00000100:00080000:2.0:1775773771.583965:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773771.583972:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773771.584012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612444544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773771.584042:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773771.584046:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773771.584047:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773771.584051:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9743 00000100:00080000:2.0:1775773771.584054:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773771.584058:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773771.584067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773771.584079:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612444672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773771.584090:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773771.584093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773771.584095:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773771.584101:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9743 00000100:00080000:2.0:1775773771.584104:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773771.584108:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773771.584113:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773771.584126:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612444800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773771.584139:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612444544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773771.584158:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773771.584163:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773771.584166:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773771.584175:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9743 00000100:00080000:2.0:1775773771.584181:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773771.584187:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773771.584196:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773771.584212:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612444928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773771.584221:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773771.584225:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773771.584226:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773771.584232:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9743 00000100:00080000:2.0:1775773771.584237:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773771.584240:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773771.584245:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773771.584251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773771.584262:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612445056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773771.584316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773771/real 1775773771] req@ffff8de1d0f2c700 x1862023612444544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773771.584339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612444544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773771.584359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773771.584363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773771.584367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612444544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773771.584379:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773771.584401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773771.584411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773771/real 1775773771] req@ffff8de1d0f2ca80 x1862023612444672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773771.584419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612444672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773771.584425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773771.584428:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773771.584430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773771.584454:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773771.584466:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773771.584472:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773771/real 1775773771] req@ffff8de1d0f2e300 x1862023612444800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773771.584480:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612444800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773771.584490:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773771.584493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773771.584495:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773771.584498:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773771.584508:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773771.584514:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773771/real 1775773771] req@ffff8de1d0f2f100 x1862023612444928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773771.584521:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612444928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773771.584526:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773771.584528:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773771.584530:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612444928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773771.584534:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773771.584544:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773771.584550:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773771/real 1775773771] req@ffff8de1d0f2df80 x1862023612445056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773771.584557:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612445056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773771.584562:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773771.584563:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773771.584566:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773772.543897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773773.567919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773774.591901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773775.615928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773776.639922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773776.703855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773776.703862:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773776.703866:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773776.703875:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9748 00000100:00080000:2.0:1775773776.703885:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773776.703891:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773776.703922:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612445184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773776.703945:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773776.703947:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773776.703949:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773776.703951:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9748 00000100:00080000:2.0:1775773776.703954:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773776.703956:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773776.703963:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773776.703972:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612445312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773776.703979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773776.703982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773776.703983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773776.703985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9748 00000100:00080000:2.0:1775773776.703987:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773776.703992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773776.703993:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612445184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773776.703997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773776.704008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612445440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773776.704015:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773776.704017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773776.704018:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773776.704021:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9748 00000100:00080000:2.0:1775773776.704024:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773776.704027:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773776.704032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773776.704043:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612445568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773776.704052:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773776.704055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773776.704057:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773776.704061:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9748 00000800:00000100:0.0:1775773776.704066:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773776.704066:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773776.704074:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773776.704079:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773776.704092:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612445696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773776.704111:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773776/real 1775773776] req@ffff8de1d0f2e680 x1862023612445184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773776.704131:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612445184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773776.704142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773776.704146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773776.704150:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612445184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773776.704157:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773776.704181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773776.704193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773776/real 1775773776] req@ffff8de1d0f2d500 x1862023612445312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773776.704206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612445312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773776.704214:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773776.704218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773776.704221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773776.704246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773776.704266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773776.704278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773776/real 1775773776] req@ffff8de1d0f2df80 x1862023612445440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773776.704289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612445440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773776.704298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773776.704301:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773776.704304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773776.704311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773776.704331:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773776.704341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773776/real 1775773776] req@ffff8de1d0f2f100 x1862023612445568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773776.704353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612445568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773776.704361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773776.704364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773776.704368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773776.704373:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773776.704392:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773776.704403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773776/real 1775773776] req@ffff8de1d0f2e300 x1862023612445696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773776.704414:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612445696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773776.704423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773776.704426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773776.704430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773777.663909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773778.687905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773779.711905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773780.735886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773781.759902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773781.823817:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773781.823844:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773781.823849:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773781.823859:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9753 00000100:00080000:3.0:1775773781.823872:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773781.823879:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773781.823914:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612445824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773781.823937:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773781.823941:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773781.823943:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773781.823947:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9753 00000100:00080000:3.0:1775773781.823952:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773781.823957:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773781.823967:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773781.823980:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612445952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773781.823981:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612445824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773781.823992:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773781.823995:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773781.823997:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773781.824000:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9753 00000100:00080000:3.0:1775773781.824004:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773781.824007:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773781.824012:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773781.824020:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612446080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773781.824028:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773781.824031:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773781.824033:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773781.824037:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773781.824037:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9753 00000100:00080000:3.0:1775773781.824040:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773781.824044:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773781.824048:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773781.824057:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612446208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773781.824069:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773781/real 1775773781] req@ffff8de1c7af6300 x1862023612445824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773781.824076:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773781.824079:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773781.824081:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773781.824084:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9753 00000100:00100000:0.0:1775773781.824087:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612445824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773781.824088:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773781.824091:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773781.824112:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773781.824115:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773781.824119:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773781.824122:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612446336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773781.824124:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612445824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773781.824149:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773781.824177:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773781.824190:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773781/real 1775773781] req@ffff8de1c7af4700 x1862023612445952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773781.824199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612445952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773781.824206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773781.824208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773781.824211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612445952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773781.824216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773781.824230:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773781.824237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773781/real 1775773781] req@ffff8de1c7af6680 x1862023612446080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773781.824246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612446080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773781.824251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773781.824253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773781.824255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773781.824259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773781.824270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773781.824276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773781/real 1775773781] req@ffff8de1c7af6a00 x1862023612446208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773781.824294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612446208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773781.824300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773781.824303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773781.824306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773781.824310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773781.824324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773781.824350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773781/real 1775773781] req@ffff8de1c7af5c00 x1862023612446336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773781.824364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612446336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773781.824373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773781.824377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773781.824381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773782.783900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773783.808025:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773784.831893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773785.855943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773786.879901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773786.943883:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773786.943894:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773786.943900:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773786.943910:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9758 00000100:00080000:1.0:1775773786.943921:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773786.943928:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773786.943964:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612446464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773786.943990:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773786.943993:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773786.943995:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773786.943998:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9758 00000100:00080000:1.0:1775773786.944001:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773786.944003:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773786.944011:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773786.944022:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612446592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773786.944031:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773786.944034:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773786.944036:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773786.944039:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9758 00000100:00080000:1.0:1775773786.944042:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773786.944047:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612446464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773786.944048:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773786.944057:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773786.944067:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612446720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773786.944075:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773786.944078:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773786.944079:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773786.944082:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9758 00000100:00080000:1.0:1775773786.944085:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773786.944094:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773786.944098:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773786.944109:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612446848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773786.944116:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773786.944125:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773786.944128:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773786.944129:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773786.944134:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9758 00000100:00080000:1.0:1775773786.944137:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773786.944140:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773786.944144:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773786.944158:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612446976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773786.944159:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773786/real 1775773786] req@ffff8de1c2e16a00 x1862023612446464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773786.944201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612446464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773786.944210:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773786.944215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773786.944219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612446464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773786.944225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773786.944243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773786.944252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773786/real 1775773786] req@ffff8de1c2e14380 x1862023612446592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773786.944261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612446592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773786.944272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773786.944275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773786.944277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773786.944316:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773786.944339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773786.944347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773786/real 1775773786] req@ffff8de1c2e16680 x1862023612446720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773786.944357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612446720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773786.944363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773786.944366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773786.944368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773786.944372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773786.944384:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773786.944391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773786/real 1775773786] req@ffff8de1c2e17b80 x1862023612446848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773786.944399:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612446848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773786.944405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773786.944407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773786.944410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773786.944415:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773786.944426:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773786.944442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773786/real 1775773786] req@ffff8de1c2e17100 x1862023612446976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773786.944451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612446976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773786.944457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773786.944476:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773786.944478:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612446976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773787.903910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773788.927866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773789.951926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773790.975839:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773791.999944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773792.063912:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773792.063920:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773792.063924:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773792.063932:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9763 00000100:00080000:1.0:1775773792.063942:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773792.063949:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773792.063982:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612447104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773792.064007:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773792.064014:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773792.064016:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773792.064021:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9763 00000100:00080000:1.0:1775773792.064025:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773792.064030:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773792.064040:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773792.064055:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612447232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773792.064068:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773792.064071:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773792.064073:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773792.064078:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9763 00000100:00080000:1.0:1775773792.064082:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773792.064086:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773792.064092:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612447104:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775773792.064094:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773792.064110:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612447360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773792.064121:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773792.064124:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773792.064127:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773792.064131:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9763 00000100:00080000:1.0:1775773792.064136:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773792.064141:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773792.064147:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773792.064158:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612447488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773792.064183:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775773792.064191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773792.064193:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773792.064200:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773792.064209:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9763 00000100:00080000:1.0:1775773792.064217:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773792.064226:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773792.064235:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773792.064261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773792/real 1775773792] req@ffff8de1c2e17800 x1862023612447104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773792.064261:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612447616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773792.064330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612447104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773792.064367:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773792.064375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773792.064381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612447104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773792.064393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773792.064453:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773792.064475:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773792/real 1775773792] req@ffff8de1c2e15500 x1862023612447232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773792.064495:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612447232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773792.064504:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773792.064507:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773792.064537:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773792.064571:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773792.064609:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773792.064628:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773792/real 1775773792] req@ffff8de1c2e14700 x1862023612447360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773792.064642:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612447360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773792.064651:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773792.064655:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773792.064659:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773792.064666:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773792.064685:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773792.064693:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773792/real 1775773792] req@ffff8de1c2e17480 x1862023612447488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773792.064705:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612447488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773792.064714:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773792.064718:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773792.064772:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773792.064779:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773792.064800:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773792.064812:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773792/real 1775773792] req@ffff8de1c2e14a80 x1862023612447616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773792.064824:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612447616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773792.064832:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773792.064836:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773792.064840:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773793.023854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773794.047907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773795.071958:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773796.095913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773797.119933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773797.183850:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773797.183859:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773797.183863:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773797.183872:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9768 00000100:00080000:3.0:1775773797.183883:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773797.183889:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773797.183922:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612447744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773797.183948:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773797.183951:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773797.183953:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773797.183956:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9768 00000100:00080000:3.0:1775773797.183958:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773797.183960:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773797.183969:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773797.183982:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612447872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773797.183991:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773797.183993:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773797.183996:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773797.183999:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9768 00000100:00080000:3.0:1775773797.184000:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773797.184003:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773797.184007:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773797.184016:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612447744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773797.184018:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612448000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773797.184041:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773797.184043:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773797.184044:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773797.184048:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9768 00000100:00080000:3.0:1775773797.184050:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773797.184052:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773797.184056:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773797.184068:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612448128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773797.184075:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773797.184078:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773797.184080:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773797.184083:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9768 00000100:00080000:3.0:1775773797.184086:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773797.184089:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773797.184092:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773797.184099:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612448256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773797.184117:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773797.184159:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773797/real 1775773797] req@ffff8de1c7af5500 x1862023612447744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773797.184176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612447744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773797.184185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773797.184189:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773797.184192:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612447744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773797.184199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773797.184215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773797.184223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773797/real 1775773797] req@ffff8de1c7af7480 x1862023612447872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773797.184232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612447872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773797.184237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773797.184239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773797.184241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612447872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773797.184267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773797.184278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773797.184284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773797/real 1775773797] req@ffff8de1c7af4000 x1862023612448000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773797.184292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612448000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773797.184297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773797.184298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773797.184300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773797.184304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773797.184315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773797.184320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773797/real 1775773797] req@ffff8de1c7af4380 x1862023612448128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773797.184328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612448128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773797.184333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773797.184335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773797.184337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773797.184340:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773797.184350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773797.184355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773797/real 1775773797] req@ffff8de1c7af4e00 x1862023612448256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773797.184361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612448256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773797.184366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773797.184368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773797.184370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773798.143987:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773799.167873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773800.191933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773801.215953:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773802.239935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773802.303854:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773802.303864:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773802.303870:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773802.303880:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9774 00000100:00080000:3.0:1775773802.303893:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773802.303900:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773802.303949:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612448384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773802.304002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773802.304012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773802.304015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773802.304020:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9774 00000100:00080000:3.0:1775773802.304026:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773802.304030:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773802.304043:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773802.304062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612448512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773802.304064:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612448384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773802.304077:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773802.304081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773802.304083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773802.304088:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9774 00000100:00080000:3.0:1775773802.304092:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773802.304096:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773802.304102:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773802.304112:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612448640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773802.304142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773802.304145:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773802.304147:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773802.304151:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9774 00000100:00080000:3.0:1775773802.304154:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773802.304158:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773802.304163:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773802.304171:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612448768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773802.304180:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773802.304184:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773802.304185:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773802.304199:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9774 00000100:00080000:3.0:1775773802.304202:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773802.304206:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773802.304211:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773802.304221:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612448896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773802.304252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773802.304293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773802.304322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773802.304388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773803.263902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773804.287869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773805.311924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773805.376133:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775773805.376182:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773805.376200:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773805.376242:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773805.376249:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773805.376255:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773805.376262:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775773805.376315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773802/real 1775773805] req@ffff8de1c7af5f80 x1862023612448512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773805.376341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612448512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773805.376356:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773805.376360:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773805.376364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773805.376370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773802/real 1775773805] req@ffff8de1c7af5880 x1862023612448640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773805.376379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612448640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773805.376383:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773805.376386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773805.376388:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773805.376395:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773802/real 1775773805] req@ffff8de1c7af7b80 x1862023612448768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773805.376409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612448768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773805.376417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773805.376421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773805.376425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773805.376433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773802/real 1775773805] req@ffff8de1c7af6d80 x1862023612448896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773805.376457:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612448896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773805.376465:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773805.376469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773805.376472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612448896:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773805.376479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773802/real 1775773805] req@ffff8de1c7af4a80 x1862023612448384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773805.376493:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612448384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773805.376502:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773805.376506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773805.376509:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612448384:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775773806.335878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773807.359930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773807.423851:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773807.423863:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773807.423867:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773807.423878:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9779 00000100:00080000:3.0:1775773807.423891:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773807.423898:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773807.423936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612449024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773807.423962:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773807.423966:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773807.423967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773807.423970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9779 00000100:00080000:3.0:1775773807.423973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773807.423975:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773807.423986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773807.424000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612449152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773807.424011:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773807.424015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773807.424017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773807.424024:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9779 00000100:00080000:3.0:1775773807.424028:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773807.424032:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773807.424038:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612449024:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773807.424041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773807.424059:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612449280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773807.424071:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773807.424075:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773807.424077:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773807.424082:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9779 00000100:00080000:3.0:1775773807.424087:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773807.424092:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773807.424098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773807.424121:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612449408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773807.424128:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773807.424133:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773807.424136:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773807.424138:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773807.424142:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9779 00000100:00080000:3.0:1775773807.424146:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773807.424149:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773807.424153:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773807.424161:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612449536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773807.424188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773807/real 1775773807] req@ffff8de1c7af5180 x1862023612449024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773807.424212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612449024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773807.424226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773807.424232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773807.424237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612449024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773807.424284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773807.424319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773807.424334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773807/real 1775773807] req@ffff8de1c7af7100 x1862023612449152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773807.424348:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612449152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773807.424356:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773807.424359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773807.424364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773807.424399:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773807.424428:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773807.424441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773807/real 1775773807] req@ffff8de1c7af7800 x1862023612449280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773807.424454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612449280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773807.424463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773807.424468:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773807.424473:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773807.424480:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773807.424504:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773807.424517:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773807/real 1775773807] req@ffff8de1c7af4a80 x1862023612449408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773807.424530:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612449408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773807.424538:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773807.424542:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773807.424545:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773807.424555:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773807.424576:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773807.424592:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773807/real 1775773807] req@ffff8de1c7af6d80 x1862023612449536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773807.424605:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612449536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773807.424613:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773807.424618:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773807.424622:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773808.384838:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773809.407997:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773810.431924:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773811.455988:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773812.479877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773812.543841:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773812.543851:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773812.543856:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773812.543867:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9784 00000100:00080000:0.0:1775773812.543880:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773812.543888:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773812.543932:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612449664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773812.543962:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773812.543967:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773812.543969:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773812.543975:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9784 00000100:00080000:0.0:1775773812.543980:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773812.543985:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773812.543996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773812.544000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612449664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773812.544024:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612449792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773812.544038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773812.544042:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773812.544044:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773812.544048:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9784 00000100:00080000:0.0:1775773812.544055:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773812.544060:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773812.544066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:3.0:1775773812.544067:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773812.544083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612449920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773812.544095:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773812.544099:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773812.544102:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773812.544108:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9784 00000100:00100000:3.0:1775773812.544109:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773812/real 1775773812] req@ffff8de1c5683b80 x1862023612449664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773812.544114:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773812.544122:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773812.544131:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773812.544140:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612449664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773812.544146:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612450048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773812.544171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773812.544178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:0.0:1775773812.544179:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775773812.544184:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612449664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773812.544186:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773812.544190:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773812.544197:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9784 00000100:00080000:0.0:1775773812.544202:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773812.544206:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773812.544210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449792:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775773812.544212:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773812.544231:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612450176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773812.544241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773812.544264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773812/real 1775773812] req@ffff8de1c5682680 x1862023612449792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773812.544278:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612449792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773812.544287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773812.544290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773812.544294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773812.544304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773812.544326:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773812.544336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773812/real 1775773812] req@ffff8de1c5682d80 x1862023612449920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773812.544349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612449920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773812.544357:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773812.544361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773812.544365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612449920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773812.544371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773812.544393:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773812.544402:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773812/real 1775773812] req@ffff8de1c5680700 x1862023612450048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773812.544410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612450048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773812.544415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773812.544417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773812.544419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773812.544431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773812.544442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773812.544448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773812/real 1775773812] req@ffff8de1c5682300 x1862023612450176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773812.544455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612450176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773812.544460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773812.544462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773812.544464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773813.503876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773814.527902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773815.551846:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773816.575870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773817.599882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773817.663809:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773817.663819:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773817.663824:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773817.663835:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9789 00000100:00080000:3.0:1775773817.663846:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773817.663853:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773817.663890:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612450304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773817.663913:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773817.663916:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773817.663917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773817.663921:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9789 00000100:00080000:3.0:1775773817.663924:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773817.663929:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773817.663940:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773817.663954:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612450304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773817.663958:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612450432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773817.663973:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773817.663977:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773817.663978:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773817.663983:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9789 00000100:00080000:3.0:1775773817.663988:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773817.663992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773817.663996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773817.664005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612450560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773817.664013:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773817.664017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773817.664020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773817.664021:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773817.664023:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9789 00000100:00080000:3.0:1775773817.664028:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773817.664030:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773817.664033:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773817.664042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612450688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773817.664049:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773817.664051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773817.664053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773817.664057:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773817/real 1775773817] req@ffff8de1c7af7b80 x1862023612450304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773817.664060:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9789 00000100:00080000:3.0:1775773817.664082:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773817.664086:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773817.664092:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773817.664094:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612450304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773817.664103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612450816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773817.664104:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773817.664113:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773817.664119:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612450304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773817.664138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773817.664155:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773817.664164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773817/real 1775773817] req@ffff8de1c7af5880 x1862023612450432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773817.664172:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612450432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773817.664178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773817.664180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773817.664183:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773817.664186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773817.664196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773817.664202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773817/real 1775773817] req@ffff8de1c7af5f80 x1862023612450560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773817.664208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612450560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773817.664213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773817.664215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773817.664217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773817.664220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773817.664231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773817.664240:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773817/real 1775773817] req@ffff8de1c7af4e00 x1862023612450688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773817.664252:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612450688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773817.664260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773817.664263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773817.664267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773817.664273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773817.664292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773817.664300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773817/real 1775773817] req@ffff8de1c7af4380 x1862023612450816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773817.664307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612450816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773817.664313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773817.664315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773817.664317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612450816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773818.623905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773819.647933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773820.671932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773821.695901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773822.719986:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773822.783865:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773822.783879:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773822.783886:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773822.783898:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9794 00000100:00080000:0.0:1775773822.783911:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773822.783920:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773822.783964:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612450944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773822.784015:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773822.784019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773822.784020:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773822.784026:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9794 00000100:00080000:0.0:1775773822.784031:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773822.784036:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773822.784050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773822.784052:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612450944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773822.784068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612451072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773822.784081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773822.784084:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773822.784086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773822.784089:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9794 00000100:00080000:0.0:1775773822.784092:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773822.784095:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773822.784100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773822.784110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612451200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773822.784126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773822.784129:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773822.784131:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773822.784134:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9794 00000100:00080000:0.0:1775773822.784137:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773822.784141:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775773822.784144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773822.784148:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773822.784156:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612451328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773822.784163:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773822.784166:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773822.784168:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773822.784170:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9794 00000100:00080000:0.0:1775773822.784183:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773822.784186:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773822.784189:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773822.784196:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612451456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773822.784209:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773822/real 1775773822] req@ffff8de1c5681c00 x1862023612450944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773822.784234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612450944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773822.784247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773822.784252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773822.784257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612450944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773822.784286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773822.784314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773822.784328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773822/real 1775773822] req@ffff8de1c5681f80 x1862023612451072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773822.784342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612451072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773822.784352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773822.784356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773822.784359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773822.784366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773822.784389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773822.784401:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773822/real 1775773822] req@ffff8de1c5682a00 x1862023612451200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773822.784413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612451200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773822.784423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773822.784426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773822.784430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773822.784437:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773822.784468:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773822.784480:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773822/real 1775773822] req@ffff8de1c5680380 x1862023612451328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773822.784494:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612451328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773822.784503:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773822.784507:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773822.784511:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773822.784518:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773822.784540:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773822.784550:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773822/real 1775773822] req@ffff8de1c5680000 x1862023612451456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773822.784573:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612451456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773822.784582:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773822.784586:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773822.784590:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773823.743904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773824.767953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773825.791849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773826.815875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773827.839878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773827.903839:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773827.903848:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773827.903852:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773827.903860:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9799 00000100:00080000:3.0:1775773827.903870:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773827.903876:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773827.903921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612451584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773827.903947:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773827.903950:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773827.903952:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773827.903956:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9799 00000100:00080000:3.0:1775773827.903960:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773827.903964:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773827.903973:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612451584:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773827.903974:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773827.903988:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612451712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773827.903998:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773827.904001:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773827.904003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773827.904006:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9799 00000100:00080000:3.0:1775773827.904009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773827.904012:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773827.904016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773827.904024:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612451840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773827.904031:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773827.904033:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773827.904037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773827.904038:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773827.904049:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9799 00000100:00080000:3.0:1775773827.904053:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773827.904057:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773827.904062:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773827.904073:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773827/real 1775773827] req@ffff8de1c7af4000 x1862023612451584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773827.904074:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612451968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773827.904103:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612451584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773827.904114:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773827.904119:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773827.904123:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612451584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773827.904145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773827.904166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773827.904176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773827/real 1775773827] req@ffff8de1c7af7480 x1862023612451712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773827.904186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612451712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773827.904191:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773827.904194:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773827.904196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773827.904200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773827.904212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773827.904218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773827/real 1775773827] req@ffff8de1c7af5500 x1862023612451840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773827.904226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612451840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773827.904232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773827.904234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773827.904238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773827.904248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451968:192.168.201.137@tcp:8:kworker.0 00000100:00080000:3.0:1775773827.904259:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775773827.904262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773827.904266:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773827.904268:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773827.904274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773827/real 1775773827] req@ffff8de1c7af5c00 x1862023612451968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773827.904275:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9799 00000100:00080000:3.0:1775773827.904281:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773827.904292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612451968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773827.904298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773827.904302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773827.904305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612451968:192.168.201.137@tcp:8:kworker.0 00000100:00080000:3.0:1775773827.904322:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773827.904327:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773827.904339:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612452096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773827.904377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773827.904406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773827.904420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773827/real 1775773827] req@ffff8de1c7af6a00 x1862023612452096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773827.904432:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612452096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773827.904438:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773827.904441:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773827.904443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773828.863914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773829.887925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773830.911878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773831.935898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773832.959873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773833.023849:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773833.023856:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773833.023860:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773833.023868:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9804 00000100:00080000:3.0:1775773833.023878:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773833.023883:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773833.023915:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612452224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773833.023939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773833.023942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773833.023944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773833.023947:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9804 00000100:00080000:3.0:1775773833.023949:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773833.023952:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773833.023959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773833.023967:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612452352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773833.023974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773833.023977:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773833.023978:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773833.023981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9804 00000100:00080000:3.0:1775773833.023982:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773833.023985:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773833.023988:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773833.023995:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612452224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773833.023998:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612452480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773833.024009:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773833.024011:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773833.024012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773833.024014:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9804 00000100:00080000:3.0:1775773833.024016:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773833.024018:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773833.024022:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773833.024028:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612452608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773833.024034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773833.024037:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773833.024038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773833.024040:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9804 00000100:00080000:3.0:1775773833.024042:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773833.024044:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773833.024047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773833.024053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612452736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773833.024071:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773833.024105:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773833/real 1775773833] req@ffff8de1c7af6a00 x1862023612452224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773833.024123:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612452224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773833.024134:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773833.024138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773833.024142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612452224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773833.024150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773833.024170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773833.024181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773833/real 1775773833] req@ffff8de1c7af6680 x1862023612452352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773833.024202:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612452352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773833.024211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773833.024215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773833.024218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773833.024241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773833.024258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773833.024267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773833/real 1775773833] req@ffff8de1c7af4700 x1862023612452480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773833.024280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612452480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773833.024288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773833.024291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773833.024294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773833.024299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773833.024314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773833.024323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773833/real 1775773833] req@ffff8de1c7af6300 x1862023612452608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773833.024334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612452608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773833.024350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773833.024353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773833.024357:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773833.024361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773833.024377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773833.024386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773833/real 1775773833] req@ffff8de1c7af5c00 x1862023612452736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773833.024397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612452736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773833.024405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773833.024408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773833.024411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773833.983926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773835.007875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773836.031947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773837.055914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773838.079859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773838.143780:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773838.143788:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773838.143792:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773838.143800:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9809 00000100:00080000:3.0:1775773838.143810:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773838.143817:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773838.143856:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612452864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773838.143883:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773838.143886:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773838.143887:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773838.143891:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9809 00000100:00080000:3.0:1775773838.143894:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773838.143897:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773838.143904:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773838.143916:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612452992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773838.143924:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773838.143927:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773838.143928:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773838.143930:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9809 00000100:00080000:3.0:1775773838.143932:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773838.143937:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773838.143939:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612452864:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773838.143941:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773838.143954:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612453120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773838.143971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773838.143974:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773838.143976:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773838.143981:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9809 00000100:00080000:3.0:1775773838.143986:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773838.143990:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773838.143997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773838.144003:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773838.144011:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612453248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773838.144019:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773838.144022:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773838.144023:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773838.144026:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9809 00000100:00080000:3.0:1775773838.144030:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773838.144033:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773838.144037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773838.144042:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773838/real 1775773838] req@ffff8de1c7af5500 x1862023612452864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773838.144047:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612453376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773838.144079:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612452864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773838.144091:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773838.144097:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773838.144101:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612452864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773838.144110:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773838.144134:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773838.144158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773838/real 1775773838] req@ffff8de1c7af7480 x1862023612452992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773838.144172:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612452992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773838.144180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773838.144184:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773838.144188:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612452992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773838.144213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773838.144235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773838.144246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773838/real 1775773838] req@ffff8de1c7af4000 x1862023612453120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773838.144259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612453120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773838.144267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773838.144271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773838.144274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773838.144281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773838.144314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773838.144325:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773838/real 1775773838] req@ffff8de1c7af4380 x1862023612453248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773838.144339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612453248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773838.144347:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773838.144350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773838.144353:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773838.144359:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773838.144374:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773838.144382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773838/real 1775773838] req@ffff8de1c7af4e00 x1862023612453376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773838.144390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612453376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773838.144395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773838.144397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773838.144399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775773839.103855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773840.127906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773841.151850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773842.175888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773843.199863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773843.263823:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773843.263832:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773843.263836:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773843.263845:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9815 00000100:00080000:3.0:1775773843.263856:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773843.263864:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773843.263901:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612453504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773843.263931:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773843.263934:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773843.263936:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773843.263939:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9815 00000100:00080000:3.0:1775773843.263943:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773843.263946:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773843.263955:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773843.263968:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612453632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773843.263977:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773843.263980:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773843.263981:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773843.263987:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9815 00000100:00100000:0.0:1775773843.263989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612453504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773843.263990:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773843.263994:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773843.264001:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773843.264008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612453760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773843.264021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773843.264024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773843.264025:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773843.264027:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9815 00000100:00080000:3.0:1775773843.264029:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773843.264032:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773843.264035:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773843.264042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612453888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773843.264049:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773843.264051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773843.264053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773843.264057:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9815 00000800:00000100:0.0:1775773843.264059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773843.264060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773843.264064:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773843.264067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773843.264075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612454016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773843.264099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773843/real 1775773843] req@ffff8de1c7af5f80 x1862023612453504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773843.264118:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612453504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773843.264136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773843.264140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773843.264144:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612453504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773843.264152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773843.264173:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773843.264186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773843/real 1775773843] req@ffff8de1c7af5880 x1862023612453632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773843.264200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612453632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773843.264209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773843.264213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773843.264216:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773843.264241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773843.264262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773843.264273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773843/real 1775773843] req@ffff8de1c7af7b80 x1862023612453760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773843.264286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612453760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773843.264295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773843.264298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773843.264302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773843.264309:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773843.264327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773843.264337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773843/real 1775773843] req@ffff8de1c7af6d80 x1862023612453888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773843.264361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612453888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773843.264370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773843.264373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773843.264377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612453888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773843.264383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773843.264403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773843.264413:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773843/real 1775773843] req@ffff8de1c7af4a80 x1862023612454016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773843.264425:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612454016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773843.264434:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773843.264437:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773843.264441:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773844.223887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773845.247876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773846.271879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775773847.295949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773848.319966:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773848.383855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773848.383868:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773848.383874:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773848.383888:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9820 00000100:00080000:1.0:1775773848.383904:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773848.383914:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773848.383964:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612454144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773848.383996:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773848.384001:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773848.384003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773848.384008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9820 00000100:00080000:1.0:1775773848.384013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773848.384017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773848.384030:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773848.384048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612454272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773848.384056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612454144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773848.384065:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773848.384070:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773848.384072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773848.384077:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9820 00000100:00080000:1.0:1775773848.384082:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773848.384086:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773848.384092:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773848.384106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612454400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773848.384117:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773848.384121:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773848.384123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773848.384136:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9820 00000100:00080000:1.0:1775773848.384141:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773848.384145:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775773848.384150:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775773848.384152:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773848.384166:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612454528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773848.384177:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773848.384181:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773848.384183:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773848.384188:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9820 00000100:00080000:1.0:1775773848.384192:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773848.384198:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773848/real 1775773848] req@ffff8de1c2e14e00 x1862023612454144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773848.384201:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773848.384210:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773848.384225:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612454656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773848.384229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612454144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773848.384255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773848.384260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773848.384265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612454144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773848.384303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773848.384327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773848.384339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773848/real 1775773848] req@ffff8de1c2e14a80 x1862023612454272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773848.384352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612454272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773848.384369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773848.384372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773848.384376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773848.384383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773848.384401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773848.384411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773848/real 1775773848] req@ffff8de1c2e17480 x1862023612454400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773848.384424:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612454400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773848.384439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773848.384443:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773848.384446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773848.384452:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773848.384469:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773848.384477:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773848/real 1775773848] req@ffff8de1c2e14700 x1862023612454528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773848.384489:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612454528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773848.384498:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773848.384501:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773848.384504:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773848.384511:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773848.384541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773848.384551:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773848/real 1775773848] req@ffff8de1c2e15500 x1862023612454656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773848.384564:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612454656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773848.384574:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773848.384577:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773848.384581:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773849.343949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773850.367973:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773851.391966:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773852.415902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773853.439874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773853.503810:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773853.503819:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773853.503823:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773853.503831:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9825 00000100:00080000:3.0:1775773853.503841:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773853.503847:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773853.503878:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612454784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773853.503903:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773853.503906:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773853.503907:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773853.503910:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9825 00000100:00080000:3.0:1775773853.503912:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773853.503914:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773853.503921:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773853.503931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612454912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773853.503938:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773853.503940:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773853.503941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773853.503944:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9825 00000100:00080000:3.0:1775773853.503946:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773853.503948:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773853.503951:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773853.503957:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612455040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773853.503964:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612454784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773853.503978:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773853.503980:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773853.503981:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773853.503984:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9825 00000100:00080000:3.0:1775773853.503986:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773853.503989:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773853.503992:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773853.504000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612455168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773853.504005:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773853.504007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773853.504008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773853.504010:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9825 00000100:00080000:3.0:1775773853.504012:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773853.504014:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773853.504018:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773853.504025:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612455296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773853.504033:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773853.504068:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773853/real 1775773853] req@ffff8de1c7af7800 x1862023612454784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773853.504098:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612454784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773853.504110:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773853.504115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773853.504120:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612454784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773853.504127:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773853.504149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773853.504161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773853/real 1775773853] req@ffff8de1c7af7100 x1862023612454912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773853.504182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612454912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773853.504193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773853.504196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773853.504200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612454912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773853.504228:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773853.504249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773853.504260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773853/real 1775773853] req@ffff8de1c7af5180 x1862023612455040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773853.504273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612455040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773853.504282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773853.504286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773853.504290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773853.504296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773853.504312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773853.504321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773853/real 1775773853] req@ffff8de1c7af4a80 x1862023612455168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773853.504333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612455168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773853.504342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773853.504346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773853.504349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773853.504355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773853.504371:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773853.504380:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773853/real 1775773853] req@ffff8de1c7af6d80 x1862023612455296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773853.504394:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612455296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773853.504402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773853.504406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773853.504409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773854.463907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773855.487907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773856.511854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773857.535889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773858.559890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773858.623919:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773858.623927:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773858.623931:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773858.623938:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9830 00000100:00080000:2.0:1775773858.623948:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773858.623953:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773858.623984:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612455424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773858.623999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773858.624002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773858.624003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773858.624005:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9830 00000100:00080000:2.0:1775773858.624008:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773858.624010:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773858.624017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773858.624023:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612455552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773858.624029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773858.624031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773858.624033:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773858.624035:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9830 00000100:00080000:2.0:1775773858.624037:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773858.624039:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773858.624042:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773858.624049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612455680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773858.624054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773858.624056:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773858.624057:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773858.624059:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9830 00000100:00080000:2.0:1775773858.624061:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773858.624063:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773858.624066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773858.624071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612455808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773858.624076:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773858.624077:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773858.624078:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773858.624080:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9830 00000100:00080000:2.0:1775773858.624082:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773858.624083:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773858.624086:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773858.624091:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612455936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773858.624152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612455424:192.168.201.137@tcp:250:kworker.0 00000800:00000100:0.0:1775773858.624202:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773858.624225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773858/real 1775773858] req@ffff8de1d0f2ca80 x1862023612455424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773858.624246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612455424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773858.624255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773858.624258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773858.624260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612455424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773858.624266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773858.624280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773858.624287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773858/real 1775773858] req@ffff8de1d0f2c700 x1862023612455552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773858.624294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612455552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773858.624300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773858.624303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773858.624305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773858.624308:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773858.624317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773858.624322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773858/real 1775773858] req@ffff8de1d0f2e300 x1862023612455680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773858.624329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612455680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773858.624334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773858.624336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773858.624337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773858.624341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773858.624368:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773858.624375:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773858/real 1775773858] req@ffff8de1d0f2f100 x1862023612455808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773858.624382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612455808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773858.624387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773858.624389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773858.624392:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773858.624395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773858.624405:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773858.624410:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773858/real 1775773858] req@ffff8de1d0f2df80 x1862023612455936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773858.624416:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612455936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773858.624421:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773858.624423:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773858.624425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612455936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773859.583874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773860.607865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773861.631858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773862.655897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773863.679851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773863.743790:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773863.743798:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773863.743802:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773863.743811:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9835 00000100:00080000:2.0:1775773863.743820:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773863.743825:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773863.743858:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612456064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773863.743879:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773863.743882:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773863.743883:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773863.743887:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9835 00000100:00080000:2.0:1775773863.743890:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773863.743893:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773863.743902:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773863.743910:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612456192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773863.743918:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773863.743921:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773863.743924:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773863.743927:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612456064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773863.743932:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9835 00000100:00080000:2.0:1775773863.743939:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773863.743943:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773863.743949:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773863.743963:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612456320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773863.743974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773863.743978:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773863.743981:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773863.743987:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9835 00000800:00000100:0.0:1775773863.743992:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773863.743994:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773863.744000:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773863.744008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773863.744023:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612456448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773863.744026:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773863/real 1775773863] req@ffff8de1d0f2d500 x1862023612456064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773863.744054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773863.744057:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773863.744058:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773863.744061:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612456064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773863.744064:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9835 00000100:00080000:2.0:1775773863.744070:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773863.744075:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775773863.744076:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:2.0:1775773863.744080:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773863.744083:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773863.744088:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612456064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773863.744094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612456576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773863.744118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773863.744137:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773863.744148:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773863/real 1775773863] req@ffff8de1d0f2e680 x1862023612456192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773863.744162:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612456192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773863.744171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773863.744176:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773863.744180:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773863.744188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773863.744209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773863.744229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773863/real 1775773863] req@ffff8de1d0f2df80 x1862023612456320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773863.744243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612456320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773863.744252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773863.744274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773863.744278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773863.744286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773863.744310:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773863.744326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773863/real 1775773863] req@ffff8de1d0f2f100 x1862023612456448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773863.744345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612456448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773863.744354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773863.744359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773863.744363:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773863.744370:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773863.744396:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773863.744415:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773863/real 1775773863] req@ffff8de1d0f2e300 x1862023612456576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773863.744428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612456576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773863.744437:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773863.744440:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773863.744443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773864.703857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773865.727891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773866.751919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773867.775934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773868.799852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773868.863803:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773868.863817:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773868.863821:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773868.863831:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9840 00000100:00080000:2.0:1775773868.863842:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773868.863849:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773868.863882:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612456704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773868.863909:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773868.863913:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773868.863915:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773868.863920:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9840 00000100:00080000:2.0:1775773868.863925:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773868.863929:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773868.863938:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773868.863944:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612456704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773868.863953:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612456832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773868.863965:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773868.863969:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773868.863970:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773868.863974:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9840 00000100:00080000:2.0:1775773868.863977:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773868.863980:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773868.863984:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773868.863992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612456960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773868.863999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773868.864002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773868.864003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773868.864006:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9840 00000100:00080000:2.0:1775773868.864008:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773868.864010:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773868.864014:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773868.864022:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612457088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773868.864030:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773868.864032:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773868.864034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773868.864038:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456832:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773868.864038:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9840 00000100:00080000:2.0:1775773868.864042:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773868.864046:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773868.864049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773868.864059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612457216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773868.864081:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773868.864109:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773868.864133:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773869.823926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773870.847852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773871.871872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773871.935971:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775773871.936022:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773871.936042:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773871.936082:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773871.936090:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773871.936099:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773871.936108:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775773871.936154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773868/real 1775773871] req@ffff8de1d0f2df80 x1862023612457216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773871.936182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612457216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773871.936200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773871.936206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773871.936211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457216:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773871.936220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773868/real 1775773871] req@ffff8de1d0f2ca80 x1862023612456832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773871.936234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612456832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773871.936242:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773871.936246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773871.936250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773871.936272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773868/real 1775773871] req@ffff8de1d0f2e300 x1862023612456960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773871.936287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612456960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773871.936302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773871.936317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773871.936322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612456960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773871.936331:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773868/real 1775773871] req@ffff8de1d0f2f100 x1862023612457088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773871.936346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612457088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773871.936353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773871.936356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773871.936359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773871.936365:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773868/real 1775773871] req@ffff8de1d0f2c700 x1862023612456704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773871.936378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612456704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773871.936386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773871.936389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773871.936392:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612456704:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775773872.895821:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773873.919856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773873.983871:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773873.983878:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773873.983882:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773873.983890:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9845 00000100:00080000:0.0:1775773873.983899:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773873.983904:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773873.983933:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612457344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773873.983958:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773873.983961:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773873.983962:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773873.983965:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9845 00000100:00080000:0.0:1775773873.983967:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773873.983969:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773873.983977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773873.983985:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612457472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773873.983992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773873.983995:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773873.983996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773873.984010:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9845 00000100:00080000:0.0:1775773873.984012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773873.984014:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773873.984017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773873.984024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612457600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773873.984025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612457344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773873.984043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773873.984046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773873.984047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773873.984057:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9845 00000100:00080000:0.0:1775773873.984060:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773873.984064:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773873.984070:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773873.984099:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612457728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773873.984108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773873.984122:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773873.984126:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775773873.984127:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775773873.984132:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9845 00000100:00080000:0.0:1775773873.984138:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773873.984142:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773873.984147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773873.984157:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612457856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773873.984168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773873/real 1775773873] req@ffff8de1c5683480 x1862023612457344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773873.984205:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612457344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773873.984217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773873.984222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773873.984226:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612457344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773873.984234:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773873.984276:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773873.984289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773873/real 1775773873] req@ffff8de1c5681500 x1862023612457472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773873.984302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612457472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773873.984320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773873.984323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773873.984327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773873.984353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773873.984378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773873.984392:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773873/real 1775773873] req@ffff8de1c5681880 x1862023612457600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773873.984404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612457600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773873.984417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773873.984420:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773873.984424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773873.984430:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773873.984450:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773873.984461:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773873/real 1775773873] req@ffff8de1c5680e00 x1862023612457728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773873.984473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612457728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773873.984482:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773873.984485:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773873.984488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773873.984494:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773873.984512:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773873.984522:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773873/real 1775773873] req@ffff8de1c5683800 x1862023612457856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773873.984534:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612457856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773873.984542:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773873.984545:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773873.984549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612457856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773874.943871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773875.967828:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773876.991963:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773878.015860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773879.039917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773879.103893:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773879.103902:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773879.103906:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773879.103913:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9850 00000100:00080000:1.0:1775773879.103924:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773879.103929:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773879.103961:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612457984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773879.104017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773879.104022:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773879.104024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773879.104030:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9850 00000100:00080000:1.0:1775773879.104034:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773879.104040:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773879.104043:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612457984:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775773879.104052:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773879.104067:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612458112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773879.104077:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773879.104079:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773879.104081:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773879.104083:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9850 00000100:00080000:1.0:1775773879.104087:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773879.104090:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773879.104093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:3.0:1775773879.104101:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773879.104102:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612458240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773879.104113:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773879.104116:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773879.104118:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773879.104123:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9850 00000100:00080000:1.0:1775773879.104128:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773879.104134:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773879.104134:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773879/real 1775773879] req@ffff8de1c2e17800 x1862023612457984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:1.0:1775773879.104143:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773879.104153:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612457984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773879.104159:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612458368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773879.104165:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773879.104173:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:1.0:1775773879.104176:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775773879.104179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612457984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775773879.104181:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773879.104185:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773879.104189:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9850 00000100:00080000:1.0:1775773879.104192:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773879.104195:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773879.104199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773879.104208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773879.104209:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612458496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775773879.104245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773879.104257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773879/real 1775773879] req@ffff8de1c2e17100 x1862023612458112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773879.104266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612458112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773879.104272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773879.104275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773879.104277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773879.104281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773879.104294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773879.104301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773879/real 1775773879] req@ffff8de1c2e17b80 x1862023612458240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773879.104308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612458240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773879.104314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773879.104316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773879.104318:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773879.104321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773879.104330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773879.104335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773879/real 1775773879] req@ffff8de1c2e16680 x1862023612458368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773879.104343:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612458368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773879.104348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773879.104349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773879.104351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773879.104363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773879.104372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773879.104377:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773879/real 1775773879] req@ffff8de1c2e14380 x1862023612458496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773879.104384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612458496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773879.104389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773879.104391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773879.104395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773880.063865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773881.087935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773882.111860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773883.135947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773884.159844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773884.223877:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773884.223886:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773884.223891:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773884.223911:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9855 00000100:00080000:3.0:1775773884.223922:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773884.223929:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773884.223978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612458624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773884.224009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773884.224013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773884.224015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773884.224019:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9855 00000100:00080000:3.0:1775773884.224023:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773884.224027:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773884.224037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773884.224050:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612458752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773884.224060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773884.224063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775773884.224064:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612458624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773884.224065:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773884.224069:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9855 00000100:00080000:3.0:1775773884.224073:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773884.224076:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773884.224080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773884.224090:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612458880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773884.224098:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773884.224101:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773884.224103:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773884.224106:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9855 00000100:00080000:3.0:1775773884.224109:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773884.224112:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773884.224116:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773884.224121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773884.224124:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612459008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773884.224132:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773884.224134:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773884.224136:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773884.224139:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9855 00000100:00080000:3.0:1775773884.224142:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773884.224145:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773884.224149:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773884.224159:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612459136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773884.224164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773884/real 1775773884] req@ffff8de1c7af7b80 x1862023612458624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773884.224181:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612458624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773884.224191:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773884.224195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773884.224199:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612458624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773884.224221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773884.224239:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773884.224248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773884/real 1775773884] req@ffff8de1c7af5880 x1862023612458752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773884.224257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612458752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773884.224262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773884.224264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773884.224266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773884.224270:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773884.224279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773884.224285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773884/real 1775773884] req@ffff8de1c7af5f80 x1862023612458880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773884.224297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612458880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773884.224301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773884.224303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773884.224305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612458880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773884.224309:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773884.224325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773884.224335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773884/real 1775773884] req@ffff8de1c7af4e00 x1862023612459008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773884.224346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612459008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773884.224355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773884.224358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773884.224361:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773884.224367:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773884.224387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773884.224396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773884/real 1775773884] req@ffff8de1c7af4380 x1862023612459136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773884.224409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612459136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773884.224424:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773884.224427:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773884.224430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773885.183859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773886.207880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773887.231982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773888.255868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773889.279941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773889.343879:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773889.343887:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773889.343890:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773889.343899:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9861 00000100:00080000:3.0:1775773889.343909:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773889.343915:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773889.343948:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612459264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773889.343972:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773889.343976:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773889.343978:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773889.343982:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9861 00000100:00080000:3.0:1775773889.343986:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773889.343990:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773889.344000:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773889.344023:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612459392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773889.344039:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773889.344043:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773889.344045:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773889.344049:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9861 00000100:00080000:3.0:1775773889.344053:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773889.344057:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773889.344062:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773889.344073:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612459520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773889.344083:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773889.344086:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773889.344089:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773889.344090:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612459264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773889.344092:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9861 00000100:00080000:3.0:1775773889.344096:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773889.344099:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773889.344103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773889.344113:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612459648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773889.344121:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773889.344124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773889.344125:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773889.344128:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9861 00000100:00080000:3.0:1775773889.344131:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773889.344134:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773889.344137:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773889.344145:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612459776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773889.344148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773889.344181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773889/real 1775773889] req@ffff8de1c7af4000 x1862023612459264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773889.344198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612459264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773889.344209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773889.344213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773889.344217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612459264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773889.344225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773889.344243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773889.344251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773889/real 1775773889] req@ffff8de1c7af7480 x1862023612459392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773889.344259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612459392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773889.344264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773889.344267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773889.344269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773889.344288:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773889.344299:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773889.344304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773889/real 1775773889] req@ffff8de1c7af5500 x1862023612459520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773889.344312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612459520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773889.344316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773889.344318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773889.344320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773889.344323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773889.344332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773889.344337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773889/real 1775773889] req@ffff8de1c7af5c00 x1862023612459648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773889.344344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612459648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773889.344349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773889.344350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773889.344352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773889.344355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773889.344364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773889.344369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773889/real 1775773889] req@ffff8de1c7af6300 x1862023612459776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773889.344376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612459776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773889.344381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773889.344382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773889.344384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612459776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773890.303857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773891.327934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773892.351881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773893.375933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773894.399941:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773894.463972:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773894.463981:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773894.463986:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773894.463996:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9866 00000100:00080000:1.0:1775773894.464008:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773894.464015:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773894.464052:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612459904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773894.464078:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773894.464082:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773894.464084:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773894.464088:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9866 00000100:00080000:1.0:1775773894.464092:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773894.464096:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773894.464106:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773894.464119:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612459904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773894.464122:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612460032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773894.464136:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773894.464140:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773894.464142:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773894.464146:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9866 00000100:00080000:1.0:1775773894.464151:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773894.464154:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773894.464159:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773894.464170:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612460160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773894.464179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773894.464181:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773894.464186:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773894.464188:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773894.464194:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9866 00000100:00080000:1.0:1775773894.464199:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773894.464203:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773894.464208:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773894.464212:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773894/real 1775773894] req@ffff8de1c2e16a00 x1862023612459904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773894.464222:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612460288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773894.464244:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773894.464248:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773894.464250:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773894.464254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612459904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773894.464258:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9866 00000100:00080000:1.0:1775773894.464267:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773894.464270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773894.464272:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775773894.464277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:1.0:1775773894.464281:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773894.464282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612459904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773894.464299:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612460416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773894.464310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773894.464336:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773894.464352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773894/real 1775773894] req@ffff8de1c2e14380 x1862023612460032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773894.464365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612460032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773894.464374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773894.464377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773894.464381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773894.464388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773894.464410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773894.464421:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773894/real 1775773894] req@ffff8de1c2e16680 x1862023612460160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773894.464434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612460160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773894.464442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773894.464446:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773894.464449:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773894.464456:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773894.464476:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773894.464486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773894/real 1775773894] req@ffff8de1c2e17b80 x1862023612460288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773894.464494:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612460288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773894.464500:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773894.464502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773894.464504:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773894.464522:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773894.464542:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773894.464553:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773894/real 1775773894] req@ffff8de1c2e17100 x1862023612460416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773894.464566:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612460416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773894.464574:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773894.464577:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773894.464580:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775773895.423879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773896.447926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773897.471970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773898.495987:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773899.519921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773899.583902:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773899.583914:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773899.583918:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773899.583926:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9871 00000100:00080000:2.0:1775773899.583935:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773899.583941:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773899.583978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612460544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773899.584008:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773899.584012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773899.584013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773899.584017:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9871 00000100:00080000:2.0:1775773899.584020:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773899.584024:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773899.584033:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773899.584045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612460672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773899.584058:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773899.584063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773899.584067:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773899.584070:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612460544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773899.584078:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9871 00000100:00080000:2.0:1775773899.584088:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773899.584095:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773899.584104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773899.584120:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612460800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773899.584133:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773899.584136:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773899.584138:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773899.584141:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9871 00000100:00080000:2.0:1775773899.584146:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773899.584151:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773899.584158:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775773899.584166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773899.584176:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612460928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773899.584199:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773899.584204:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773899.584207:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773899.584215:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9871 00000100:00080000:2.0:1775773899.584221:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773899.584224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773899/real 1775773899] req@ffff8de1d0f2e680 x1862023612460544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773899.584230:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773899.584242:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773899.584260:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612461056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773899.584265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612460544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773899.584316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773899.584320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773899.584326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612460544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773899.584355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773899.584378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773899.584389:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773899/real 1775773899] req@ffff8de1d0f2d500 x1862023612460672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773899.584397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612460672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773899.584403:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773899.584408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773899.584410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773899.584415:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773899.584435:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773899.584441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773899/real 1775773899] req@ffff8de1d0f2c700 x1862023612460800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773899.584452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612460800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773899.584458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773899.584461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773899.584463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773899.584469:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773899.584481:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773899.584491:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773899/real 1775773899] req@ffff8de1d0f2f100 x1862023612460928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773899.584499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612460928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773899.584511:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773899.584516:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773899.584518:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612460928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773899.584523:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773899.584536:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773899.584573:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773899/real 1775773899] req@ffff8de1d0f2e300 x1862023612461056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773899.584583:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612461056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773899.584588:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773899.584592:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773899.584595:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773900.543946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775773901.567878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773902.591873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773903.615877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773904.639904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773904.703783:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773904.703790:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773904.703794:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773904.703802:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9876 00000100:00080000:2.0:1775773904.703811:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773904.703816:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773904.703848:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612461184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773904.703869:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773904.703871:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773904.703873:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773904.703875:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9876 00000100:00080000:2.0:1775773904.703878:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773904.703881:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773904.703890:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773904.703898:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612461312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773904.703905:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612461184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773904.703908:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773904.703914:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773904.703915:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773904.703918:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9876 00000100:00080000:2.0:1775773904.703920:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773904.703922:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773904.703925:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773904.703934:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612461440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773904.703940:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773904.703942:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773904.703943:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773904.703946:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9876 00000100:00080000:2.0:1775773904.703948:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773904.703951:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773904.703954:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773904.703960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612461568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773904.703967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775773904.703971:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773904.703972:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773904.703974:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773904.703978:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9876 00000100:00080000:2.0:1775773904.703981:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773904.703984:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773904.703987:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773904.703996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612461696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773904.704003:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773904/real 1775773904] req@ffff8de1d0f2ca80 x1862023612461184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773904.704019:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612461184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773904.704027:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773904.704030:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773904.704032:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612461184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773904.704049:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773904.704063:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773904.704070:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773904/real 1775773904] req@ffff8de1d0f2df80 x1862023612461312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773904.704078:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612461312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773904.704083:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773904.704085:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773904.704087:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773904.704091:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773904.704100:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773904.704104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773904/real 1775773904] req@ffff8de1d0f2e300 x1862023612461440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773904.704112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612461440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773904.704121:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773904.704123:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773904.704125:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773904.704128:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773904.704137:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773904.704142:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773904/real 1775773904] req@ffff8de1d0f2f100 x1862023612461568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773904.704148:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612461568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773904.704153:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773904.704155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773904.704156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773904.704159:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773904.704170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773904.704179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773904/real 1775773904] req@ffff8de1d0f2c700 x1862023612461696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773904.704190:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612461696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773904.704198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773904.704200:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773904.704204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773905.663844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773906.687882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773907.711881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773908.735863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773909.759845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773909.823851:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773909.823862:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773909.823866:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773909.823874:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9881 00000100:00080000:0.0:1775773909.823884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773909.823890:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773909.823924:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612461824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773909.823965:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773909.823968:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773909.823969:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773909.823972:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9881 00000100:00080000:0.0:1775773909.823975:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773909.823978:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773909.823985:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773909.823994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612461952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773909.824003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773909.824006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773909.824007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773909.824010:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9881 00000100:00080000:0.0:1775773909.824012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773909.824014:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773909.824018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773909.824024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612461824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773909.824027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612462080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773909.824037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773909.824040:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773909.824041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773909.824044:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9881 00000100:00080000:0.0:1775773909.824046:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773909.824049:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773909.824052:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773909.824061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612462208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773909.824070:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773909.824074:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773909.824092:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773909.824096:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9881 00000100:00080000:0.0:1775773909.824101:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773909.824104:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773909.824109:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775773909.824118:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773909.824123:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612462336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773909.824151:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773909/real 1775773909] req@ffff8de1c5683800 x1862023612461824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773909.824166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612461824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773909.824174:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773909.824178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773909.824181:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612461824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773909.824185:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773909.824200:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773909.824208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773909/real 1775773909] req@ffff8de1c5680e00 x1862023612461952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773909.824216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612461952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773909.824221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773909.824223:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773909.824225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612461952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773909.824242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773909.824252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773909.824258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773909/real 1775773909] req@ffff8de1c5681880 x1862023612462080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773909.824265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612462080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773909.824270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773909.824272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773909.824273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773909.824277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773909.824287:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773909.824291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773909/real 1775773909] req@ffff8de1c5681500 x1862023612462208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773909.824299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612462208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773909.824303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773909.824322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773909.824324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773909.824329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773909.824342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773909.824348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773909/real 1775773909] req@ffff8de1c5683480 x1862023612462336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773909.824356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612462336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773909.824363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773909.824366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773909.824368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773910.783915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773911.807852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773912.831898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773913.855936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773914.879936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775773914.943883:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773914.943893:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775773914.943898:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773914.943910:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9886 00000100:00080000:0.0:1775773914.943923:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773914.943931:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773914.943978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612462464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773914.944014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773914.944018:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775773914.944021:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773914.944025:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9886 00000100:00080000:0.0:1775773914.944028:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773914.944032:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773914.944043:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773914.944058:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612462592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773914.944058:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612462464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775773914.944075:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773914.944078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775773914.944080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773914.944084:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9886 00000100:00080000:0.0:1775773914.944087:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773914.944091:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773914.944097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773914.944111:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612462720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773914.944123:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773914.944127:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775773914.944129:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773914.944134:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9886 00000100:00080000:0.0:1775773914.944148:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775773914.944153:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775773914.944159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775773914.944162:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773914.944178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612462848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775773914.944189:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775773914.944192:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775773914.944194:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775773914.944199:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9886 00000100:00080000:0.0:1775773914.944204:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773914.944210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773914/real 1775773914] req@ffff8de1c5680000 x1862023612462464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773914.944211:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775773914.944219:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775773914.944236:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612462976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773914.944243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612462464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773914.944260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773914.944266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773914.944271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612462464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773914.944301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773914.944327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773914.944340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773914/real 1775773914] req@ffff8de1c5680380 x1862023612462592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773914.944349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612462592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773914.944355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773914.944357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773914.944373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773914.944379:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773914.944395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773914.944403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773914/real 1775773914] req@ffff8de1c5682a00 x1862023612462720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773914.944411:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612462720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773914.944417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773914.944419:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773914.944421:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773914.944425:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773914.944436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773914.944441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773914/real 1775773914] req@ffff8de1c5681f80 x1862023612462848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773914.944449:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612462848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773914.944454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773914.944456:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773914.944457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773914.944461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773914.944471:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773914.944476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773914/real 1775773914] req@ffff8de1c5681c00 x1862023612462976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773914.944484:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612462976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773914.944488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773914.944490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773914.944491:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612462976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773915.903959:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773916.927902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773917.951887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773918.975903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773919.999927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773920.063817:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773920.063824:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773920.063828:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773920.063837:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9891 00000100:00080000:2.0:1775773920.063848:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773920.063854:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773920.063891:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612463104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773920.063918:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773920.063929:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773920.063932:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773920.063937:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9891 00000100:00080000:2.0:1775773920.063940:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773920.063943:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773920.063952:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612463104:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773920.063955:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773920.063973:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612463232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773920.063987:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773920.063991:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773920.063993:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773920.063997:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9891 00000100:00080000:2.0:1775773920.064001:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773920.064004:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773920.064008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773920.064018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612463360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773920.064025:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773920.064029:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773920.064034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775773920.064035:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773920.064043:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9891 00000100:00080000:2.0:1775773920.064048:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773920.064053:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773920.064059:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773920.064067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773920/real 1775773920] req@ffff8de1d0f2d500 x1862023612463104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775773920.064074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612463488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773920.064084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773920.064087:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773920.064089:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773920.064090:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612463104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773920.064096:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9891 00000100:00080000:2.0:1775773920.064104:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773920.064110:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775773920.064110:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773920.064116:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775773920.064119:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773920.064126:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612463104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773920.064132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612463616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773920.064154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773920.064176:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773920.064186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773920/real 1775773920] req@ffff8de1d0f2e680 x1862023612463232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773920.064194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612463232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773920.064205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773920.064207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773920.064209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773920.064213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773920.064224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773920.064230:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773920/real 1775773920] req@ffff8de1d0f2c700 x1862023612463360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773920.064237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612463360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773920.064242:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773920.064244:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773920.064246:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773920.064250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773920.064260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773920.064265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773920/real 1775773920] req@ffff8de1d0f2f100 x1862023612463488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773920.064289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612463488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773920.064295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773920.064297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773920.064299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773920.064304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773920.064320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773920.064333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773920/real 1775773920] req@ffff8de1d0f2e300 x1862023612463616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773920.064345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612463616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773920.064354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773920.064357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773920.064361:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773921.023875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773922.047954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773923.071858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773924.095825:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773925.119843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773925.183866:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773925.183877:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773925.183882:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773925.183892:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9896 00000100:00080000:3.0:1775773925.183904:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773925.183911:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773925.183952:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612463744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773925.183984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773925.183989:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773925.183991:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773925.183996:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9896 00000100:00080000:3.0:1775773925.184000:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773925.184004:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773925.184015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773925.184032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612463872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773925.184045:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612463744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773925.184047:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773925.184056:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773925.184058:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773925.184063:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9896 00000100:00080000:3.0:1775773925.184067:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773925.184072:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773925.184078:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773925.184093:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612464000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773925.184105:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773925.184111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:1.0:1775773925.184112:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773925.184113:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773925.184121:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9896 00000100:00080000:3.0:1775773925.184127:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773925.184131:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773925.184138:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773925.184153:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612464128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773925.184155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773925/real 1775773925] req@ffff8de1c7af4700 x1862023612463744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773925.184198:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773925.184202:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773925.184205:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775773925.184208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612463744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773925.184213:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9896 00000100:00080000:3.0:1775773925.184220:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773925.184228:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775773925.184229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:3.0:1775773925.184235:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775773925.184237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773925.184244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612463744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773925.184253:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612464256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773925.184271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773925.184298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773925.184312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773925/real 1775773925] req@ffff8de1c7af6680 x1862023612463872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773925.184326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612463872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773925.184335:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773925.184339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773925.184342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612463872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773925.184348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773925.184366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773925.184376:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773925/real 1775773925] req@ffff8de1c7af6a00 x1862023612464000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773925.184389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612464000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773925.184398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773925.184401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773925.184405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773925.184411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773925.184429:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773925.184438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773925/real 1775773925] req@ffff8de1c7af6300 x1862023612464128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773925.184450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612464128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773925.184459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773925.184463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773925.184466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773925.184473:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773925.184490:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773925.184500:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773925/real 1775773925] req@ffff8de1c7af5c00 x1862023612464256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773925.184512:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612464256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773925.184521:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773925.184525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773925.184528:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773926.143915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773927.167885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773928.191880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773929.215934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773930.239904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773930.303875:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773930.303882:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773930.303886:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773930.303894:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9902 00000100:00080000:2.0:1775773930.303904:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773930.303910:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773930.303943:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612464384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773930.303970:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773930.303974:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773930.303975:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773930.303980:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9902 00000100:00080000:2.0:1775773930.303983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773930.303987:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773930.303997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773930.304009:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612464512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773930.304020:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773930.304025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775773930.304026:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612464384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773930.304027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773930.304031:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9902 00000100:00080000:2.0:1775773930.304034:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773930.304037:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773930.304042:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773930.304052:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612464640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773930.304060:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773930.304063:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773930.304064:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773930.304067:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9902 00000100:00080000:2.0:1775773930.304070:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773930.304073:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773930.304078:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775773930.304085:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773930.304086:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612464768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773930.304121:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773930.304124:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773930.304125:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773930.304129:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9902 00000100:00080000:2.0:1775773930.304132:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775773930.304135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773930/real 1775773930] req@ffff8de1d0f2df80 x1862023612464384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773930.304136:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773930.304141:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773930.304152:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612464896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775773930.304154:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612464384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773930.304164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773930.304168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773930.304172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612464384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775773930.304195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773930.304218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773930.304227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773930/real 1775773930] req@ffff8de1d0f2ca80 x1862023612464512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773930.304235:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612464512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773930.304241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773930.304243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773930.304245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773930.304249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775773930.304259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773930.304265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773930/real 1775773930] req@ffff8de1d0f2e300 x1862023612464640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773930.304272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612464640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773930.304276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773930.304278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773930.304280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775773930.304283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773930.304292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773930.304297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773930/real 1775773930] req@ffff8de1d0f2f100 x1862023612464768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773930.304305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612464768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773930.304310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773930.304312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773930.304313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775773930.304316:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775773930.304325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775773930.304330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773930/real 1775773930] req@ffff8de1d0f2c700 x1862023612464896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775773930.304337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612464896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775773930.304342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775773930.304343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775773930.304345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612464896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773931.263899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773932.287936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773933.311844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773934.335898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773935.359920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773935.423936:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773935.423944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773935.423949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773935.423958:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9907 00000100:00080000:2.0:1775773935.423969:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773935.423976:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773935.424033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612465024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773935.424059:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773935.424062:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773935.424064:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773935.424069:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9907 00000100:00080000:2.0:1775773935.424072:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773935.424082:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773935.424091:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773935.424095:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612465024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773935.424108:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612465152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773935.424121:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773935.424125:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773935.424127:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773935.424130:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9907 00000100:00080000:2.0:1775773935.424136:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773935.424140:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773935.424144:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773935.424154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612465280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773935.424162:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773935.424165:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773935.424167:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773935.424171:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9907 00000100:00080000:2.0:1775773935.424174:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773935.424177:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773935.424182:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773935.424190:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612465408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773935.424199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465152:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775773935.424202:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773935.424208:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773935.424209:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773935.424212:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9907 00000100:00080000:2.0:1775773935.424216:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773935.424219:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773935.424224:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773935.424235:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612465536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773935.424247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773935.424297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773935.424335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773936.383896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773937.407838:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773938.431845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775773938.496133:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775773938.496188:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775773938.496210:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773938.496262:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773938.496273:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773938.496286:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775773938.496296:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775773938.496325:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773935/real 1775773938] req@ffff8de1d0f2f100 x1862023612465408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773938.496366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612465408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773938.496380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773938.496385:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773938.496390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773938.496408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773935/real 1775773938] req@ffff8de1d0f2e300 x1862023612465536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773938.496421:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612465536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773938.496429:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773938.496433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773938.496437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465536:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773938.496444:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773935/real 1775773938] req@ffff8de1d0f2d500 x1862023612465152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773938.496456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612465152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773938.496465:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773938.496469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773938.496473:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773938.496480:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773935/real 1775773938] req@ffff8de1d0f2c700 x1862023612465280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773938.496493:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612465280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773938.496501:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773938.496504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773938.496508:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773938.496515:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773935/real 1775773938] req@ffff8de1d0f2e680 x1862023612465024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773938.496529:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612465024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773938.496537:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773938.496541:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773938.496545:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612465024:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775773939.455830:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773940.479870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773940.543818:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773940.543827:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773940.543832:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773940.543841:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9912 00000100:00080000:2.0:1775773940.543852:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773940.543860:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773940.543894:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612465664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773940.543934:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773940.543939:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773940.543941:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773940.543946:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9912 00000100:00080000:2.0:1775773940.543950:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773940.543954:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773940.543964:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773940.543978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612465792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773940.543990:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773940.543994:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773940.543995:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773940.543999:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9912 00000100:00080000:2.0:1775773940.544003:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773940.544008:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773940.544015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775773940.544024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612465664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775773940.544033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612465920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773940.544048:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773940.544052:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773940.544055:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773940.544060:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9912 00000100:00080000:2.0:1775773940.544064:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773940.544069:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773940.544074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773940.544088:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612466048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773940.544098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773940.544101:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773940.544103:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773940.544107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9912 00000100:00080000:2.0:1775773940.544111:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773940.544115:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773940.544120:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773940.544128:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773940.544134:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612466176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773940.544174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773940/real 1775773940] req@ffff8de1d0f2ca80 x1862023612465664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773940.544198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612465664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773940.544211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773940.544218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773940.544223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612465664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773940.544233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773940.544260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773940.544273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773940/real 1775773940] req@ffff8de1d0f2df80 x1862023612465792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773940.544287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612465792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773940.544296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773940.544300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773940.544304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773940.544339:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773940.544361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773940.544372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773940/real 1775773940] req@ffff8de1d0f2e680 x1862023612465920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773940.544386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612465920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773940.544396:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773940.544399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773940.544403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612465920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773940.544411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773940.544432:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773940.544443:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773940/real 1775773940] req@ffff8de1d0f2c700 x1862023612466048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773940.544456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612466048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773940.544465:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773940.544469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773940.544472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773940.544479:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773940.544500:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773940.544511:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773940/real 1775773940] req@ffff8de1d0f2d500 x1862023612466176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773940.544524:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612466176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773940.544531:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773940.544535:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773940.544538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773941.503833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773942.527856:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773943.551899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773944.575853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773945.600023:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775773945.663850:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773945.663858:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775773945.663862:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773945.663883:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9917 00000100:00080000:1.0:1775773945.663894:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773945.663901:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775773945.663936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612466304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773945.663967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773945.663970:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775773945.663972:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773945.663976:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9917 00000100:00080000:1.0:1775773945.663979:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773945.663981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773945.663990:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773945.664001:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612466432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773945.664010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773945.664013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775773945.664015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773945.664018:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9917 00000100:00080000:1.0:1775773945.664020:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773945.664025:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773945.664027:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612466304:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775773945.664029:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775773945.664042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612466560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773945.664050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773945.664053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775773945.664055:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773945.664057:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9917 00000100:00080000:1.0:1775773945.664060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775773945.664064:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773945.664068:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773945.664077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612466688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775773945.664085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775773945.664087:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775773945.664088:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775773945.664091:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9917 00000100:00080000:1.0:1775773945.664094:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775773945.664099:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775773945.664106:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775773945.664111:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775773945.664121:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612466816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773945.664143:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773945/real 1775773945] req@ffff8de1c2e17800 x1862023612466304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773945.664161:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612466304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773945.664172:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773945.664177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773945.664182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612466304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773945.664192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773945.664221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773945.664237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773945/real 1775773945] req@ffff8de1c2e15500 x1862023612466432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773945.664254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612466432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773945.664265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773945.664269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773945.664272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773945.664296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773945.664315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773945.664324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773945/real 1775773945] req@ffff8de1c2e14700 x1862023612466560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773945.664339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612466560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773945.664346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773945.664348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773945.664351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773945.664355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773945.664367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773945.664373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773945/real 1775773945] req@ffff8de1c2e17480 x1862023612466688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773945.664383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612466688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773945.664388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773945.664391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773945.664393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773945.664397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773945.664416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773945.664422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773945/real 1775773945] req@ffff8de1c2e14a80 x1862023612466816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773945.664431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612466816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773945.664442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773945.664444:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773945.664447:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612466816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773946.623942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773947.647869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773948.671902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773949.695922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773950.719888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773950.783852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773950.783863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773950.783868:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773950.783878:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9922 00000100:00080000:3.0:1775773950.783892:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773950.783899:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773950.783944:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612466944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773950.783970:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773950.783973:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773950.783974:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773950.783978:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9922 00000100:00080000:3.0:1775773950.783980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773950.783983:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773950.783992:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773950.784003:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612467072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773950.784011:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773950.784014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773950.784016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773950.784019:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9922 00000100:00080000:3.0:1775773950.784021:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773950.784024:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773950.784028:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612466944:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773950.784029:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773950.784040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612467200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773950.784047:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773950.784050:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773950.784052:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773950.784054:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9922 00000100:00080000:3.0:1775773950.784057:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773950.784059:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773950.784062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773950.784072:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612467328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773950.784078:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773950.784080:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773950.784081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773950.784084:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9922 00000100:00080000:3.0:1775773950.784087:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773950.784089:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773950.784093:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773950.784100:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612467456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773950.784107:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773950.784148:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773950/real 1775773950] req@ffff8de1c7af5500 x1862023612466944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773950.784164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612466944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773950.784172:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773950.784176:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773950.784179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612466944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773950.784184:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773950.784200:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773950.784208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773950/real 1775773950] req@ffff8de1c7af7480 x1862023612467072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773950.784216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612467072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773950.784222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773950.784225:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773950.784227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773950.784249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773950.784260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773950.784265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773950/real 1775773950] req@ffff8de1c7af4000 x1862023612467200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773950.784272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612467200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773950.784278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773950.784279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773950.784281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773950.784285:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773950.784295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773950.784301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773950/real 1775773950] req@ffff8de1c7af4380 x1862023612467328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773950.784308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612467328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773950.784313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773950.784314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773950.784317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773950.784320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773950.784330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773950.784335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773950/real 1775773950] req@ffff8de1c7af4e00 x1862023612467456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773950.784342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612467456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773950.784347:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773950.784349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773950.784350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773951.743935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773952.767945:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773953.791865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773954.815920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773955.839886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773955.903763:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773955.903770:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773955.903774:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773955.903782:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9927 00000100:00080000:3.0:1775773955.903791:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773955.903797:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773955.903828:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612467584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773955.903855:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773955.903858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773955.903859:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773955.903862:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9927 00000100:00080000:3.0:1775773955.903865:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773955.903867:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773955.903875:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773955.903897:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612467712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773955.903904:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773955.903907:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773955.903908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773955.903910:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9927 00000100:00080000:3.0:1775773955.903912:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773955.903916:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773955.903919:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612467584:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775773955.903921:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773955.903931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612467840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773955.903939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773955.903942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773955.903943:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773955.903945:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9927 00000100:00080000:3.0:1775773955.903948:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773955.903951:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773955.903954:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773955.903962:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612467968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773955.903967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773955.903970:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773955.903971:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773955.903974:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9927 00000100:00080000:3.0:1775773955.903976:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773955.903978:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773955.903981:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773955.903986:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773955.903990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612468096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773955.904028:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773955/real 1775773955] req@ffff8de1c7af5f80 x1862023612467584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773955.904052:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612467584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773955.904059:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773955.904063:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773955.904066:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612467584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773955.904071:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773955.904090:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773955.904098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773955/real 1775773955] req@ffff8de1c7af5880 x1862023612467712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773955.904106:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612467712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773955.904111:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773955.904114:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773955.904116:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773955.904133:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773955.904144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773955.904150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773955/real 1775773955] req@ffff8de1c7af7b80 x1862023612467840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773955.904157:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612467840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773955.904162:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773955.904164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773955.904167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773955.904170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773955.904179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773955.904185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773955/real 1775773955] req@ffff8de1c7af6d80 x1862023612467968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773955.904193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612467968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773955.904198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773955.904199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773955.904201:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612467968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773955.904204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773955.904215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773955.904220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773955/real 1775773955] req@ffff8de1c7af4a80 x1862023612468096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773955.904227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612468096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773955.904232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773955.904234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773955.904235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773956.863970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773957.887911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773958.911901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773959.935851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773960.959997:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773961.023797:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773961.023808:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773961.023814:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773961.023827:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9932 00000100:00080000:3.0:1775773961.023840:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773961.023849:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773961.023902:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612468224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773961.023938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773961.023946:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773961.023948:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773961.023953:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9932 00000100:00080000:3.0:1775773961.023957:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773961.023960:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773961.023972:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773961.023988:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612468352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773961.024002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612468224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773961.024004:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773961.024016:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773961.024021:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773961.024025:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9932 00000100:00080000:3.0:1775773961.024027:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773961.024030:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773961.024033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773961.024040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612468480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773961.024046:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773961.024049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773961.024050:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773961.024054:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9932 00000100:00080000:3.0:1775773961.024057:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773961.024060:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773961.024066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773961.024074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612468608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773961.024081:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773961.024083:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773961.024090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773961.024092:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773961.024098:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9932 00000100:00080000:3.0:1775773961.024103:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773961.024105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773961.024109:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773961.024120:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612468736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773961.024134:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773961/real 1775773961] req@ffff8de1c7af5180 x1862023612468224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773961.024154:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612468224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773961.024163:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773961.024170:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773961.024173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612468224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773961.024193:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773961.024209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773961.024217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773961/real 1775773961] req@ffff8de1c7af7100 x1862023612468352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773961.024225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612468352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773961.024230:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773961.024232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773961.024234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773961.024238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773961.024247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773961.024253:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773961/real 1775773961] req@ffff8de1c7af7800 x1862023612468480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773961.024260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612468480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773961.024270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773961.024272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773961.024274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773961.024278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773961.024288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773961.024293:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773961/real 1775773961] req@ffff8de1c7af4a80 x1862023612468608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773961.024306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612468608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773961.024316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773961.024319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773961.024321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773961.024325:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773961.024336:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773961.024342:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773961/real 1775773961] req@ffff8de1c7af6d80 x1862023612468736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773961.024350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612468736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773961.024354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773961.024356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773961.024358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773961.983954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773963.007930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773964.031885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773965.055895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773966.079911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773966.143849:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773966.143856:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773966.143860:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773966.143869:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9937 00000100:00080000:2.0:1775773966.143879:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773966.143885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773966.143918:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612468864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773966.143941:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773966.143943:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773966.143945:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773966.143948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9937 00000100:00080000:2.0:1775773966.143950:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773966.143952:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773966.143959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773966.143967:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612468992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773966.143973:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773966.143975:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773966.143976:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773966.143978:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9937 00000100:00080000:2.0:1775773966.143980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773966.143982:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773966.143984:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773966.143991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612469120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773966.144001:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773966.144003:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773966.144004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773966.144006:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9937 00000100:00080000:2.0:1775773966.144008:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773966.144010:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773966.144013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773966.144017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612469248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773966.144022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773966.144024:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773966.144025:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773966.144027:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9937 00000100:00080000:2.0:1775773966.144029:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773966.144030:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773966.144033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773966.144038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612469376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773966.144099:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612468864:192.168.201.137@tcp:250:kworker.0 00000800:00000100:0.0:1775773966.144181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773966.144223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773966/real 1775773966] req@ffff8de1d0f2e300 x1862023612468864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773966.144240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612468864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773966.144251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773966.144254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773966.144258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612468864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773966.144264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773966.144279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773966.144287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773966/real 1775773966] req@ffff8de1d0f2f100 x1862023612468992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773966.144295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612468992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773966.144300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773966.144302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773966.144305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612468992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773966.144309:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773966.144320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773966.144325:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773966/real 1775773966] req@ffff8de1d0f2d500 x1862023612469120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773966.144332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612469120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773966.144337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773966.144339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773966.144341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773966.144345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773966.144355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773966.144360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773966/real 1775773966] req@ffff8de1d0f2c700 x1862023612469248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773966.144366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612469248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773966.144372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773966.144374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773966.144376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773966.144380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773966.144390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773966.144396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773966/real 1775773966] req@ffff8de1d0f2e680 x1862023612469376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773966.144403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612469376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773966.144408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773966.144410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773966.144411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773967.103901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773968.127900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773969.151871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773970.175865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773971.199880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773971.263835:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773971.263856:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773971.263865:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773971.263876:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9943 00000100:00080000:2.0:1775773971.263887:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773971.263894:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773971.263941:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612469504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773971.263974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773971.263978:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773971.263980:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773971.263985:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9943 00000100:00080000:2.0:1775773971.263989:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773971.263994:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773971.264004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612469504:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775773971.264005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773971.264026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612469632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773971.264039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773971.264043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773971.264045:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773971.264051:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9943 00000100:00080000:2.0:1775773971.264056:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773971.264060:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773971.264067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:3.0:1775773971.264070:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775773971.264085:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612469760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773971.264097:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773971.264103:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1775773971.264104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773971/real 1775773971] req@ffff8de1d0f2df80 x1862023612469504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775773971.264105:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773971.264114:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9943 00000100:00080000:2.0:1775773971.264122:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773971.264128:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773971.264133:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773971.264144:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612469888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773971.264154:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773971.264158:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773971.264160:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773971.264163:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9943 00000100:00080000:2.0:1775773971.264167:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773971.264170:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773971.264175:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773971.264185:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612470016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775773971.264203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612469504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773971.264216:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773971.264220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773971.264225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612469504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773971.264246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773971.264401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773971.264419:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773971/real 1775773971] req@ffff8de1d0f2ca80 x1862023612469632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773971.264434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612469632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773971.264486:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773971.264490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773971.264494:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773971.264500:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775773971.264522:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773971.264533:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773971/real 1775773971] req@ffff8de1d0f2e680 x1862023612469760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773971.264545:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612469760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773971.264552:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773971.264555:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773971.264558:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775773971.264564:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773971.264580:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773971.264588:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773971/real 1775773971] req@ffff8de1d0f2c700 x1862023612469888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773971.264605:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612469888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773971.264612:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773971.264615:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773971.264618:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612469888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775773971.264624:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775773971.264639:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773971.264647:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773971/real 1775773971] req@ffff8de1d0f2d500 x1862023612470016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775773971.264658:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612470016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775773996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773971.264665:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775773971.264668:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775773971.264671:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773972.223887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773973.247912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773974.271899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773975.295910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773976.319900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773976.383838:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773976.383847:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773976.383850:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773976.383857:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9948 00000100:00080000:3.0:1775773976.383866:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773976.383871:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773976.383901:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612470144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773976.383924:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773976.383927:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773976.383928:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773976.383931:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9948 00000100:00080000:3.0:1775773976.383933:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773976.383936:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773976.383943:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773976.383952:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612470272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773976.383960:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773976.383963:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773976.383965:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775773976.383968:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612470144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773976.383970:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9948 00000100:00080000:3.0:1775773976.383976:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773976.383978:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773976.383982:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773976.383990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612470400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773976.383996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773976.383998:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773976.384000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773976.384002:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9948 00000100:00080000:3.0:1775773976.384006:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773976.384009:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773976.384012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773976.384018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612470528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773976.384023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773976.384025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773976.384026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773976.384029:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775773976.384033:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9948 00000100:00080000:3.0:1775773976.384039:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773976.384043:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773976.384049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773976.384061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612470656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773976.384070:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773976/real 1775773976] req@ffff8de1c7af7b80 x1862023612470144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773976.384086:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612470144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773976.384094:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773976.384098:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773976.384101:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612470144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773976.384120:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773976.384136:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773976.384144:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773976/real 1775773976] req@ffff8de1c7af5880 x1862023612470272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773976.384152:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612470272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773976.384157:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773976.384159:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773976.384161:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773976.384164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773976.384174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773976.384179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773976/real 1775773976] req@ffff8de1c7af5f80 x1862023612470400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773976.384186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612470400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773976.384191:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773976.384193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773976.384201:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773976.384205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773976.384216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773976.384222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773976/real 1775773976] req@ffff8de1c7af4e00 x1862023612470528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773976.384229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612470528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773976.384234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773976.384236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773976.384238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773976.384242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773976.384251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773976.384256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773976/real 1775773976] req@ffff8de1c7af4380 x1862023612470656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773976.384263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612470656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773976.384268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773976.384270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773976.384272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773977.343935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773978.367914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773979.391899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773980.415949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773981.439944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773981.503815:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773981.503835:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773981.503840:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773981.503849:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9953 00000100:00080000:3.0:1775773981.503860:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773981.503867:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773981.503915:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612470784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773981.503945:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773981.503952:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773981.503954:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773981.503958:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9953 00000100:00080000:3.0:1775773981.503961:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773981.503964:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773981.503973:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773981.504002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612470912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773981.504017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773981.504022:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773981.504024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773981.504032:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9953 00000100:00080000:3.0:1775773981.504037:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773981.504041:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773981.504048:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773981.504074:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612471040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773981.504086:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773981.504091:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773981.504093:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773981.504102:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9953 00000100:00080000:3.0:1775773981.504109:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773981.504114:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612470784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773981.504116:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773981.504134:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773981.504146:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612471168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773981.504157:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773981.504160:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773981.504163:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773981.504168:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9953 00000100:00080000:3.0:1775773981.504170:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773981.504174:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773981.504178:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773981.504236:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612471296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775773981.504277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773981.504334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773981/real 1775773981] req@ffff8de1c7af4000 x1862023612470784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773981.504369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612470784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773981.504384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773981.504390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773981.504395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612470784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773981.504405:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773981.504432:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773981.504446:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773981/real 1775773981] req@ffff8de1c7af7480 x1862023612470912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773981.504460:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612470912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773981.504469:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773981.504473:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773981.504477:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612470912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773981.504513:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773981.504531:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773981.504540:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773981/real 1775773981] req@ffff8de1c7af5500 x1862023612471040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773981.504554:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612471040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773981.504578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773981.504585:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773981.504590:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773981.504602:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773981.504637:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773981.504672:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773981/real 1775773981] req@ffff8de1c7af5c00 x1862023612471168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773981.504692:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612471168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773981.504703:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773981.504707:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773981.504710:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773981.504718:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773981.504847:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773981.504867:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773981/real 1775773981] req@ffff8de1c7af6300 x1862023612471296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773981.504881:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612471296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773981.504890:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773981.504894:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773981.504898:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773982.463938:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773983.487895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773984.511891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773985.535871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773986.559906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773986.623827:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773986.623836:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773986.623840:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773986.623848:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9958 00000100:00080000:3.0:1775773986.623858:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773986.623865:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773986.623905:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612471424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773986.623934:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773986.623937:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773986.623938:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773986.623942:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9958 00000100:00080000:3.0:1775773986.623946:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773986.623948:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773986.623957:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773986.623971:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612471552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773986.623982:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612471424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773986.623984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773986.623993:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773986.623996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773986.624001:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9958 00000100:00080000:3.0:1775773986.624005:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773986.624009:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773986.624015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773986.624028:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612471680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773986.624036:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773986.624038:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773986.624040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773986.624043:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9958 00000100:00080000:3.0:1775773986.624046:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773986.624052:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775773986.624053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775773986.624058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773986.624068:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612471808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773986.624082:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773986.624086:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775773986.624089:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773986/real 1775773986] req@ffff8de1c7af6a00 x1862023612471424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773986.624090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773986.624100:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9958 00000100:00080000:3.0:1775773986.624124:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773986.624128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612471424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775773986.624130:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773986.624140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775773986.624142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773986.624149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773986.624153:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612471424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775773986.624158:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612471936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773986.624176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773986.624196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773986.624204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773986/real 1775773986] req@ffff8de1c7af6680 x1862023612471552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773986.624213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612471552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773986.624218:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773986.624220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773986.624223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773986.624227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773986.624238:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773986.624243:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773986/real 1775773986] req@ffff8de1c7af4700 x1862023612471680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773986.624250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612471680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773986.624255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773986.624257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773986.624259:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773986.624262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773986.624272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773986.624277:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773986/real 1775773986] req@ffff8de1c7af6300 x1862023612471808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773986.624284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612471808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773986.624289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773986.624290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773986.624292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773986.624295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773986.624304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773986.624310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773986/real 1775773986] req@ffff8de1c7af5c00 x1862023612471936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773986.624317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612471936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773986.624322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773986.624324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773986.624325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612471936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773987.583867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773988.607871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773989.631932:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773990.655900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773991.679923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775773991.743796:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773991.743806:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775773991.743812:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773991.743822:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9963 00000100:00080000:3.0:1775773991.743835:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773991.743840:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775773991.743872:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612472064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773991.743896:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773991.743898:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775773991.743900:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773991.743903:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9963 00000100:00080000:3.0:1775773991.743905:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773991.743908:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773991.743919:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773991.743934:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612472192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773991.743943:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612472064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775773991.743949:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773991.743954:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775773991.743956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773991.743961:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9963 00000100:00080000:3.0:1775773991.743965:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773991.743969:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773991.743974:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775773991.743984:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612472320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773991.743991:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773991.743994:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775773991.743995:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773991.743998:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9963 00000100:00080000:3.0:1775773991.744001:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773991.744003:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775773991.744007:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775773991.744012:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775773991.744038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612472448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775773991.744047:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775773991.744049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775773991.744051:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775773991.744054:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9963 00000100:00080000:3.0:1775773991.744058:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775773991.744061:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775773991.744066:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773991/real 1775773991] req@ffff8de1c7af5500 x1862023612472064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775773991.744066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775773991.744076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612472576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773991.744087:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612472064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773991.744096:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773991.744100:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773991.744104:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612472064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773991.744123:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773991.744141:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773991.744152:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773991/real 1775773991] req@ffff8de1c7af7480 x1862023612472192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773991.744166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612472192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773991.744175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773991.744179:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773991.744182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773991.744189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773991.744211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773991.744221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773991/real 1775773991] req@ffff8de1c7af4000 x1862023612472320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773991.744234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612472320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773991.744243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773991.744246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773991.744249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773991.744267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773991.744288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773991.744299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773991/real 1775773991] req@ffff8de1c7af4380 x1862023612472448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773991.744312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612472448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773991.744321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773991.744324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773991.744327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773991.744333:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773991.744354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773991.744365:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773991/real 1775773991] req@ffff8de1c7af4e00 x1862023612472576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773991.744377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612472576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773991.744386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773991.744389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773991.744392:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773992.703924:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773993.727923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773994.751936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773995.775909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773996.799991:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775773996.863896:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773996.863904:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775773996.863908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773996.863916:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9968 00000100:00080000:2.0:1775773996.863939:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773996.863946:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775773996.863990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612472704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773996.864016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773996.864019:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775773996.864020:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773996.864023:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9968 00000100:00080000:2.0:1775773996.864025:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773996.864027:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773996.864034:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773996.864042:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612472832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773996.864050:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773996.864053:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775773996.864054:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773996.864057:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9968 00000100:00080000:2.0:1775773996.864060:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775773996.864061:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612472704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775773996.864065:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773996.864071:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775773996.864079:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612472960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773996.864086:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773996.864089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775773996.864090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775773996.864092:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9968 00000100:00080000:2.0:1775773996.864095:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773996.864098:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773996.864102:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773996.864108:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612473088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775773996.864113:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775773996.864115:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775773996.864117:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775773996.864121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775773996.864121:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9968 00000100:00080000:2.0:1775773996.864126:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775773996.864128:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775773996.864131:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775773996.864139:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612473216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775773996.864170:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773996/real 1775773996] req@ffff8de1d0f2f100 x1862023612472704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773996.864186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612472704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773996.864194:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773996.864197:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773996.864200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612472704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775773996.864204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773996.864228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773996.864235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773996/real 1775773996] req@ffff8de1d0f2e300 x1862023612472832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773996.864242:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612472832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773996.864247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773996.864249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773996.864251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773996.864268:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775773996.864279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773996.864284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773996/real 1775773996] req@ffff8de1d0f2d500 x1862023612472960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773996.864291:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612472960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773996.864296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773996.864298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773996.864299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612472960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775773996.864304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773996.864314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773996.864319:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773996/real 1775773996] req@ffff8de1d0f2c700 x1862023612473088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773996.864326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612473088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773996.864331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773996.864332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773996.864334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775773996.864337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775773996.864346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775773996.864351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775773996/real 1775773996] req@ffff8de1d0f2e680 x1862023612473216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775773996.864357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612473216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775773996.864362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775773996.864364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775773996.864366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775773997.823987:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773998.847943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775773999.871934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774000.895905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774001.919941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774001.983874:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774001.983883:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774001.983886:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774001.983894:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9973 00000100:00080000:3.0:1775774001.983903:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774001.983908:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774001.983941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612473344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774001.983964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774001.983966:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774001.983967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774001.983970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9973 00000100:00080000:3.0:1775774001.983972:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774001.983974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774001.983982:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774001.983991:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612473472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774001.984003:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774001.984006:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774001.984007:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774001.984010:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9973 00000100:00080000:3.0:1775774001.984011:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774001.984014:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774001.984017:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774001.984025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612473344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774001.984025:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612473600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774001.984038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774001.984041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774001.984042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774001.984044:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9973 00000100:00080000:3.0:1775774001.984046:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774001.984048:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774001.984051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774001.984058:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612473728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774001.984064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774001.984066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774001.984067:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774001.984069:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9973 00000100:00080000:3.0:1775774001.984072:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774001.984074:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774001.984078:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774001.984085:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612473856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774001.984116:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774001.984143:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774001.984158:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774001.984171:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774002.943927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774003.967882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774004.991869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775774005.056113:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775774005.056179:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775774005.056204:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774005.056260:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774005.056277:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774005.056286:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774005.056299:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775774005.056328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774001/real 1775774005] req@ffff8de1c7af7b80 x1862023612473600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774005.056362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612473600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774005.056375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774005.056381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774005.056386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774005.056396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774001/real 1775774005] req@ffff8de1c7af6d80 x1862023612473728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774005.056412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612473728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774005.056420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774005.056425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774005.056429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774005.056437:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774001/real 1775774005] req@ffff8de1c7af4a80 x1862023612473856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774005.056451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612473856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774005.056460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774005.056464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774005.056468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473856:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774005.056476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774001/real 1775774005] req@ffff8de1c7af5f80 x1862023612473344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774005.056490:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612473344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774005.056498:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774005.056503:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774005.056506:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612473344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774005.056513:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774001/real 1775774005] req@ffff8de1c7af5880 x1862023612473472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774005.056525:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612473472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774005.056534:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774005.056554:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774005.056558:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612473472:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775774006.015876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774007.039858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774007.103835:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774007.103849:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774007.103855:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774007.103867:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9978 00000100:00080000:3.0:1775774007.103879:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774007.103887:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774007.103931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612473984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774007.103971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774007.103976:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774007.103978:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774007.103983:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9978 00000100:00080000:3.0:1775774007.103987:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774007.103990:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774007.104001:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774007.104015:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612474112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774007.104026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774007.104033:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774007.104035:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774007.104041:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9978 00000100:00080000:3.0:1775774007.104045:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774007.104048:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612473984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774007.104053:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774007.104063:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774007.104080:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612474240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774007.104091:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774007.104094:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774007.104097:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774007.104101:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9978 00000100:00080000:3.0:1775774007.104106:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774007.104111:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774007.104117:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774007.104133:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612474368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774007.104144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774007.104149:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774007.104156:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774007.104159:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774007.104164:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9978 00000100:00080000:3.0:1775774007.104170:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774007.104175:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774007.104183:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774007.104195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774007/real 1775774007] req@ffff8de1c7af7800 x1862023612473984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774007.104200:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612474496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774007.104237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612473984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774007.104252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774007.104260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774007.104267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612473984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774007.104300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774007.104330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774007.104346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774007/real 1775774007] req@ffff8de1c7af7100 x1862023612474112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774007.104367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612474112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774007.104375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774007.104380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774007.104384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774007.104392:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774007.104415:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774007.104429:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774007/real 1775774007] req@ffff8de1c7af5180 x1862023612474240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774007.104442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612474240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774007.104451:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774007.104455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774007.104458:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774007.104465:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774007.104488:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774007.104499:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774007/real 1775774007] req@ffff8de1c7af5880 x1862023612474368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774007.104512:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612474368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774007.104528:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774007.104532:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774007.104536:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774007.104544:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774007.104566:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774007.104592:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774007/real 1775774007] req@ffff8de1c7af5f80 x1862023612474496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774007.104610:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612474496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774007.104619:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774007.104623:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774007.104626:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774008.063829:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774009.087855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774010.111962:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774011.135953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774012.159867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774012.223777:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774012.223785:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774012.223789:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774012.223798:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9983 00000100:00080000:3.0:1775774012.223814:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774012.223820:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774012.223851:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612474624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774012.223873:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774012.223875:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774012.223877:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774012.223880:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9983 00000100:00080000:3.0:1775774012.223882:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774012.223884:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774012.223892:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774012.223901:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612474752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774012.223908:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774012.223911:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774012.223912:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774012.223915:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9983 00000100:00080000:3.0:1775774012.223918:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774012.223920:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774012.223924:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774012.223930:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612474880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774012.223935:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612474624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774012.223939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774012.223943:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774012.223944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774012.223948:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9983 00000100:00080000:3.0:1775774012.223949:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774012.223958:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774012.223961:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774012.223970:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612475008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774012.223976:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774012.223979:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774012.223980:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774012.223982:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9983 00000100:00080000:3.0:1775774012.223985:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774012.223987:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774012.223990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774012.223994:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774012.224001:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612475136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774012.224027:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774012/real 1775774012] req@ffff8de1c7af4a80 x1862023612474624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774012.224042:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612474624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774012.224050:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774012.224053:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774012.224056:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612474624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774012.224061:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774012.224075:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774012.224082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774012/real 1775774012] req@ffff8de1c7af6d80 x1862023612474752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774012.224090:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612474752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774012.224095:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774012.224097:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774012.224098:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774012.224117:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774012.224128:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774012.224133:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774012/real 1775774012] req@ffff8de1c7af7b80 x1862023612474880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774012.224141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612474880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774012.224145:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774012.224147:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774012.224149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612474880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774012.224152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774012.224161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774012.224166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774012/real 1775774012] req@ffff8de1c7af4e00 x1862023612475008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774012.224172:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612475008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774012.224182:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774012.224184:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774012.224186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774012.224189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774012.224198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774012.224202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774012/real 1775774012] req@ffff8de1c7af4380 x1862023612475136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774012.224209:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612475136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774012.224214:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774012.224216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774012.224218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774013.183954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774014.208017:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774015.231999:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774016.255949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774017.280021:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774017.343842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774017.343854:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774017.343859:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774017.343871:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9989 00000100:00080000:1.0:1775774017.343885:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774017.343892:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774017.343941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612475264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774017.343971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774017.343975:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774017.343976:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774017.343980:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9989 00000100:00080000:1.0:1775774017.343982:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774017.343984:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774017.343996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774017.344008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612475392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774017.344016:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774017.344019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774017.344020:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774017.344023:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9989 00000100:00080000:1.0:1775774017.344025:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774017.344029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612475264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774017.344030:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774017.344037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774017.344045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612475520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774017.344057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774017.344060:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774017.344061:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774017.344063:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9989 00000100:00080000:1.0:1775774017.344065:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774017.344068:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774017.344072:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774017.344079:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612475648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774017.344085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774017.344087:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774017.344088:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774017.344090:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9989 00000100:00080000:1.0:1775774017.344103:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774017.344105:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774017.344109:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774017.344116:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774017.344119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612475776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774017.344174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774017/real 1775774017] req@ffff8de1c2e14e00 x1862023612475264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774017.344191:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612475264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774017.344201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774017.344205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774017.344209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612475264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774017.344235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774017.344251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774017.344259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774017/real 1775774017] req@ffff8de1c2e14a80 x1862023612475392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774017.344267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612475392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774017.344273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774017.344275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774017.344277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774017.344281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774017.344291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774017.344296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774017/real 1775774017] req@ffff8de1c2e17480 x1862023612475520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774017.344303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612475520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774017.344320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774017.344321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774017.344323:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774017.344336:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774017.344352:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774017.344358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774017/real 1775774017] req@ffff8de1c2e14700 x1862023612475648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774017.344366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612475648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774017.344372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774017.344374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774017.344377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774017.344380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774017.344391:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774017.344396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774017/real 1775774017] req@ffff8de1c2e15500 x1862023612475776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774017.344403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612475776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774017.344408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774017.344409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774017.344411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612475776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774018.303886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774019.327978:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774020.351926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774021.375876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774022.399900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774022.463841:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774022.463851:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774022.463857:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774022.463867:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9994 00000100:00080000:3.0:1775774022.463880:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774022.463887:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774022.463931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612475904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774022.463961:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774022.463965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774022.463968:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774022.463972:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9994 00000100:00080000:3.0:1775774022.463976:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774022.463981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774022.463993:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774022.464012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612476032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774022.464024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612475904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774022.464034:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774022.464038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774022.464040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774022.464044:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9994 00000100:00080000:3.0:1775774022.464048:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774022.464052:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774022.464059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774022.464075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612476160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774022.464085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774022.464090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774022.464092:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774022.464097:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9994 00000800:00000100:0.0:1775774022.464102:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774022.464112:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774022.464120:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774022.464128:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774022.464141:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774022/real 1775774022] req@ffff8de1c7af4000 x1862023612475904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774022.464145:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612476288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774022.464214:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774022.464217:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774022.464219:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774022.464221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612475904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774022.464229:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9994 00000100:00080000:3.0:1775774022.464235:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774022.464239:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774022.464256:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774022.464260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774022.464266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774022.464270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612475904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774022.464277:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612476416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774022.464299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774022.464322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774022.464330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774022/real 1775774022] req@ffff8de1c7af7480 x1862023612476032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774022.464338:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612476032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774022.464344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774022.464346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774022.464348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774022.464352:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774022.464361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774022.464367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774022/real 1775774022] req@ffff8de1c7af5500 x1862023612476160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774022.464374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612476160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774022.464379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774022.464381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774022.464383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774022.464386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774022.464395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774022.464400:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774022/real 1775774022] req@ffff8de1c7af5c00 x1862023612476288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774022.464407:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612476288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774022.464412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774022.464414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774022.464416:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774022.464419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774022.464428:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774022.464433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774022/real 1775774022] req@ffff8de1c7af6300 x1862023612476416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774022.464439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612476416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774022.464448:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774022.464450:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774022.464452:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774023.423929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774024.447896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774025.471951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774026.495910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774027.519953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774027.583871:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774027.583885:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774027.583891:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774027.583906:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 9999 00000100:00080000:1.0:1775774027.583922:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774027.583931:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774027.583977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612476544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774027.584006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774027.584009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774027.584011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774027.584014:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9999 00000100:00080000:1.0:1775774027.584018:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774027.584020:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774027.584031:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774027.584041:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612476672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774027.584049:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774027.584051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774027.584052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774027.584055:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9999 00000100:00080000:1.0:1775774027.584057:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774027.584059:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774027.584062:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774027.584070:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612476800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774027.584079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774027.584084:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774027.584086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774027.584090:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9999 00000100:00080000:1.0:1775774027.584094:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774027.584099:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612476544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774027.584101:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774027.584112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774027.584126:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612476928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774027.584138:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774027.584141:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774027.584143:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774027.584146:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 9999 00000100:00080000:1.0:1775774027.584150:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774027.584152:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774027.584157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774027.584165:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612477056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774027.584193:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774027.584237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774027/real 1775774027] req@ffff8de1c2e17800 x1862023612476544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774027.584254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612476544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774027.584263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774027.584268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774027.584271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612476544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774027.584277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774027.584294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774027.584302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774027/real 1775774027] req@ffff8de1c2e17100 x1862023612476672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774027.584310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612476672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774027.584316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774027.584319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774027.584321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774027.584324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774027.584334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774027.584339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774027/real 1775774027] req@ffff8de1c2e17b80 x1862023612476800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774027.584346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612476800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774027.584352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774027.584353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774027.584355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774027.584378:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774027.584418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774027.584426:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774027/real 1775774027] req@ffff8de1c2e16680 x1862023612476928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774027.584433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612476928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774027.584439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774027.584441:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774027.584444:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612476928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774027.584448:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774027.584460:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774027.584465:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774027/real 1775774027] req@ffff8de1c2e14380 x1862023612477056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774027.584473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612477056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774027.584478:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774027.584479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774027.584481:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774028.543883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774029.567892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774030.591930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774031.615912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774032.639863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774032.703818:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774032.703827:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774032.703831:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774032.703839:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10004 00000100:00080000:2.0:1775774032.703848:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774032.703854:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774032.703884:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612477184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774032.703905:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774032.703907:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774032.703909:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774032.703911:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10004 00000100:00080000:2.0:1775774032.703913:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774032.703916:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774032.703923:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774032.703930:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612477312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774032.703938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774032.703941:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774032.703942:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774032.703944:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10004 00000100:00080000:2.0:1775774032.703946:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774032.703949:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774032.703952:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774032.703959:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612477184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774032.703962:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612477440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774032.703976:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774032.703979:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774032.703980:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774032.703982:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10004 00000100:00080000:2.0:1775774032.703984:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774032.703986:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774032.703990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774032.703998:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612477568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774032.704003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774032.704005:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774032.704007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774032.704009:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10004 00000100:00080000:2.0:1775774032.704012:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774032.704014:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774032.704017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774032.704018:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774032.704026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612477696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774032.704051:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774032/real 1775774032] req@ffff8de1d0f2ca80 x1862023612477184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774032.704065:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612477184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774032.704073:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774032.704077:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774032.704080:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612477184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774032.704085:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774032.704100:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774032.704107:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774032/real 1775774032] req@ffff8de1d0f2df80 x1862023612477312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774032.704115:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612477312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774032.704121:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774032.704123:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774032.704125:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774032.704142:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774032.704152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774032.704166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774032/real 1775774032] req@ffff8de1d0f2e680 x1862023612477440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774032.704174:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612477440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774032.704180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774032.704182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774032.704184:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774032.704188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774032.704199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774032.704205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774032/real 1775774032] req@ffff8de1d0f2c700 x1862023612477568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774032.704212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612477568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774032.704217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774032.704219:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774032.704221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774032.704224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774032.704234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774032.704239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774032/real 1775774032] req@ffff8de1d0f2d500 x1862023612477696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774032.704246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612477696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774032.704251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774032.704252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774032.704254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774033.663871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774034.687896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774035.711922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774036.735948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774037.759892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774037.823833:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774037.823847:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774037.823853:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774037.823867:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10009 00000100:00080000:2.0:1775774037.823884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774037.823893:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774037.823945:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612477824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774037.823977:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774037.823981:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774037.823983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774037.823987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10009 00000100:00080000:2.0:1775774037.823991:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774037.823996:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774037.824008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774037.824021:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612477952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774037.824032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774037.824034:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612477824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774037.824038:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774037.824041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774037.824047:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10009 00000100:00080000:2.0:1775774037.824051:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774037.824055:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774037.824059:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774037.824075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612478080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774037.824085:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774037.824089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774037.824091:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774037.824096:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10009 00000100:00080000:2.0:1775774037.824100:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774037.824105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774037.824112:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774037.824118:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774037.824125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612478208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774037.824134:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774037.824137:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774037.824138:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774037.824141:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10009 00000100:00080000:2.0:1775774037.824145:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774037.824147:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774037.824152:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774037.824160:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612478336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774037.824164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774037/real 1775774037] req@ffff8de1d0f2e300 x1862023612477824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774037.824185:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612477824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774037.824198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774037.824204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774037.824237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612477824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774037.824265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774037.824287:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774037.824297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774037/real 1775774037] req@ffff8de1d0f2f100 x1862023612477952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774037.824306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612477952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774037.824312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774037.824314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774037.824316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612477952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774037.824320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774037.824332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774037.824338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774037/real 1775774037] req@ffff8de1d0f2d500 x1862023612478080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774037.824346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612478080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774037.824355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774037.824358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774037.824360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774037.824363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774037.824374:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774037.824379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774037/real 1775774037] req@ffff8de1d0f2c700 x1862023612478208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774037.824387:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612478208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774037.824392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774037.824394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774037.824396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774037.824400:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774037.824410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774037.824419:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774037/real 1775774037] req@ffff8de1d0f2e680 x1862023612478336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774037.824431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612478336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774037.824439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774037.824442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774037.824447:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774038.783954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774039.807882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774040.831903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774041.855876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774042.879916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774042.943840:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774042.943848:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774042.943853:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774042.943862:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10014 00000100:00080000:2.0:1775774042.943872:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774042.943878:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774042.943918:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612478464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774042.943942:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774042.943945:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774042.943947:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774042.943950:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10014 00000100:00080000:2.0:1775774042.943952:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774042.943955:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774042.943963:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774042.943972:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612478592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774042.943984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774042.943986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774042.943988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774042.943991:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10014 00000100:00080000:2.0:1775774042.943993:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774042.943997:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774042.944000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612478464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775774042.944001:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774042.944013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612478720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774042.944020:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774042.944022:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774042.944023:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774042.944026:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10014 00000100:00080000:2.0:1775774042.944029:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774042.944031:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774042.944035:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774042.944042:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612478848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774042.944048:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774042.944050:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774042.944051:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774042.944053:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10014 00000100:00080000:2.0:1775774042.944056:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774042.944058:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774042.944061:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774042.944067:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612478976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774042.944073:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774042.944116:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774042/real 1775774042] req@ffff8de1d0f2df80 x1862023612478464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774042.944152:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612478464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774042.944164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774042.944170:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774042.944183:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612478464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774042.944197:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774042.944224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774042.944239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774042/real 1775774042] req@ffff8de1d0f2ca80 x1862023612478592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774042.944254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612478592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774042.944263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774042.944266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774042.944270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774042.944300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774042.944332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774042.944347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774042/real 1775774042] req@ffff8de1d0f2e680 x1862023612478720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774042.944361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612478720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774042.944369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774042.944374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774042.944378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774042.944386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774042.944414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774042.944432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774042/real 1775774042] req@ffff8de1d0f2c700 x1862023612478848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774042.944449:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612478848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774042.944457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774042.944461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774042.944466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774042.944474:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774042.944496:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774042.944511:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774042/real 1775774042] req@ffff8de1d0f2d500 x1862023612478976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774042.944526:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612478976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774042.944534:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774042.944538:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774042.944542:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612478976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774043.903919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774044.927901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774045.951886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774046.975915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774047.999853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774048.063830:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774048.063842:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774048.063847:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774048.063858:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10019 00000100:00080000:1.0:1775774048.063871:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774048.063878:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774048.063919:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612479104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774048.063958:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774048.063962:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774048.063964:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774048.063969:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10019 00000100:00080000:1.0:1775774048.063973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774048.063978:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774048.063989:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774048.063999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612479104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774048.064008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612479232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774048.064021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774048.064025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774048.064027:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774048.064048:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10019 00000100:00080000:1.0:1775774048.064060:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774048.064066:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775774048.064071:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775774048.064075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774048.064090:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612479360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774048.064102:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774048.064104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774048/real 1775774048] req@ffff8de1c2e16a00 x1862023612479104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774048.064112:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774048.064117:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774048.064125:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10019 00000100:00100000:0.0:1775774048.064132:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612479104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774048.064143:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774048.064144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774048.064152:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775774048.064154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:1.0:1775774048.064160:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774048.064162:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612479104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774048.064176:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612479488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774048.064189:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774048.064193:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479232:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775774048.064195:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774048.064199:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774048.064205:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10019 00000100:00080000:1.0:1775774048.064210:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774048.064214:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774048.064220:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774048.064222:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774048.064236:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612479616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774048.064238:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774048/real 1775774048] req@ffff8de1c2e14380 x1862023612479232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774048.064273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612479232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774048.064280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774048.064283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774048.064285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774048.064290:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774048.064303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774048.064308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774048/real 1775774048] req@ffff8de1c2e16680 x1862023612479360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774048.064316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612479360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774048.064321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774048.064323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774048.064324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774048.064335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774048.064345:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774048.064351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774048/real 1775774048] req@ffff8de1c2e17b80 x1862023612479488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774048.064358:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612479488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774048.064363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774048.064365:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774048.064368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774048.064371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774048.064380:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774048.064385:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774048/real 1775774048] req@ffff8de1c2e17100 x1862023612479616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774048.064396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612479616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774048.064404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774048.064408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774048.064411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774049.023884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774050.047917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774051.071947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774052.095876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774053.119879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774053.183866:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774053.183874:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774053.183879:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774053.183887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10024 00000100:00080000:3.0:1775774053.183897:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774053.183902:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774053.183935:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612479744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774053.183978:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774053.183981:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774053.183983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774053.183986:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10024 00000100:00080000:3.0:1775774053.183988:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774053.183990:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774053.184000:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774053.184010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612479872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774053.184018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774053.184023:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612479744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774053.184023:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774053.184026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774053.184033:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10024 00000100:00080000:3.0:1775774053.184035:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774053.184037:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774053.184040:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774053.184048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612480000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774053.184058:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774053.184061:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774053.184063:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774053.184065:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10024 00000100:00080000:3.0:1775774053.184067:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774053.184069:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774053.184073:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774053.184080:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612480128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774053.184083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774053.184091:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774053.184093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774053.184095:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774053.184099:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10024 00000100:00080000:3.0:1775774053.184101:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774053.184103:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774053.184107:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774053.184115:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612480256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774053.184120:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774053/real 1775774053] req@ffff8de1c7af4700 x1862023612479744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774053.184136:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612479744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774053.184145:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774053.184148:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774053.184152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612479744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774053.184169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774053.184183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774053.184191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774053/real 1775774053] req@ffff8de1c7af6680 x1862023612479872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774053.184199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612479872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774053.184204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774053.184206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774053.184208:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612479872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774053.184212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774053.184221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774053.184226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774053/real 1775774053] req@ffff8de1c7af6a00 x1862023612480000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774053.184233:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612480000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774053.184238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774053.184240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774053.184242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774053.184246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774053.184255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774053.184261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774053/real 1775774053] req@ffff8de1c7af6300 x1862023612480128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774053.184268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612480128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774053.184273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774053.184274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774053.184276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774053.184279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774053.184288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774053.184292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774053/real 1775774053] req@ffff8de1c7af5c00 x1862023612480256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774053.184299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612480256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774053.184304:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774053.184305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774053.184307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774054.143899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774055.167896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774056.191879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774057.215933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774058.239879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774058.303815:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774058.303826:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774058.303831:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774058.303841:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10030 00000100:00080000:1.0:1775774058.303865:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774058.303911:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774058.303945:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612480384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774058.303966:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774058.303974:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774058.303976:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774058.303979:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10030 00000100:00080000:1.0:1775774058.303983:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774058.303986:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774058.303993:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774058.304002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612480512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774058.304010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774058.304013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774058.304014:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774058.304017:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10030 00000100:00080000:1.0:1775774058.304020:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774058.304022:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612480384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774058.304024:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774058.304032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774058.304039:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612480640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774058.304046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774058.304049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774058.304050:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774058.304053:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10030 00000100:00080000:1.0:1775774058.304056:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774058.304058:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774058.304062:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774058.304069:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612480768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774058.304076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774058.304078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774058.304079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775774058.304083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774058.304084:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10030 00000100:00080000:1.0:1775774058.304089:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774058.304092:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774058.304096:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774058.304104:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612480896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774058.304123:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774058/real 1775774058] req@ffff8de1c2e17800 x1862023612480384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774058.304138:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612480384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774058.304145:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774058.304147:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774058.304150:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612480384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774058.304155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774058.304170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774058.304177:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774058/real 1775774058] req@ffff8de1c2e15500 x1862023612480512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774058.304185:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612480512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774058.304190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774058.304192:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774058.304195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774058.304213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774058.304223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774058.304228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774058/real 1775774058] req@ffff8de1c2e14700 x1862023612480640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774058.304236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612480640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774058.304241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774058.304243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774058.304245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774058.304248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774058.304258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774058.304262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774058/real 1775774058] req@ffff8de1c2e17480 x1862023612480768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774058.304270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612480768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774058.304274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774058.304276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774058.304278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774058.304281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774058.304289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774058.304294:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774058/real 1775774058] req@ffff8de1c2e14a80 x1862023612480896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774058.304300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612480896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774058.304309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774058.304311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774058.304313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612480896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774059.263895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774060.287886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774061.311951:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774062.335917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774063.359920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774063.423880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774063.423890:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774063.423895:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774063.423906:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10035 00000100:00080000:3.0:1775774063.423920:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774063.423927:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774063.423977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612481024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774063.424004:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774063.424007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774063.424008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774063.424012:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10035 00000100:00080000:3.0:1775774063.424014:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774063.424017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774063.424027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774063.424040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612481152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774063.424047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774063.424051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774063.424053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774063.424056:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10035 00000100:00080000:3.0:1775774063.424058:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774063.424060:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774063.424064:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774063.424071:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612481280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774063.424080:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774063.424083:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774063.424085:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774063.424089:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10035 00000100:00080000:3.0:1775774063.424092:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774063.424098:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774063.424103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612481024:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774063.424103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774063.424114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612481408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774063.424121:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774063.424123:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774063.424124:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774063.424128:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10035 00000100:00080000:3.0:1775774063.424132:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774063.424138:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774063.424143:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774063.424155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612481536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774063.424189:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774063.424227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774063/real 1775774063] req@ffff8de1c7af5500 x1862023612481024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774063.424246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612481024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774063.424257:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774063.424261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774063.424265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612481024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774063.424273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774063.424294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774063.424304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774063/real 1775774063] req@ffff8de1c7af7480 x1862023612481152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774063.424315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612481152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774063.424323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774063.424327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774063.424329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774063.424353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774063.424383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774063.424394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774063/real 1775774063] req@ffff8de1c7af4000 x1862023612481280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774063.424407:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612481280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774063.424415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774063.424419:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774063.424422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774063.424429:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774063.424450:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774063.424461:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774063/real 1775774063] req@ffff8de1c7af4380 x1862023612481408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774063.424480:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612481408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774063.424497:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774063.424501:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774063.424505:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774063.424511:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774063.424529:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774063.424539:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774063/real 1775774063] req@ffff8de1c7af4e00 x1862023612481536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774063.424549:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612481536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774063.424555:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774063.424557:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774063.424559:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774064.383938:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774065.407882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774066.431907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774067.455847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774068.479907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774068.543880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774068.543888:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774068.543892:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774068.543901:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10040 00000100:00080000:0.0:1775774068.543912:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774068.543918:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774068.543950:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612481664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774068.543982:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774068.543985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774068.543987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774068.543990:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10040 00000100:00080000:0.0:1775774068.543994:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774068.543997:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774068.544006:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774068.544015:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612481792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774068.544028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774068.544036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775774068.544037:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612481664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774068.544041:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774068.544052:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10040 00000100:00080000:0.0:1775774068.544056:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774068.544066:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774068.544074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774068.544092:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612481920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774068.544100:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774068.544103:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774068.544104:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774068.544107:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10040 00000100:00080000:0.0:1775774068.544110:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774068.544114:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774068.544118:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774068.544127:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612482048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774068.544134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774068.544137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774068.544139:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774068.544144:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10040 00000100:00080000:0.0:1775774068.544148:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774068.544152:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774068.544157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774068.544173:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612482176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774068.544198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774068.544250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774068.544268:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774068.544295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774069.503971:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774070.527844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774071.551863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1775774071.616047:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:3.0:1775774071.616099:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1775774071.616117:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774071.616165:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774071.616176:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774071.616185:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774071.616193:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775774071.616285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774068/real 1775774071] req@ffff8de1c5680700 x1862023612481792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774071.616315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612481792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774071.616330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774071.616336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774071.616340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774071.616348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774068/real 1775774071] req@ffff8de1c5682d80 x1862023612481920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774071.616362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612481920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774071.616370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774071.616374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774071.616378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612481920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774071.616386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774068/real 1775774071] req@ffff8de1c5682680 x1862023612482048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774071.616400:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612482048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774071.616422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774071.616426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774071.616430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774071.616437:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774068/real 1775774071] req@ffff8de1c5683b80 x1862023612482176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774071.616453:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612482176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774071.616461:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774071.616464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774071.616468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482176:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774071.616476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774068/real 1775774071] req@ffff8de1c5682300 x1862023612481664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774071.616489:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612481664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774071.616495:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774071.616498:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774071.616501:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612481664:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775774072.575852:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774073.599848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774073.663842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774073.663853:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774073.663858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774073.663868:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10045 00000100:00080000:3.0:1775774073.663879:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774073.663885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774073.663918:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612482304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774073.663945:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774073.663949:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774073.663951:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774073.663955:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10045 00000100:00080000:3.0:1775774073.663960:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774073.663964:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774073.663975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774073.663990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612482304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774073.663992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612482432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774073.664010:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774073.664014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774073.664017:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774073.664021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10045 00000100:00080000:3.0:1775774073.664025:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774073.664029:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774073.664034:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774073.664045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612482560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774073.664056:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774073.664060:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774073.664061:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774073.664064:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10045 00000100:00080000:3.0:1775774073.664068:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774073.664071:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774073.664076:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774073.664082:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774073.664096:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612482688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774073.664107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775774073.664109:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774073/real 1775774073] req@ffff8de1c7af7b80 x1862023612482304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774073.664117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774073.664122:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774073.664131:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10045 00000100:00080000:3.0:1775774073.664136:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774073.664141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612482304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774073.664144:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774073.664153:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775774073.664165:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774073.664172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774073.664172:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612482816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774073.664183:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612482304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774073.664226:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774073.664253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774073.664284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774073/real 1775774073] req@ffff8de1c7af6d80 x1862023612482432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774073.664298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612482432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774073.664307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774073.664312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774073.664315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774073.664322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774073.664342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774073.664352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774073/real 1775774073] req@ffff8de1c7af4a80 x1862023612482560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774073.664364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612482560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774073.664372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774073.664375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774073.664379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774073.664385:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774073.664403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774073.664414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774073/real 1775774073] req@ffff8de1c7af5f80 x1862023612482688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774073.664425:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612482688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774073.664432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774073.664435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774073.664439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774073.664445:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774073.664463:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774073.664473:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774073/real 1775774073] req@ffff8de1c7af5880 x1862023612482816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774073.664485:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612482816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774073.664492:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774073.664496:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774073.664499:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612482816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774074.623881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774075.647863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774076.671860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774077.695915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774078.719880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774078.783813:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774078.783824:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774078.783837:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774078.783851:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10050 00000100:00080000:0.0:1775774078.783864:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774078.783872:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774078.783920:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612482944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774078.783947:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774078.783951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774078.783953:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774078.783958:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10050 00000100:00080000:0.0:1775774078.783962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774078.783967:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774078.783978:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774078.783992:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612482944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774078.783995:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612483072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774078.784010:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774078.784013:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774078.784016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774078.784020:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10050 00000100:00080000:0.0:1775774078.784024:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774078.784043:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774078.784049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775774078.784062:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774078.784064:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612483200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774078.784077:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774078.784082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774078.784084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774078.784089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10050 00000100:00080000:0.0:1775774078.784094:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774078.784098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774078/real 1775774078] req@ffff8de1c5682300 x1862023612482944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774078.784102:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774078.784110:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774078.784126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612482944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774078.784127:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612483328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774078.784157:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774078.784160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774078.784163:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774078.784167:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10050 00000100:00080000:2.0:1775774078.784169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774078.784173:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774078.784176:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774078.784181:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612482944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774078.784194:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774078.784201:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774078.784210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774078.784216:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612483456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774078.784241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774078.784268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774078/real 1775774078] req@ffff8de1c5683b80 x1862023612483072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774078.784289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612483072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774078.784297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774078.784302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774078.784305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774078.784311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774078.784336:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774078.784350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774078/real 1775774078] req@ffff8de1c5682680 x1862023612483200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774078.784365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612483200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774078.784375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774078.784378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774078.784382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774078.784390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774078.784413:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774078.784427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774078/real 1775774078] req@ffff8de1c5682d80 x1862023612483328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774078.784440:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612483328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774078.784456:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774078.784460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774078.784463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774078.784487:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774078.784529:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774078.784548:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774078/real 1775774078] req@ffff8de1c5680700 x1862023612483456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774078.784561:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612483456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774078.784569:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774078.784572:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774078.784576:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774079.743902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774080.767857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774081.791891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774082.815942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774083.839949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774083.903896:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774083.903907:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774083.903912:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774083.903923:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10055 00000100:00080000:3.0:1775774083.903935:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774083.903942:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774083.903996:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612483584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774083.904023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774083.904028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774083.904030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774083.904034:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10055 00000100:00080000:3.0:1775774083.904039:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774083.904043:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774083.904056:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774083.904074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612483712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774083.904085:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774083.904090:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775774083.904091:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612483584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774083.904092:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774083.904101:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10055 00000100:00080000:3.0:1775774083.904104:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774083.904107:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774083.904111:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774083.904122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612483840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774083.904129:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774083.904132:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774083.904133:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774083.904135:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10055 00000100:00080000:3.0:1775774083.904137:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774083.904140:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774083.904144:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774083.904150:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612483968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774083.904156:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774083.904159:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774083.904161:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774083.904163:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10055 00000100:00080000:3.0:1775774083.904166:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774083.904168:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774083.904172:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774083.904179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774083.904181:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612484096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774083.904227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774083/real 1775774083] req@ffff8de1c7af5180 x1862023612483584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774083.904243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612483584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774083.904252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774083.904256:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774083.904259:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612483584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774083.904283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774083.904301:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774083.904309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774083/real 1775774083] req@ffff8de1c7af7100 x1862023612483712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774083.904317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612483712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774083.904322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774083.904325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774083.904327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774083.904331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774083.904341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774083.904346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774083/real 1775774083] req@ffff8de1c7af7800 x1862023612483840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774083.904353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612483840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774083.904358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774083.904360:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774083.904362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774083.904365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774083.904375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774083.904386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774083/real 1775774083] req@ffff8de1c7af5880 x1862023612483968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774083.904398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612483968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774083.904427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774083.904429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774083.904432:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612483968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774083.904436:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774083.904451:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774083.904458:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774083/real 1775774083] req@ffff8de1c7af5f80 x1862023612484096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774083.904466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612484096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774083.904472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774083.904474:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774083.904476:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774084.863899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774085.887930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774086.911925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774087.935914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774088.959970:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774089.023813:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774089.023826:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774089.023833:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774089.023848:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10060 00000100:00080000:0.0:1775774089.023864:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774089.023873:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774089.023926:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612484224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774089.023962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774089.023971:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774089.023974:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774089.023979:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10060 00000100:00080000:0.0:1775774089.023984:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774089.023989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774089.024002:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774089.024015:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612484224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774089.024020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612484352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774089.024034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774089.024038:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774089.024040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774089.024045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10060 00000100:00080000:0.0:1775774089.024049:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774089.024054:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774089.024060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774089.024072:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612484480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774089.024083:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774089.024087:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774089.024089:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775774089.024094:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774089.024099:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10060 00000100:00080000:0.0:1775774089.024104:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774089.024110:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774089.024116:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774089.024129:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612484608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774089.024140:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774089.024144:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1775774089.024146:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774089/real 1775774089] req@ffff8de1c5681c00 x1862023612484224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774089.024147:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774089.024158:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10060 00000100:00080000:0.0:1775774089.024165:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774089.024169:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774089.024173:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612484224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775774089.024177:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774089.024195:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612484736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774089.024196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774089.024205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774089.024212:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612484224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774089.024240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774089.024258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774089.024267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774089/real 1775774089] req@ffff8de1c5681f80 x1862023612484352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774089.024276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612484352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774089.024288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774089.024290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774089.024292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774089.024297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774089.024309:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774089.024341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774089/real 1775774089] req@ffff8de1c5682a00 x1862023612484480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774089.024349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612484480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774089.024355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774089.024357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774089.024359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774089.024369:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774089.024384:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774089.024390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774089/real 1775774089] req@ffff8de1c5680380 x1862023612484608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774089.024398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612484608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774089.024403:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774089.024406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774089.024408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774089.024411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774089.024421:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774089.024425:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774089/real 1775774089] req@ffff8de1c5680000 x1862023612484736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774089.024432:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612484736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774089.024437:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774089.024439:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774089.024441:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774089.983878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774091.007974:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774092.031893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774093.055991:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774094.079884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774094.143861:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774094.143871:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774094.143876:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774094.143887:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10065 00000100:00080000:0.0:1775774094.143899:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774094.143905:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774094.143937:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612484864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774094.143959:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774094.143962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774094.143963:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774094.143966:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10065 00000100:00080000:0.0:1775774094.143969:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774094.143971:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774094.143978:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774094.143987:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612484992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774094.143997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774094.144000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774094.144001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774094.144004:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10065 00000100:00080000:0.0:1775774094.144006:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774094.144009:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774094.144013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774094.144026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612485120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774094.144038:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612484864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774094.144042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774094.144054:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774094.144056:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774094.144062:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10065 00000100:00080000:0.0:1775774094.144067:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774094.144072:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774094.144079:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774094.144094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612485248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774094.144108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774094.144112:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774094.144114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774094.144117:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10065 00000100:00080000:0.0:1775774094.144124:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774094.144127:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774094.144131:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774094.144137:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774094.144145:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612485376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774094.144185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774094/real 1775774094] req@ffff8de1c5683480 x1862023612484864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774094.144203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612484864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774094.144212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774094.144216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774094.144219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612484864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774094.144250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774094.144272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774094.144282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774094/real 1775774094] req@ffff8de1c5681500 x1862023612484992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774094.144291:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612484992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774094.144297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774094.144299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774094.144302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612484992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774094.144326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774094.144338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774094.144344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774094/real 1775774094] req@ffff8de1c5681880 x1862023612485120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774094.144352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612485120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774094.144362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774094.144364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774094.144366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774094.144376:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774094.144387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774094.144394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774094/real 1775774094] req@ffff8de1c5680e00 x1862023612485248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774094.144407:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612485248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774094.144415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774094.144418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774094.144422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774094.144428:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774094.144449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774094.144461:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774094/real 1775774094] req@ffff8de1c5683800 x1862023612485376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774094.144471:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612485376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774094.144484:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774094.144487:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774094.144489:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774095.103904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774096.127872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774097.151862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774098.175877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774099.199903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774099.263877:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774099.263885:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774099.263889:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774099.263899:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10071 00000100:00080000:0.0:1775774099.263911:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774099.263918:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774099.263961:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612485504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774099.263980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774099.263983:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774099.263984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774099.263987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10071 00000100:00080000:0.0:1775774099.263989:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774099.263992:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774099.264000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774099.264008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612485632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774099.264017:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774099.264020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774099.264021:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774099.264028:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10071 00000100:00100000:2.0:1775774099.264030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612485504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774099.264032:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774099.264040:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774099.264046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774099.264059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612485760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774099.264066:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774099.264069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774099.264070:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774099.264073:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10071 00000100:00080000:0.0:1775774099.264077:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774099.264080:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774099.264084:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774099.264090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612485888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774099.264096:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774099.264097:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774099.264098:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774099.264101:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10071 00000100:00080000:0.0:1775774099.264106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774099.264108:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774099.264111:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774099.264120:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774099.264121:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612486016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774099.264184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774099/real 1775774099] req@ffff8de1c5683800 x1862023612485504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774099.264201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612485504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774099.264211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774099.264215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774099.264219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612485504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774099.264245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774099.264264:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774099.264273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774099/real 1775774099] req@ffff8de1c5680e00 x1862023612485632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774099.264281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612485632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774099.264287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774099.264289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774099.264292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774099.264296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774099.264306:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774099.264313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774099/real 1775774099] req@ffff8de1c5681880 x1862023612485760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774099.264321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612485760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774099.264326:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774099.264328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774099.264330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774099.264336:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774099.264355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774099.264366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774099/real 1775774099] req@ffff8de1c5681500 x1862023612485888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774099.264379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612485888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774099.264388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774099.264392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774099.264395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612485888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774099.264402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774099.264418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774099.264425:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774099/real 1775774099] req@ffff8de1c5683480 x1862023612486016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774099.264433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612486016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774099.264439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774099.264441:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774099.264443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774100.223877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774101.247888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774102.271872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774103.295951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774104.319925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774104.383855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774104.383864:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774104.383868:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774104.383877:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10076 00000100:00080000:2.0:1775774104.383887:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774104.383892:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774104.383925:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612486144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774104.383949:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774104.383953:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774104.383955:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774104.383959:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10076 00000100:00080000:2.0:1775774104.383962:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774104.383967:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774104.383979:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774104.383993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612486272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774104.384002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612486144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774104.384019:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774104.384023:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774104.384025:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774104.384031:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10076 00000100:00080000:2.0:1775774104.384037:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774104.384042:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774104.384072:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774104.384086:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612486400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774104.384094:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774104.384101:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774104.384102:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774104.384106:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10076 00000100:00080000:2.0:1775774104.384113:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775774104.384113:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774104.384124:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774104.384128:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774104.384139:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612486528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774104.384147:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774104.384150:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774104.384151:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774104.384153:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10076 00000100:00080000:2.0:1775774104.384156:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774104.384160:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774104.384163:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774104.384174:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612486656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774104.384187:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774104/real 1775774104] req@ffff8de1d0f2f100 x1862023612486144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774104.384214:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612486144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774104.384227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774104.384232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774104.384237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612486144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774104.384280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774104.384311:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774104.384327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774104/real 1775774104] req@ffff8de1d0f2e300 x1862023612486272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774104.384341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612486272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774104.384351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774104.384355:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774104.384359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774104.384366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774104.384394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774104.384407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774104/real 1775774104] req@ffff8de1d0f2d500 x1862023612486400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774104.384421:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612486400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774104.384430:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774104.384433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774104.384437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774104.384445:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774104.384470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774104.384482:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774104/real 1775774104] req@ffff8de1d0f2c700 x1862023612486528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774104.384495:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612486528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774104.384504:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774104.384508:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774104.384512:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774104.384519:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774104.384549:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774104.384563:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774104/real 1775774104] req@ffff8de1d0f2e680 x1862023612486656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774104.384584:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612486656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774104.384592:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774104.384596:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774104.384600:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774105.343935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774106.367905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774107.391925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774108.415952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774109.439882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774109.503859:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774109.503867:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774109.503871:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774109.503880:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10081 00000100:00080000:3.0:1775774109.503890:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774109.503896:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774109.503930:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612486784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774109.503967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774109.503971:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774109.503973:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774109.503979:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10081 00000100:00080000:3.0:1775774109.503983:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774109.503987:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774109.503998:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774109.504002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612486784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774109.504019:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612486912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774109.504036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774109.504040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774109.504042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774109.504046:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10081 00000100:00080000:3.0:1775774109.504052:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774109.504055:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774109.504061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775774109.504063:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774109.504078:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612487040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774109.504089:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774109.504093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1775774109.504096:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774109/real 1775774109] req@ffff8de1c7af4a80 x1862023612486784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774109.504096:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774109.504105:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10081 00000100:00080000:3.0:1775774109.504114:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774109.504119:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774109.504126:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774109.504127:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612486784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774109.504141:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775774109.504142:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612487168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774109.504151:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774109.504159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612486784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774109.504161:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774109.504167:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774109.504169:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774109.504173:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10081 00000100:00080000:3.0:1775774109.504177:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774109.504181:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774109.504186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486912:192.168.201.137@tcp:38:kworker.0 00000008:00100000:3.0:1775774109.504187:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774109.504207:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612487296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774109.504218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774109.504235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774109/real 1775774109] req@ffff8de1c7af6d80 x1862023612486912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774109.504250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612486912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774109.504259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774109.504262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774109.504266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612486912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774109.504272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774109.504308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774109.504320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774109/real 1775774109] req@ffff8de1c7af7b80 x1862023612487040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774109.504332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612487040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774109.504340:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774109.504344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774109.504347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774109.504354:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774109.504375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774109.504386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774109/real 1775774109] req@ffff8de1c7af4e00 x1862023612487168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774109.504401:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612487168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774109.504406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774109.504408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774109.504410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774109.504422:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774109.504437:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774109.504443:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774109/real 1775774109] req@ffff8de1c7af4380 x1862023612487296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774109.504456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612487296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774109.504460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774109.504463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774109.504465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774110.463917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774111.487942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774112.511993:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774113.535850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774114.559897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774114.623790:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774114.623796:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774114.623799:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774114.623806:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10086 00000100:00080000:1.0:1775774114.623815:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774114.623820:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774114.623845:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612487424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774114.623880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774114.623883:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774114.623884:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774114.623887:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10086 00000100:00080000:1.0:1775774114.623890:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774114.623892:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774114.623900:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774114.623910:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612487552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774114.623914:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612487424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774114.623923:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774114.623925:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774114.623926:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774114.623929:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10086 00000100:00080000:1.0:1775774114.623930:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774114.623932:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774114.623935:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774114.623943:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612487680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774114.623948:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774114.623950:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774114.623951:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774114.623953:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10086 00000100:00080000:1.0:1775774114.623955:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774114.623957:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774114.623960:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774114.623966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612487808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774114.623975:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775774114.623976:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774114.623980:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774114.623982:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774114.623985:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10086 00000100:00080000:1.0:1775774114.623988:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774114.623990:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774114.623992:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774114.623999:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612487936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774114.624012:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774114/real 1775774114] req@ffff8de1c2e14e00 x1862023612487424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774114.624031:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612487424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774114.624042:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774114.624046:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774114.624049:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612487424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774114.624073:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774114.624106:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774114.624119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774114/real 1775774114] req@ffff8de1c2e14a80 x1862023612487552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774114.624133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612487552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774114.624147:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774114.624151:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774114.624155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774114.624162:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774114.624188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774114.624202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774114/real 1775774114] req@ffff8de1c2e17480 x1862023612487680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774114.624218:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612487680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774114.624226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774114.624229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774114.624232:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774114.624239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774114.624260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774114.624272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774114/real 1775774114] req@ffff8de1c2e14700 x1862023612487808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774114.624283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612487808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774114.624291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774114.624294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774114.624298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774114.624304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774114.624325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774114.624337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774114/real 1775774114] req@ffff8de1c2e15500 x1862023612487936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774114.624349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612487936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774114.624358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774114.624362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774114.624366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612487936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774115.583839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774116.607911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774117.631928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774118.655886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774119.679876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774119.743927:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774119.743936:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774119.743940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774119.743948:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10091 00000100:00080000:3.0:1775774119.743958:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774119.743964:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774119.743997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612488064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774119.744024:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774119.744027:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774119.744029:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774119.744032:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10091 00000100:00080000:3.0:1775774119.744036:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774119.744039:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774119.744049:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774119.744061:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612488192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774119.744071:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774119.744075:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774119.744077:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774119.744080:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612488064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774119.744084:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10091 00000100:00080000:3.0:1775774119.744090:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774119.744094:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774119.744098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774119.744109:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612488320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774119.744117:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774119.744120:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774119.744122:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774119.744125:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10091 00000100:00080000:3.0:1775774119.744141:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774119.744145:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775774119.744149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775774119.744153:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774119.744165:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612488448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774119.744174:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774119.744177:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774119.744178:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774119.744184:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10091 00000100:00100000:2.0:1775774119.744185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774119/real 1775774119] req@ffff8de1c7af4000 x1862023612488064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774119.744188:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774119.744195:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774119.744203:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774119.744213:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612488576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774119.744216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612488064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774119.744241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774119.744245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774119.744249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612488064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774119.744277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774119.744294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774119.744303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774119/real 1775774119] req@ffff8de1c7af7480 x1862023612488192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774119.744310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612488192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774119.744315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774119.744317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774119.744319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774119.744322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774119.744331:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774119.744336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774119/real 1775774119] req@ffff8de1c7af5500 x1862023612488320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774119.744342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612488320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774119.744346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774119.744348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774119.744350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774119.744352:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774119.744361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774119.744365:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774119/real 1775774119] req@ffff8de1c7af5c00 x1862023612488448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774119.744372:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612488448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774119.744380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774119.744383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774119.744386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774119.744390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774119.744406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774119.744416:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774119/real 1775774119] req@ffff8de1c7af6300 x1862023612488576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774119.744427:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612488576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774119.744434:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774119.744444:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774119.744446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774120.703880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774121.727886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774122.751914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774123.775874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774124.799903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774124.863870:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774124.863879:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774124.863884:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774124.863894:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10096 00000100:00080000:0.0:1775774124.863907:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774124.863915:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774124.863961:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612488704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774124.863984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774124.863986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774124.863988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774124.863991:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10096 00000100:00080000:0.0:1775774124.863993:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774124.863995:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774124.864004:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774124.864011:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612488832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774124.864018:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774124.864021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774124.864022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774124.864025:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10096 00000100:00080000:0.0:1775774124.864026:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774124.864028:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774124.864031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774124.864037:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612488960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774124.864043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775774124.864045:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612488704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774124.864046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774124.864049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774124.864056:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10096 00000100:00080000:0.0:1775774124.864058:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774124.864060:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774124.864062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774124.864068:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612489088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774124.864073:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774124.864075:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774124.864076:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774124.864078:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10096 00000100:00080000:0.0:1775774124.864080:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774124.864082:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774124.864085:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774124.864091:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612489216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774124.864130:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774124.864171:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774124/real 1775774124] req@ffff8de1c5680000 x1862023612488704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774124.864191:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612488704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774124.864202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774124.864206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774124.864210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612488704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774124.864218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774124.864236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774124.864244:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774124/real 1775774124] req@ffff8de1c5680380 x1862023612488832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774124.864251:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612488832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774124.864256:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774124.864258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774124.864260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774124.864286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774124.864304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774124.864313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774124/real 1775774124] req@ffff8de1c5682a00 x1862023612488960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774124.864324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612488960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774124.864332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774124.864335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774124.864339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612488960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774124.864344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774124.864359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774124.864366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774124/real 1775774124] req@ffff8de1c5681f80 x1862023612489088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774124.864373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612489088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774124.864378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774124.864380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774124.864382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774124.864384:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774124.864400:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774124.864405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774124/real 1775774124] req@ffff8de1c5681c00 x1862023612489216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774124.864415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612489216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774124.864422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774124.864425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774124.864428:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774125.823922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774126.847921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774127.871890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774128.895882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774129.919929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774129.983816:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774129.983825:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774129.983829:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774129.983839:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10101 00000100:00080000:0.0:1775774129.983852:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774129.983859:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774129.983895:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612489344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774129.983915:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774129.983917:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774129.983919:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774129.983922:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10101 00000100:00080000:0.0:1775774129.983925:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774129.983929:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774129.983940:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774129.983949:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612489344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774129.983955:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612489472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774129.983967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774129.983970:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774129.983971:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774129.983974:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10101 00000100:00080000:0.0:1775774129.983977:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774129.983979:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774129.983983:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774129.983994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612489600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774129.984003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774129.984007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774129.984009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774129.984012:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10101 00000100:00080000:0.0:1775774129.984016:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774129.984021:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774129.984026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774129.984033:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774129.984038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612489728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774129.984049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774129.984053:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774129.984055:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774129.984060:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10101 00000100:00080000:0.0:1775774129.984064:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774129.984065:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774129/real 1775774129] req@ffff8de1c5680700 x1862023612489344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774129.984071:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774129.984076:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774129.984094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612489856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774129.984094:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612489344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774129.984128:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774129.984131:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774129.984135:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612489344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774129.984155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774129.984171:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774129.984178:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774129/real 1775774129] req@ffff8de1c5682d80 x1862023612489472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774129.984186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612489472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774129.984190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774129.984193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774129.984195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774129.984198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774129.984207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774129.984211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774129/real 1775774129] req@ffff8de1c5682680 x1862023612489600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774129.984217:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612489600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774129.984222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774129.984223:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774129.984225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774129.984228:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774129.984237:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774129.984242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774129/real 1775774129] req@ffff8de1c5683b80 x1862023612489728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774129.984248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612489728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774129.984253:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774129.984254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774129.984256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774129.984259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774129.984267:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774129.984271:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774129/real 1775774129] req@ffff8de1c5682300 x1862023612489856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774129.984276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612489856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774129.984280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774129.984281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774129.984283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612489856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774130.943943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774131.967861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774132.991874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774134.015868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774135.039842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774135.103889:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774135.103899:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774135.103903:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774135.103913:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10106 00000100:00080000:0.0:1775774135.103923:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774135.103929:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774135.103964:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612489984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774135.103989:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774135.103992:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774135.103994:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774135.103998:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10106 00000100:00080000:0.0:1775774135.104001:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774135.104004:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774135.104011:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774135.104019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612490112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774135.104026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774135.104028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774135.104030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774135.104034:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10106 00000100:00080000:0.0:1775774135.104037:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774135.104042:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774135.104045:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612489984:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774135.104048:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774135.104061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612490240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774135.104076:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774135.104079:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774135.104081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774135.104085:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10106 00000100:00080000:0.0:1775774135.104089:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774135.104093:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774135.104097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774135.104108:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612490368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774135.104117:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774135.104120:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774135.104122:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774135.104126:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10106 00000100:00080000:0.0:1775774135.104129:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774135.104131:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490112:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775774135.104135:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774135.104140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774135.104150:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612490496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774135.104195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774135.104219:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774135.104240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774136.063884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774137.087896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774138.111864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775774138.176014:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775774138.176062:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775774138.176078:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774138.176125:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774138.176135:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774138.176143:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774138.176152:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775774138.176178:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774135/real 1775774138] req@ffff8de1c5682680 x1862023612490240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774138.176202:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612490240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774138.176213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774138.176218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774138.176222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774138.176229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774135/real 1775774138] req@ffff8de1c5682d80 x1862023612490368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774138.176240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612490368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774138.176247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774138.176250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774138.176253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774138.176260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774135/real 1775774138] req@ffff8de1c5680700 x1862023612490496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774138.176270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612490496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774138.176277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774138.176280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774138.176283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490496:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774138.176289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774135/real 1775774138] req@ffff8de1c5682300 x1862023612489984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774138.176301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612489984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774138.176308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774138.176311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774138.176314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612489984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774138.176320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774135/real 1775774138] req@ffff8de1c5683b80 x1862023612490112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774138.176330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612490112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774138.176337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774138.176340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774138.176342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490112:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775774139.135863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774140.159822:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774140.223836:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774140.223843:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774140.223846:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774140.223853:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10111 00000100:00080000:3.0:1775774140.223862:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774140.223867:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774140.223900:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612490624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774140.223924:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774140.223928:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774140.223930:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774140.223934:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10111 00000100:00080000:3.0:1775774140.223938:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774140.223941:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774140.223952:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774140.223966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612490752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774140.223977:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775774140.223982:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612490624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774140.223982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774140.223984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774140.223991:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10111 00000100:00080000:3.0:1775774140.223996:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774140.223999:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774140.224005:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774140.224018:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612490880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774140.224028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774140.224040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774140.224041:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774140.224045:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10111 00000100:00080000:3.0:1775774140.224049:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774140.224051:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774140.224055:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774140.224061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774140.224072:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612491008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774140.224081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774140.224085:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774140.224087:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774140.224089:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774140/real 1775774140] req@ffff8de1c7af6a00 x1862023612490624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774140.224093:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10111 00000100:00080000:3.0:1775774140.224096:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774140.224100:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774140.224104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774140.224118:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612491136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774140.224128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612490624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774140.224155:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774140.224160:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774140.224164:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612490624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774140.224188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774140.224211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774140.224236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774140/real 1775774140] req@ffff8de1c7af6680 x1862023612490752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774140.224248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612490752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774140.224255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774140.224258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774140.224261:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774140.224266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774140.224284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774140.224295:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774140/real 1775774140] req@ffff8de1c7af4700 x1862023612490880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774140.224304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612490880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774140.224316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774140.224318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774140.224321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612490880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774140.224326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774140.224343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774140.224351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774140/real 1775774140] req@ffff8de1c7af6300 x1862023612491008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774140.224368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612491008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774140.224376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774140.224379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774140.224381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774140.224387:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774140.224404:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774140.224414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774140/real 1775774140] req@ffff8de1c7af5c00 x1862023612491136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774140.224452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612491136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774140.224458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774140.224461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774140.224464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774141.183866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774142.207906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774143.231872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774144.255944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774145.279843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774145.343784:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774145.343797:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774145.343802:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774145.343812:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10117 00000100:00080000:3.0:1775774145.343824:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774145.343832:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774145.343867:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612491264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774145.343887:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774145.343890:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774145.343891:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774145.343894:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10117 00000100:00080000:3.0:1775774145.343897:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774145.343899:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774145.343906:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774145.343917:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612491392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774145.343924:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774145.343928:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775774145.343929:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612491264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774145.343929:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774145.343936:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10117 00000100:00080000:3.0:1775774145.343938:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774145.343940:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774145.343943:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774145.343951:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612491520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774145.343956:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774145.343959:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774145.343960:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774145.343962:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10117 00000100:00080000:3.0:1775774145.343972:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774145.343975:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774145.343978:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774145.343985:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774145.343986:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612491648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774145.343993:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774145.343995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774145.343997:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774145.343999:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10117 00000100:00080000:3.0:1775774145.344001:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774145.344003:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774145.344006:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774145.344012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612491776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774145.344016:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774145/real 1775774145] req@ffff8de1c7af5500 x1862023612491264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774145.344033:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612491264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774145.344040:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774145.344045:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774145.344048:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612491264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774145.344063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774145.344075:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774145.344081:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774145/real 1775774145] req@ffff8de1c7af7480 x1862023612491392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774145.344088:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612491392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774145.344093:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774145.344095:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774145.344097:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774145.344100:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774145.344108:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774145.344113:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774145/real 1775774145] req@ffff8de1c7af4000 x1862023612491520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774145.344124:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612491520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774145.344129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774145.344131:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774145.344132:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774145.344136:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774145.344148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774145.344154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774145/real 1775774145] req@ffff8de1c7af4380 x1862023612491648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774145.344160:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612491648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774145.344164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774145.344166:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774145.344168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774145.344171:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774145.344179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774145.344183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774145/real 1775774145] req@ffff8de1c7af4e00 x1862023612491776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774145.344189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612491776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774145.344193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774145.344195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774145.344196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612491776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774146.303867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774147.327872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774148.351849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774149.375867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774150.399844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774150.463808:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774150.463816:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774150.463821:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774150.463830:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10122 00000100:00080000:3.0:1775774150.463845:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774150.463852:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774150.463881:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612491904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774150.463907:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774150.463911:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774150.463913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774150.463917:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10122 00000100:00080000:3.0:1775774150.463921:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774150.463924:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774150.463933:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774150.463943:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612491904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774150.463946:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612492032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774150.463956:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774150.463959:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774150.463961:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774150.463965:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10122 00000100:00080000:3.0:1775774150.463970:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774150.463973:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774150.463978:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774150.463988:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612492160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774150.463996:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774150.464002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774150.464005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774150.464006:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774150.464010:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10122 00000100:00080000:3.0:1775774150.464012:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774150.464015:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774150.464019:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774150.464023:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774150/real 1775774150] req@ffff8de1c7af7b80 x1862023612491904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774150.464026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612492288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774150.464034:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774150.464036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774150.464038:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774150.464039:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612491904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774150.464041:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10122 00000100:00080000:3.0:1775774150.464043:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774150.464046:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775774150.464048:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:3.0:1775774150.464049:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774150.464052:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774150.464055:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612491904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774150.464076:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774150.464096:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774150.464107:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774150/real 1775774150] req@ffff8de1c7af6d80 x1862023612492032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774150.464117:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612492032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774150.464129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774150.464132:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774150.464135:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774150.464146:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774150.464148:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612492416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774150.464165:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774150.464176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774150/real 1775774150] req@ffff8de1c7af4a80 x1862023612492160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774150.464189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612492160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774150.464196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774150.464199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774150.464202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774150.464208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774150.464226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774150.464235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774150/real 1775774150] req@ffff8de1c7af5f80 x1862023612492288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774150.464270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612492288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774150.464278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774150.464280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774150.464284:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774150.464298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774150.464317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774150.464326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774150/real 1775774150] req@ffff8de1c7af5880 x1862023612492416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774150.464338:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612492416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774150.464347:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774150.464350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774150.464354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774151.424004:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774152.447845:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774153.471869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774154.495884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774155.519863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774155.583795:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774155.583802:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774155.583806:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774155.583814:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10127 00000100:00080000:2.0:1775774155.583821:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774155.583826:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774155.583855:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612492544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774155.583874:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774155.583877:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774155.583878:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774155.583880:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10127 00000100:00080000:2.0:1775774155.583882:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774155.583884:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774155.583891:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774155.583908:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612492672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774155.583919:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774155.583924:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775774155.583925:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612492544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774155.583926:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774155.583935:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10127 00000100:00080000:2.0:1775774155.583939:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774155.583942:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774155.583948:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774155.583961:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612492800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774155.583968:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774155.583970:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774155.583971:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774155.583974:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10127 00000100:00080000:2.0:1775774155.583977:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774155.583979:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774155.583983:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774155.583987:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774155.583997:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612492928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774155.584004:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774155.584006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774155.584007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774155.584009:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10127 00000100:00080000:2.0:1775774155.584012:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774155.584014:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774155.584017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774155.584021:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774155/real 1775774155] req@ffff8de1d0f2ca80 x1862023612492544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774155.584026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612493056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774155.584062:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612492544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774155.584069:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774155.584072:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774155.584075:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612492544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774155.584091:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774155.584106:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774155.584114:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774155/real 1775774155] req@ffff8de1d0f2df80 x1862023612492672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774155.584121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612492672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774155.584125:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774155.584127:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774155.584129:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774155.584131:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774155.584140:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774155.584144:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774155/real 1775774155] req@ffff8de1d0f2e680 x1862023612492800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774155.584164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612492800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774155.584169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774155.584171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774155.584172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774155.584176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774155.584188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774155.584194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774155/real 1775774155] req@ffff8de1d0f2c700 x1862023612492928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774155.584200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612492928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774155.584204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774155.584206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774155.584207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612492928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774155.584210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774155.584218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774155.584222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774155/real 1775774155] req@ffff8de1d0f2d500 x1862023612493056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774155.584227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612493056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774155.584231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774155.584233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774155.584235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774156.543857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774157.567930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774158.591866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774159.615895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774160.639854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774160.703833:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774160.703844:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774160.703850:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774160.703860:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10132 00000100:00080000:0.0:1775774160.703871:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774160.703879:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774160.703915:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612493184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774160.703948:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774160.703952:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774160.703954:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774160.703959:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10132 00000100:00080000:0.0:1775774160.703963:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774160.703966:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774160.703977:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774160.703990:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612493312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774160.704000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612493184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774160.704006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774160.704010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774160.704012:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774160.704016:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10132 00000100:00080000:0.0:1775774160.704020:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774160.704024:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774160.704028:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774160.704042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612493440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774160.704057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774160.704076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774160.704078:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774160.704082:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10132 00000100:00080000:0.0:1775774160.704087:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774160.704091:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774160.704096:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774160.704103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774160.704118:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612493568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774160.704128:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774160.704132:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774160.704134:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774160.704138:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774160/real 1775774160] req@ffff8de1c5681c00 x1862023612493184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774160.704141:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10132 00000100:00080000:0.0:1775774160.704147:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774160.704154:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774160.704162:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774160.704173:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612493184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774160.704178:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612493696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774160.704197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774160.704205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774160.704211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612493184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774160.704249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774160.704277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774160.704292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774160/real 1775774160] req@ffff8de1c5681f80 x1862023612493312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774160.704306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612493312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774160.704314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774160.704318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774160.704322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774160.704329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774160.704355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774160.704367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774160/real 1775774160] req@ffff8de1c5682a00 x1862023612493440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774160.704381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612493440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774160.704389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774160.704393:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774160.704396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774160.704402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774160.704426:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774160.704437:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774160/real 1775774160] req@ffff8de1c5680380 x1862023612493568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774160.704450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612493568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774160.704458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774160.704462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774160.704465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774160.704471:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774160.704491:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774160.704499:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774160/real 1775774160] req@ffff8de1c5680000 x1862023612493696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774160.704512:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612493696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774160.704517:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774160.704519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774160.704521:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774161.663859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774162.687882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774163.711906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774164.735853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774165.760031:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774165.823936:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774165.823951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774165.823957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774165.823999:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10137 00000100:00080000:1.0:1775774165.824013:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774165.824025:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774165.824081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612493824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774165.824110:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774165.824114:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774165.824115:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774165.824119:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10137 00000100:00080000:1.0:1775774165.824122:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774165.824125:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774165.824135:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774165.824146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612493952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774165.824154:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774165.824156:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774165.824158:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774165.824161:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10137 00000100:00080000:1.0:1775774165.824163:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774165.824166:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774165.824169:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774165.824178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612494080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774165.824189:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774165.824193:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774165.824195:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774165.824200:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10137 00000100:00080000:1.0:1775774165.824205:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774165.824216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612493824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774165.824217:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774165.824225:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774165.824239:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612494208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774165.824248:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774165.824251:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774165.824252:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774165.824256:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10137 00000100:00080000:1.0:1775774165.824259:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774165.824261:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774165.824265:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774165.824276:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612494336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774165.824312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774165.824360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774165/real 1775774165] req@ffff8de1c2e17800 x1862023612493824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774165.824381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612493824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774165.824393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774165.824398:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774165.824402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612493824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774165.824411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774165.824437:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774165.824450:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774165/real 1775774165] req@ffff8de1c2e17100 x1862023612493952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774165.824462:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612493952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774165.824476:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774165.824480:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774165.824483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612493952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774165.824490:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774165.824514:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774165.824525:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774165/real 1775774165] req@ffff8de1c2e17b80 x1862023612494080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774165.824533:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612494080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774165.824539:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774165.824541:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774165.824544:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774165.824566:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774165.824596:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774165.824608:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774165/real 1775774165] req@ffff8de1c2e16680 x1862023612494208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774165.824621:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612494208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774165.824629:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774165.824633:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774165.824636:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774165.824641:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774165.824658:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774165.824678:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774165/real 1775774165] req@ffff8de1c2e14380 x1862023612494336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774165.824691:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612494336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774165.824699:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774165.824703:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774165.824706:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774166.783896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774167.807910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774168.831903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774169.855896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774170.879900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774170.943818:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774170.943825:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774170.943829:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774170.943836:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10142 00000100:00080000:2.0:1775774170.943845:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774170.943850:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774170.943891:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612494464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774170.943915:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774170.943917:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774170.943919:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774170.943922:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10142 00000100:00080000:2.0:1775774170.943924:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774170.943928:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774170.943937:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774170.943946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612494592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774170.943959:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774170.943961:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612494464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774170.943962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774170.943966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774170.943974:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10142 00000100:00080000:2.0:1775774170.943976:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774170.943978:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774170.943982:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774170.943992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612494720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774170.943998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774170.944001:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774170.944002:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774170.944005:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10142 00000100:00080000:2.0:1775774170.944008:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774170.944010:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774170.944013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774170.944019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612494848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774170.944025:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774170.944028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774170.944029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774170.944033:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10142 00000100:00080000:2.0:1775774170.944036:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775774170.944039:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774170.944042:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774170.944046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774170.944053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612494976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774170.944079:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774170/real 1775774170] req@ffff8de1d0f2e300 x1862023612494464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774170.944094:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612494464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774170.944101:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774170.944104:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774170.944107:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612494464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774170.944125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774170.944152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774170.944161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774170/real 1775774170] req@ffff8de1d0f2f100 x1862023612494592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774170.944169:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612494592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774170.944175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774170.944177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774170.944179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774170.944185:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774170.944196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774170.944201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774170/real 1775774170] req@ffff8de1d0f2d500 x1862023612494720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774170.944209:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612494720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774170.944213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774170.944215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774170.944217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774170.944221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774170.944230:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774170.944235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774170/real 1775774170] req@ffff8de1d0f2c700 x1862023612494848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774170.944241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612494848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774170.944246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774170.944248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774170.944250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774170.944253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774170.944262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774170.944267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774170/real 1775774170] req@ffff8de1d0f2e680 x1862023612494976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774170.944278:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612494976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774170.944286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774170.944290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774170.944292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612494976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774171.903844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774172.927901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774173.951854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774174.975905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774175.999916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774176.063836:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774176.063844:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774176.063848:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774176.063856:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10147 00000100:00080000:0.0:1775774176.063865:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774176.063871:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774176.063902:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612495104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774176.063923:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774176.063926:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774176.063927:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774176.063930:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10147 00000100:00080000:0.0:1775774176.063933:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774176.063936:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774176.063945:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774176.063953:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612495232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774176.063962:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775774176.063963:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612495104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774176.063965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774176.063968:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774176.063976:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10147 00000100:00080000:0.0:1775774176.063978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774176.063980:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774176.063983:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774176.063991:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612495360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774176.063997:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774176.064000:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774176.064001:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774176.064004:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10147 00000100:00080000:0.0:1775774176.064006:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774176.064009:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774176.064013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774176.064019:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612495488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774176.064025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775774176.064031:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774176.064033:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774176.064035:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774176.064038:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10147 00000100:00080000:0.0:1775774176.064041:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774176.064043:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774176.064047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774176.064055:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612495616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774176.064078:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774176/real 1775774176] req@ffff8de1c5683480 x1862023612495104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774176.064100:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612495104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774176.064111:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774176.064116:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774176.064120:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612495104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774176.064151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774176.064171:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774176.064181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774176/real 1775774176] req@ffff8de1c5681500 x1862023612495232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774176.064189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612495232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774176.064196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774176.064198:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774176.064200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774176.064204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774176.064214:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774176.064220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774176/real 1775774176] req@ffff8de1c5681880 x1862023612495360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774176.064227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612495360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774176.064232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774176.064234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774176.064235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774176.064239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774176.064249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774176.064254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774176/real 1775774176] req@ffff8de1c5680e00 x1862023612495488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774176.064261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612495488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774176.064266:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774176.064268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774176.064270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774176.064276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774176.064293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774176.064303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774176/real 1775774176] req@ffff8de1c5683800 x1862023612495616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774176.064316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612495616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774176.064325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774176.064328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774176.064331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774177.023917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774178.047878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774179.071923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774180.095863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774181.119888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774181.183805:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774181.183826:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774181.183831:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774181.183841:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10152 00000100:00080000:0.0:1775774181.183853:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774181.183861:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774181.183898:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612495744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774181.183927:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774181.183931:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774181.183933:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774181.183938:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10152 00000100:00080000:0.0:1775774181.183943:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774181.183947:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774181.183965:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774181.183980:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612495744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774181.183983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612495872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774181.183997:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774181.184001:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774181.184002:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774181.184008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10152 00000100:00080000:0.0:1775774181.184013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774181.184017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774181.184022:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775774181.184038:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774181.184040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612496000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774181.184061:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774181.184065:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1775774181.184068:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774181/real 1775774181] req@ffff8de1c5683800 x1862023612495744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774181.184069:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774181.184080:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10152 00000100:00080000:0.0:1775774181.184086:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774181.184090:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612495744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774181.184095:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774181.184103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775774181.184116:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775774181.184117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612496128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774181.184124:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774181.184131:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612495744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774181.184147:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774181.184151:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774181.184153:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774181.184156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495872:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775774181.184162:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10152 00000100:00080000:0.0:1775774181.184167:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774181.184171:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775774181.184180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774181.184189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774181/real 1775774181] req@ffff8de1c5680e00 x1862023612495872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775774181.184191:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774181.184200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612495872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774181.184206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774181.184210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774181.184214:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612496256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774181.184215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612495872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774181.184225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774181.184245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774181.184252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774181/real 1775774181] req@ffff8de1c5681880 x1862023612496000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774181.184260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612496000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774181.184265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774181.184268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774181.184271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774181.184276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774181.184296:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774181.184307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774181/real 1775774181] req@ffff8de1c5681500 x1862023612496128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774181.184319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612496128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774181.184327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774181.184331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774181.184334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774181.184346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774181.184361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774181.184367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774181/real 1775774181] req@ffff8de1c5683480 x1862023612496256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774181.184379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612496256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774181.184387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774181.184390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774181.184393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774182.143854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774183.167894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774184.191855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774185.215893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774186.239910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774186.303904:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774186.303915:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774186.303920:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774186.303931:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10158 00000100:00080000:3.0:1775774186.303945:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774186.303952:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774186.303996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612496384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774186.304031:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774186.304034:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774186.304036:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774186.304040:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10158 00000100:00080000:3.0:1775774186.304043:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774186.304045:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774186.304058:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774186.304082:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612496512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774186.304086:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612496384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774186.304106:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774186.304111:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774186.304115:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774186.304123:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10158 00000100:00080000:3.0:1775774186.304127:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774186.304133:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774186.304141:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774186.304153:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612496640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774186.304160:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774186.304164:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774186.304165:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774186.304168:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10158 00000800:00000100:0.0:1775774186.304173:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774186.304174:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774186.304179:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774186.304183:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774186.304193:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612496768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774186.304211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774186/real 1775774186] req@ffff8de1c7af7800 x1862023612496384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774186.304228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612496384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774186.304236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774186.304240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774186.304243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612496384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774186.304267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496512:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774186.304275:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774186.304280:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774186.304282:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774186.304289:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10158 00000100:00080000:3.0:1775774186.304294:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775774186.304299:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774186.304304:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774186.304311:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774186.304317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774186/real 1775774186] req@ffff8de1c7af7100 x1862023612496512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774186.304337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612496512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774186.304347:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774186.304351:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774186.304354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774186.304362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774186.304381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774186.304388:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774186/real 1775774186] req@ffff8de1c7af5180 x1862023612496640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774186.304397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612496640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774186.304402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774186.304405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774186.304407:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774186.304421:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774186.304433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774186.304438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774186/real 1775774186] req@ffff8de1c7af5880 x1862023612496768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774186.304447:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612496768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774186.304453:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774186.304456:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774186.304458:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774186.304481:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612496896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774186.304518:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774186.304554:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774186.304585:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774186/real 1775774186] req@ffff8de1c7af5f80 x1862023612496896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774186.304610:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612496896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774186.304636:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774186.304641:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774186.304644:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612496896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774187.263866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774188.287871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774189.311872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774190.335882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774191.359833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774191.423842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774191.423853:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774191.423858:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774191.423869:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10163 00000100:00080000:0.0:1775774191.423888:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774191.423894:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774191.423925:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612497024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774191.423951:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774191.423954:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774191.423956:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774191.423959:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10163 00000100:00080000:0.0:1775774191.423961:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774191.423964:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774191.423971:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774191.423978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612497152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774191.423986:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774191.423988:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774191.423989:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774191.423992:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10163 00000100:00080000:0.0:1775774191.423994:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774191.423997:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774191.424005:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774191.424013:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612497280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774191.424025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774191.424028:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1775774191.424028:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612497024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774191.424030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774191.424037:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10163 00000100:00080000:0.0:1775774191.424040:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774191.424042:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774191.424045:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774191.424054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612497408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774191.424060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774191.424063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774191.424064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774191.424066:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10163 00000100:00080000:0.0:1775774191.424068:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774191.424071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774191.424075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774191.424085:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612497536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774191.424102:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774191.424135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774191/real 1775774191] req@ffff8de1c5680000 x1862023612497024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774191.424153:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612497024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774191.424164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774191.424169:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774191.424173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612497024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774191.424181:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774191.424201:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774191.424211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774191/real 1775774191] req@ffff8de1c5680380 x1862023612497152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774191.424219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612497152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774191.424225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774191.424227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774191.424229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774191.424247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774191.424258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774191.424264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774191/real 1775774191] req@ffff8de1c5682a00 x1862023612497280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774191.424274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612497280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774191.424282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774191.424285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774191.424288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774191.424295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774191.424315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774191.424327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774191/real 1775774191] req@ffff8de1c5681f80 x1862023612497408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774191.424340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612497408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774191.424348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774191.424351:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774191.424353:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774191.424357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774191.424372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774191.424379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774191/real 1775774191] req@ffff8de1c5681c00 x1862023612497536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774191.424386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612497536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774191.424391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774191.424394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774191.424395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774192.383887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774193.407933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774194.431911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774195.455926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774196.479935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774196.543836:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774196.543847:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774196.543852:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774196.543862:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10168 00000100:00080000:2.0:1775774196.543875:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774196.543882:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774196.543921:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612497664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774196.543947:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774196.543950:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774196.543952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774196.543955:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10168 00000100:00080000:2.0:1775774196.543959:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774196.543963:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774196.543972:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774196.543977:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612497664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774196.543986:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612497792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774196.543995:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774196.543997:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774196.543998:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774196.544001:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10168 00000100:00080000:2.0:1775774196.544003:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774196.544006:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774196.544009:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774196.544017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612497920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774196.544024:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774196.544026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774196.544027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774196.544030:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10168 00000100:00080000:2.0:1775774196.544033:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775774196.544038:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774196.544041:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774196.544046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774196.544058:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612498048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774196.544069:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774196.544072:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774196/real 1775774196] req@ffff8de1d0f2df80 x1862023612497664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774196.544083:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774196.544086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774196.544089:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612497664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774196.544094:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10168 00000100:00080000:0.0:1775774196.544104:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774196.544104:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774196.544111:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775774196.544114:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774196.544118:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612497664:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775774196.544124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774196.544141:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774196.544141:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612498176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774196.544163:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774196.544174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774196/real 1775774196] req@ffff8de1d0f2ca80 x1862023612497792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774196.544184:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612497792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774196.544198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774196.544201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774196.544203:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774196.544208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774196.544228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774196.544239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774196/real 1775774196] req@ffff8de1d0f2e680 x1862023612497920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774196.544260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612497920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774196.544268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774196.544272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774196.544275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612497920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774196.544282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774196.544299:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774196.544306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774196/real 1775774196] req@ffff8de1d0f2c700 x1862023612498048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774196.544314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612498048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774196.544319:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774196.544321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774196.544323:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774196.544334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774196.544344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774196.544349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774196/real 1775774196] req@ffff8de1d0f2d500 x1862023612498176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774196.544356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612498176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774196.544365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774196.544367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774196.544369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774197.503931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774198.527931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774199.551881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774200.575889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774201.599970:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774201.663825:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774201.663837:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774201.663843:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774201.663855:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10173 00000100:00080000:2.0:1775774201.663869:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774201.663878:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774201.663924:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612498304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774201.663959:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774201.663964:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774201.663966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774201.663971:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10173 00000100:00080000:2.0:1775774201.663975:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774201.663979:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774201.663991:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774201.664004:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612498432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774201.664014:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612498304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774201.664022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774201.664027:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774201.664029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774201.664034:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10173 00000100:00080000:2.0:1775774201.664038:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774201.664042:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774201.664048:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774201.664063:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612498560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774201.664074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774201.664078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774201.664079:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774201.664083:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10173 00000100:00080000:2.0:1775774201.664088:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774201.664092:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774201.664106:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774201.664119:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612498688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774201.664129:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774201.664133:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775774201.664135:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498432:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775774201.664137:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774201.664146:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10173 00000100:00080000:2.0:1775774201.664151:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774201.664156:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774201.664162:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774201.664167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774201.664183:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612498816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774201.664190:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774201.664216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774202.623873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774203.647834:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774204.671877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775774204.735992:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775774204.736041:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775774204.736058:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774204.736099:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774204.736109:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774204.736118:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774204.736126:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775774204.736409:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774201/real 1775774204] req@ffff8de1d0f2e680 x1862023612498816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774204.736438:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612498816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774204.736449:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774204.736456:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774204.736460:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498816:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774204.736469:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774201/real 1775774204] req@ffff8de1d0f2e300 x1862023612498432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774204.736481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612498432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774204.736489:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774204.736493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774204.736496:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774204.736502:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774201/real 1775774204] req@ffff8de1d0f2d500 x1862023612498560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774204.736514:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612498560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774204.736520:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774204.736523:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774204.736525:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774204.736531:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774201/real 1775774204] req@ffff8de1d0f2c700 x1862023612498688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774204.736541:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612498688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774204.736548:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774204.736551:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774204.736554:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612498688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774204.736559:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774201/real 1775774204] req@ffff8de1d0f2f100 x1862023612498304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774204.736571:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612498304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774204.736578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774204.736581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774204.736584:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612498304:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775774205.695833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774206.719850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774206.783841:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774206.783852:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774206.783858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774206.783868:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10178 00000100:00080000:2.0:1775774206.783882:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774206.783889:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774206.783931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612498944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774206.783962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774206.783966:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774206.783968:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774206.783973:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10178 00000100:00080000:2.0:1775774206.783978:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774206.783982:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774206.783995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774206.784013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612499072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774206.784036:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774206.784041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612498944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774206.784041:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774206.784044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774206.784057:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10178 00000100:00080000:2.0:1775774206.784062:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774206.784067:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774206.784074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774206.784095:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612499200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774206.784113:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774206.784117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774206.784119:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774206.784123:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10178 00000800:00000100:0.0:1775774206.784132:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774206.784135:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774206.784144:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774206.784152:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774206.784172:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612499328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774206.784184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774206/real 1775774206] req@ffff8de1d0f2ca80 x1862023612498944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774206.784230:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774206.784235:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774206.784238:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774206.784245:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10178 00000100:00080000:2.0:1775774206.784253:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774206.784273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612498944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774206.784274:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774206.784287:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774206.784302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774206.784314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774206.784314:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612499456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774206.784328:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612498944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774206.784388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774206.784428:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774206.784443:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774206/real 1775774206] req@ffff8de1d0f2df80 x1862023612499072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774206.784456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612499072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774206.784464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774206.784468:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774206.784472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774206.784479:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774206.784500:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774206.784510:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774206/real 1775774206] req@ffff8de1d0f2f100 x1862023612499200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774206.784522:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612499200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774206.784529:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774206.784533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774206.784535:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774206.784542:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774206.784562:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774206.784572:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774206/real 1775774206] req@ffff8de1d0f2c700 x1862023612499328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774206.784584:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612499328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774206.784592:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774206.784595:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774206.784598:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774206.784603:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774206.784621:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774206.784632:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774206/real 1775774206] req@ffff8de1d0f2d500 x1862023612499456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774206.784642:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612499456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774206.784649:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774206.784653:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774206.784655:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774207.743861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774208.767879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774209.791942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774210.815900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774211.839873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774211.903829:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774211.903836:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774211.903840:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774211.903848:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10183 00000100:00080000:3.0:1775774211.903857:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774211.903862:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774211.903892:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612499584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774211.903912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774211.903914:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774211.903916:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774211.903918:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10183 00000100:00080000:3.0:1775774211.903921:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774211.903923:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774211.903930:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774211.903939:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612499712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774211.903946:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774211.903948:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774211.903950:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774211.903952:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10183 00000100:00080000:3.0:1775774211.903954:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774211.903956:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774211.903959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774211.903968:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612499840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774211.903969:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612499584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774211.903983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774211.903985:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774211.903986:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774211.903988:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10183 00000100:00080000:3.0:1775774211.903991:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774211.903993:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774211.903996:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774211.904002:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612499968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774211.904008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774211.904010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774211.904011:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774211.904013:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10183 00000100:00080000:3.0:1775774211.904016:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774211.904018:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774211.904021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774211.904027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612500096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774211.904054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774211.904090:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774211/real 1775774211] req@ffff8de1c7af4a80 x1862023612499584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774211.904109:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612499584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774211.904120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774211.904125:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774211.904129:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612499584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774211.904136:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774211.904161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774211.904192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774211/real 1775774211] req@ffff8de1c7af6d80 x1862023612499712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774211.904205:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612499712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774211.904213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774211.904217:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774211.904220:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774211.904258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774211.904282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774211.904293:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774211/real 1775774211] req@ffff8de1c7af7b80 x1862023612499840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774211.904306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612499840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774211.904314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774211.904318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774211.904321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774211.904328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774211.904349:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774211.904360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774211/real 1775774211] req@ffff8de1c7af4e00 x1862023612499968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774211.904370:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612499968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774211.904378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774211.904381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774211.904384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612499968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774211.904390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774211.904411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774211.904422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774211/real 1775774211] req@ffff8de1c7af4380 x1862023612500096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774211.904434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612500096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774211.904441:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774211.904445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774211.904448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774212.863863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774213.887947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774214.911888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774215.935904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774216.959849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774217.023844:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774217.023854:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774217.023859:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774217.023871:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10188 00000100:00080000:2.0:1775774217.023883:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774217.023891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774217.023928:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612500224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774217.023954:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774217.023959:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774217.023961:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774217.023966:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10188 00000100:00080000:2.0:1775774217.023976:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774217.023980:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774217.023990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612500224:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775774217.023993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774217.024011:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612500352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774217.024024:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774217.024028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774217.024030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774217.024035:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10188 00000100:00080000:2.0:1775774217.024039:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774217.024043:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774217.024049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775774217.024057:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774217.024063:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612500480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774217.024101:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774217.024107:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:0.0:1775774217.024109:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774217/real 1775774217] req@ffff8de1d0f2e300 x1862023612500224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774217.024110:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774217.024118:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10188 00000100:00080000:2.0:1775774217.024126:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774217.024131:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774217.024138:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774217.024141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612500224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774217.024153:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612500608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774217.024156:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774217.024166:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775774217.024172:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774217.024174:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612500224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774217.024179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774217.024183:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774217.024189:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10188 00000100:00080000:2.0:1775774217.024194:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774217.024198:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774217.024204:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774217.024206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774217.024218:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612500736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774217.024237:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774217.024254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774217/real 1775774217] req@ffff8de1d0f2e680 x1862023612500352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774217.024268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612500352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774217.024276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774217.024279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774217.024282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774217.024289:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774217.024309:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774217.024319:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774217/real 1775774217] req@ffff8de1d0f2d500 x1862023612500480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774217.024331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612500480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774217.024338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774217.024341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774217.024345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774217.024350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774217.024369:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774217.024379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774217/real 1775774217] req@ffff8de1d0f2c700 x1862023612500608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774217.024390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612500608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774217.024398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774217.024401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774217.024404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774217.024419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774217.024438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774217.024448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774217/real 1775774217] req@ffff8de1d0f2f100 x1862023612500736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774217.024459:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612500736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774217.024472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774217.024475:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774217.024478:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774217.983896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774219.007878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774220.031873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774221.055877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774222.079930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774222.143876:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774222.143885:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774222.143891:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774222.143902:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10193 00000100:00080000:3.0:1775774222.143918:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774222.143926:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774222.143977:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612500864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774222.144030:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774222.144036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774222.144040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774222.144046:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10193 00000100:00080000:3.0:1775774222.144052:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774222.144057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774222.144069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774222.144075:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612500864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774222.144090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612500992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774222.144102:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774222.144105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774222.144107:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774222.144112:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10193 00000100:00080000:3.0:1775774222.144116:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774222.144118:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774222.144122:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774222.144131:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612501120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774222.144140:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774222.144143:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774222.144150:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775774222.144151:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774222.144163:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10193 00000100:00080000:3.0:1775774222.144169:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774222.144174:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774222.144181:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774222.144192:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612501248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774222.144196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774222/real 1775774222] req@ffff8de1c7af4000 x1862023612500864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774222.144211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612500864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774222.144222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774222.144227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774222.144231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612500864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774222.144262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500992:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774222.144275:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774222.144279:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774222.144281:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774222.144286:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10193 00000100:00080000:3.0:1775774222.144298:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774222.144305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774222.144318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774222/real 1775774222] req@ffff8de1c7af7480 x1862023612500992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774222.144329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612500992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774222.144340:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774222.144343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774222.144345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612500992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774222.144349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774222.144363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774222.144369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774222/real 1775774222] req@ffff8de1c7af5500 x1862023612501120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774222.144377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612501120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774222.144383:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774222.144386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774222.144389:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774222.144399:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774222.144413:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774222.144420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774222/real 1775774222] req@ffff8de1c7af5c00 x1862023612501248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774222.144426:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774222.144437:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774222.144438:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612501248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774222.144457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774222.144463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774222.144471:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612501376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774222.144472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774222.144547:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774222.144566:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774222.144597:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774222/real 1775774222] req@ffff8de1c7af6300 x1862023612501376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774222.144618:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612501376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774222.144633:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774222.144641:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774222.144647:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774223.103894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774224.127944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774225.151894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774226.175888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774227.199889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774227.263832:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774227.263842:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774227.263847:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774227.263856:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10199 00000100:00080000:0.0:1775774227.263866:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774227.263872:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774227.263913:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612501504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774227.263934:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774227.263937:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774227.263939:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774227.263942:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10199 00000100:00080000:0.0:1775774227.263945:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774227.263949:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774227.263958:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774227.263968:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612501632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774227.263973:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612501504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774227.263979:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774227.263981:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774227.263983:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774227.263986:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10199 00000100:00080000:0.0:1775774227.263988:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774227.263990:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774227.263994:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774227.264001:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612501760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774227.264007:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774227.264010:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774227.264011:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774227.264013:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10199 00000100:00080000:0.0:1775774227.264015:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774227.264018:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774227.264021:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774227.264028:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612501888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774227.264037:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774227.264044:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774227.264046:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774227.264047:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774227.264051:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10199 00000100:00080000:0.0:1775774227.264053:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774227.264056:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774227.264060:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774227.264065:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612502016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774227.264082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774227/real 1775774227] req@ffff8de1c5683b80 x1862023612501504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774227.264116:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612501504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774227.264128:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774227.264133:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774227.264138:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612501504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774227.264160:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774227.264185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774227.264198:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774227/real 1775774227] req@ffff8de1c5682300 x1862023612501632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774227.264211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612501632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774227.264219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774227.264222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774227.264226:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774227.264231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774227.264262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774227.264274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774227/real 1775774227] req@ffff8de1c5680700 x1862023612501760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774227.264288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612501760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774227.264296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774227.264299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774227.264303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774227.264309:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774227.264330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774227.264340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774227/real 1775774227] req@ffff8de1c5682d80 x1862023612501888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774227.264352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612501888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774227.264360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774227.264364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774227.264367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612501888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774227.264373:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774227.264393:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774227.264403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774227/real 1775774227] req@ffff8de1c5682680 x1862023612502016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774227.264415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612502016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774227.264423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774227.264426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774227.264430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774228.223890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774229.247920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774230.271907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774231.295930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774232.319907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774232.383912:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774232.383927:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774232.383934:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774232.383948:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10204 00000100:00080000:0.0:1775774232.383963:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774232.383972:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774232.384026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612502144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774232.384063:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774232.384068:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774232.384071:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774232.384076:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10204 00000100:00080000:0.0:1775774232.384082:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774232.384087:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774232.384101:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774232.384114:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612502144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774232.384118:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612502272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774232.384133:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774232.384136:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774232.384139:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774232.384144:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10204 00000100:00080000:0.0:1775774232.384148:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774232.384152:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774232.384158:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774232.384171:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612502400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774232.384182:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774232.384186:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774232.384188:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774232.384193:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10204 00000100:00080000:0.0:1775774232.384197:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774232.384201:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774232.384208:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774232.384208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774232.384223:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612502528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774232.384235:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774232.384240:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774232.384242:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774232.384247:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10204 00000100:00080000:0.0:1775774232.384251:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774232.384257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774232/real 1775774232] req@ffff8de1c5682680 x1862023612502144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774232.384258:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774232.384273:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774232.384278:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612502144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774232.384288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775774232.384290:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612502656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774232.384294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774232.384301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612502144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774232.384330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774232.384350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774232.384359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774232/real 1775774232] req@ffff8de1c5682d80 x1862023612502272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774232.384369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612502272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774232.384378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774232.384381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774232.384385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774232.384392:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774232.384414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774232.384426:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774232/real 1775774232] req@ffff8de1c5680700 x1862023612502400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774232.384439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612502400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774232.384448:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774232.384451:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774232.384454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774232.384459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774232.384475:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774232.384486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774232/real 1775774232] req@ffff8de1c5682300 x1862023612502528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774232.384499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612502528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774232.384508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774232.384511:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774232.384515:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774232.384521:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774232.384542:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774232.384554:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774232/real 1775774232] req@ffff8de1c5683b80 x1862023612502656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774232.384567:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612502656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774232.384575:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774232.384579:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774232.384582:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774233.343966:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774234.367958:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774235.391936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774236.415911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774237.439895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774237.503846:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774237.503853:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774237.503857:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774237.503864:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10209 00000100:00080000:3.0:1775774237.503874:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774237.503880:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774237.503911:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612502784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774237.503936:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774237.503939:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774237.503941:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774237.503945:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10209 00000100:00080000:3.0:1775774237.503950:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774237.503954:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774237.503963:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774237.503980:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612502912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774237.503990:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774237.503992:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774237.503994:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774237.503997:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10209 00000100:00080000:3.0:1775774237.504000:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774237.504002:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774237.504005:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774237.504014:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612503040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774237.504022:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774237.504027:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1775774237.504029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612502784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774237.504029:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774237.504036:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10209 00000100:00080000:3.0:1775774237.504047:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774237.504050:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774237.504054:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774237.504063:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612503168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774237.504081:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774237.504084:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774237.504086:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774237.504091:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10209 00000100:00080000:3.0:1775774237.504109:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774237.504114:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774237.504120:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774237.504127:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774237.504138:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612503296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774237.504179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774237/real 1775774237] req@ffff8de1c7af4700 x1862023612502784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774237.504197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612502784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774237.504211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774237.504215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774237.504218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612502784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774237.504225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774237.504242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774237.504250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774237/real 1775774237] req@ffff8de1c7af6680 x1862023612502912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774237.504259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612502912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774237.504264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774237.504266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774237.504268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612502912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774237.504294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774237.504308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774237.504315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774237/real 1775774237] req@ffff8de1c7af6a00 x1862023612503040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774237.504323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612503040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774237.504337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774237.504340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774237.504344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774237.504349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774237.504362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774237.504368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774237/real 1775774237] req@ffff8de1c7af6300 x1862023612503168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774237.504376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612503168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774237.504381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774237.504384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774237.504386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774237.504390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774237.504400:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774237.504405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774237/real 1775774237] req@ffff8de1c7af5c00 x1862023612503296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774237.504412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612503296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774237.504417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774237.504419:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774237.504420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774238.463884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774239.487887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774240.511913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774241.535900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774242.559841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774242.623811:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774242.623819:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774242.623823:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774242.623831:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10214 00000100:00080000:0.0:1775774242.623841:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774242.623846:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774242.623880:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612503424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774242.623909:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774242.623913:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774242.623915:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774242.623920:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10214 00000100:00080000:0.0:1775774242.623925:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774242.623930:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774242.623940:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774242.623945:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612503424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774242.623958:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612503552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774242.623967:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774242.623970:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774242.623971:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774242.623974:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10214 00000100:00080000:0.0:1775774242.623977:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774242.623980:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774242.623984:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774242.623992:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612503680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774242.623999:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774242.624002:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774242.624003:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774242.624006:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10214 00000100:00080000:0.0:1775774242.624008:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774242.624013:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775774242.624014:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775774242.624017:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774242.624025:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612503808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774242.624032:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774242.624035:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774242.624036:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774242.624038:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10214 00000100:00080000:0.0:1775774242.624040:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774242.624043:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774242.624047:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774242.624055:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774242/real 1775774242] req@ffff8de1c5681c00 x1862023612503424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774242.624056:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612503936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774242.624097:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612503424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774242.624108:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774242.624113:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774242.624117:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612503424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774242.624140:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774242.624166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774242.624179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774242/real 1775774242] req@ffff8de1c5681f80 x1862023612503552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774242.624193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612503552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774242.624202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774242.624206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774242.624209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774242.624213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774242.624234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774242.624245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774242/real 1775774242] req@ffff8de1c5682a00 x1862023612503680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774242.624258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612503680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774242.624272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774242.624275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774242.624278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774242.624284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774242.624305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774242.624315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774242/real 1775774242] req@ffff8de1c5680380 x1862023612503808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774242.624327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612503808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774242.624336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774242.624339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774242.624343:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774242.624349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774242.624365:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774242.624376:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774242/real 1775774242] req@ffff8de1c5680000 x1862023612503936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774242.624398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612503936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774242.624406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774242.624409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774242.624413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612503936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774243.583901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774244.607930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774245.631862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774246.655856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774247.679868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774247.743856:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774247.743865:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774247.743869:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774247.743877:0:139607:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10219 00000100:00080000:3.0:1775774247.743887:0:139607:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774247.743893:0:139607:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774247.743925:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612504064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774247.743948:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774247.743951:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774247.743952:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774247.743955:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10219 00000100:00080000:3.0:1775774247.743957:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774247.743960:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774247.743968:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774247.743978:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612504192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774247.743986:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774247.743989:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774247.743991:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774247.743994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612504064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774247.743996:0:139607:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10219 00000100:00080000:3.0:1775774247.744002:0:139607:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774247.744005:0:139607:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774247.744008:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774247.744017:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612504320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774247.744024:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774247.744026:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774247.744028:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774247.744030:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10219 00000100:00080000:3.0:1775774247.744040:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774247.744043:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774247.744046:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774247.744053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774247.744056:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612504448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774247.744064:0:139607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774247.744066:0:139607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774247.744068:0:139607:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774247.744072:0:139607:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10219 00000100:00080000:3.0:1775774247.744074:0:139607:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774247.744077:0:139607:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774247.744081:0:139607:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774247.744087:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774247/real 1775774247] req@ffff8de1c7af5500 x1862023612504064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774247.744090:0:139607:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612504576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774247.744124:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612504064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774247.744132:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774247.744138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774247.744143:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612504064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774247.744169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774247.744205:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774247.744215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774247/real 1775774247] req@ffff8de1c7af7480 x1862023612504192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774247.744224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612504192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774247.744230:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774247.744232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774247.744234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774247.744239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774247.744250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774247.744257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774247/real 1775774247] req@ffff8de1c7af4000 x1862023612504320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774247.744264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612504320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774247.744269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774247.744271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774247.744273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774247.744276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774247.744286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774247.744291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774247/real 1775774247] req@ffff8de1c7af4380 x1862023612504448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774247.744299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612504448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774247.744304:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774247.744305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774247.744307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774247.744310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774247.744320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774247.744324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774247/real 1775774247] req@ffff8de1c7af4e00 x1862023612504576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774247.744331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612504576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774247.744337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774247.744339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774247.744341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774248.703912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774249.727869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774250.751887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774251.775864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774252.799910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774252.863821:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774252.863837:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774252.863842:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774252.863852:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10224 00000100:00080000:2.0:1775774252.863862:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774252.863868:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774252.863907:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612504704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774252.863939:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774252.863943:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774252.863945:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774252.863949:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10224 00000100:00080000:2.0:1775774252.863952:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774252.863955:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774252.863965:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774252.863975:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612504832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774252.863982:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774252.863984:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774252.863986:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774252.863989:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10224 00000100:00080000:2.0:1775774252.863992:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774252.863995:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774252.863998:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774252.864008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612504960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774252.864011:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612504704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774252.864037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774252.864041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774252.864044:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774252.864049:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10224 00000100:00080000:2.0:1775774252.864054:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774252.864058:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774252.864064:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774252.864078:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774252.864081:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612505088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774252.864094:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774252.864098:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774252.864100:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774252.864105:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10224 00000100:00100000:0.0:1775774252.864108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774252/real 1775774252] req@ffff8de1d0f2df80 x1862023612504704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774252.864112:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774252.864121:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774252.864128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612504704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775774252.864128:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774252.864141:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774252.864146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774252.864150:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612505216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774252.864152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612504704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774252.864162:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774252.864191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774252.864206:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774252/real 1775774252] req@ffff8de1d0f2ca80 x1862023612504832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774252.864220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612504832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774252.864228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774252.864231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774252.864233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774252.864253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774252.864280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774252.864297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774252/real 1775774252] req@ffff8de1d0f2f100 x1862023612504960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774252.864318:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612504960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774252.864324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774252.864326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774252.864328:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612504960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774252.864333:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774252.864348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774252.864355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774252/real 1775774252] req@ffff8de1d0f2c700 x1862023612505088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774252.864363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612505088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774252.864368:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774252.864370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774252.864372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774252.864375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774252.864384:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774252.864389:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774252/real 1775774252] req@ffff8de1d0f2d500 x1862023612505216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774252.864396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612505216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774252.864405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774252.864407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774252.864409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774253.823874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774254.847979:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774255.871941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774256.895910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774257.919890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774257.983834:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774257.983847:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774257.983851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774257.983860:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10229 00000100:00080000:2.0:1775774257.983870:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774257.983877:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774257.983908:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612505344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774257.983930:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774257.983933:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774257.983935:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774257.983940:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10229 00000100:00080000:2.0:1775774257.983943:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774257.983945:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774257.983953:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774257.983959:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612505344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774257.983968:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612505472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774257.983977:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774257.983980:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774257.983981:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774257.983985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10229 00000100:00080000:2.0:1775774257.983987:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774257.983991:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774257.983995:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774257.984005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612505600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774257.984012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774257.984015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774257.984017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774257.984026:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10229 00000800:00000100:0.0:1775774257.984027:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774257.984032:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774257.984036:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774257.984041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774257.984054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612505728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774257.984062:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774257.984064:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775774257.984067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774257/real 1775774257] req@ffff8de1d0f2e680 x1862023612505344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774257.984068:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774257.984077:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10229 00000100:00080000:2.0:1775774257.984082:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774257.984086:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774257.984092:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774257.984094:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612505344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774257.984103:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775774257.984108:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612505856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774257.984109:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774257.984115:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612505344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774257.984138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774257.984168:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774257.984182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774257/real 1775774257] req@ffff8de1d0f2e300 x1862023612505472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774257.984197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612505472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774257.984207:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774257.984213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774257.984218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774257.984229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774257.984252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774257.984262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774257/real 1775774257] req@ffff8de1d0f2d500 x1862023612505600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774257.984271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612505600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774257.984276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774257.984279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774257.984281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774257.984286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774257.984298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774257.984304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774257/real 1775774257] req@ffff8de1d0f2c700 x1862023612505728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774257.984313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612505728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774257.984318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774257.984320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774257.984324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774257.984338:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774257.984350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774257.984360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774257/real 1775774257] req@ffff8de1d0f2f100 x1862023612505856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774257.984391:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612505856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774257.984397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774257.984401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774257.984404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612505856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774258.943883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774259.967982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774260.991891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774262.015854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774263.039902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774263.103840:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774263.103848:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774263.103852:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774263.103859:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10234 00000100:00080000:3.0:1775774263.103871:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774263.103878:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774263.103916:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612505984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774263.103953:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774263.103958:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774263.103960:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774263.103964:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10234 00000100:00080000:3.0:1775774263.103968:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774263.103971:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774263.103981:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774263.103994:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612506112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774263.103999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612505984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774263.104023:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774263.104036:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774263.104039:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774263.104045:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10234 00000100:00080000:3.0:1775774263.104050:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775774263.104054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774263.104057:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774263.104065:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774263.104080:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612506240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774263.104093:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774263.104095:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774263/real 1775774263] req@ffff8de1c7af7b80 x1862023612505984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774263.104099:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774263.104104:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774263.104115:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10234 00000100:00080000:3.0:1775774263.104120:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774263.104128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612505984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774263.104128:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775774263.104144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774263.104150:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:3.0:1775774263.104152:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774263.104156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612505984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774263.104172:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612506368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774263.104183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506112:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774263.104187:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774263.104192:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774263.104195:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774263.104201:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10234 00000800:00000100:0.0:1775774263.104207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774263.104207:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774263.104215:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774263.104221:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774263.104222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774263/real 1775774263] req@ffff8de1c7af6d80 x1862023612506112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774263.104236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612506112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774263.104243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775774263.104247:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612506496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774263.104248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774263.104254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774263.104266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774263.104301:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774263.104310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774263/real 1775774263] req@ffff8de1c7af4a80 x1862023612506240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774263.104319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612506240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774263.104328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774263.104331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774263.104335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774263.104349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774263.104371:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774263.104382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774263/real 1775774263] req@ffff8de1c7af5f80 x1862023612506368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774263.104393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612506368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774263.104399:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774263.104401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774263.104403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774263.104407:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774263.104421:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774263.104427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774263/real 1775774263] req@ffff8de1c7af5880 x1862023612506496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774263.104435:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612506496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774263.104439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774263.104441:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774263.104443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774264.063893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774265.087872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774266.111867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774267.135867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774268.159871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774268.223855:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774268.223863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774268.223867:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774268.223875:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10239 00000100:00080000:1.0:1775774268.223886:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774268.223891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774268.223922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612506624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774268.223947:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774268.223949:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774268.223951:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774268.223954:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10239 00000100:00080000:1.0:1775774268.223956:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774268.223958:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774268.223967:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774268.223981:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612506752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774268.223994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612506624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774268.224006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774268.224010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774268.224012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774268.224017:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10239 00000100:00080000:1.0:1775774268.224022:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774268.224027:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774268.224032:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774268.224045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612506880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774268.224057:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774268.224059:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774268.224061:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774268.224065:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10239 00000100:00100000:0.0:1775774268.224078:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506752:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775774268.224083:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774268.224089:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774268.224096:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774268.224111:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612507008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774268.224123:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774268.224126:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774268.224128:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774268.224133:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10239 00000100:00100000:0.0:1775774268.224134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506880:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775774268.224137:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774268.224143:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774268.224148:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774268.224159:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612507136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774268.224179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774268.224214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774269.183878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774270.207838:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774271.231881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775774271.296012:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775774271.296056:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775774271.296071:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774271.296103:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774271.296109:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774271.296114:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774271.296119:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775774271.296174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774268/real 1775774271] req@ffff8de1c2e17b80 x1862023612507008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774271.296201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612507008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774271.296211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774271.296216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774271.296221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774271.296229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774268/real 1775774271] req@ffff8de1c2e17100 x1862023612507136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774271.296241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612507136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774271.296248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774271.296252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774271.296255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507136:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774271.296262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774268/real 1775774271] req@ffff8de1c2e14380 x1862023612506752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774271.296276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612506752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774271.296296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774271.296299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774271.296303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774271.296309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774268/real 1775774271] req@ffff8de1c2e16680 x1862023612506880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774271.296321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612506880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774271.296327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774271.296331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774271.296333:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612506880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774271.296340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774268/real 1775774271] req@ffff8de1c2e16a00 x1862023612506624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774271.296351:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612506624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774271.296358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774271.296362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774271.296365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612506624:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775774272.255849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774273.279948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774273.344040:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774273.344053:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774273.344059:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774273.344077:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10245 00000100:00080000:3.0:1775774273.344119:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774273.344130:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774273.344188:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612507264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774273.344234:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774273.344239:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774273.344241:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774273.344247:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10245 00000100:00080000:3.0:1775774273.344252:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774273.344257:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774273.344270:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774273.344287:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612507392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774273.344299:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774273.344304:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774273.344307:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774273.344312:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10245 00000100:00080000:3.0:1775774273.344317:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774273.344322:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774273.344329:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774273.344341:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612507520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774273.344349:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774273.344353:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774273.344355:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774273.344359:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10245 00000100:00080000:3.0:1775774273.344362:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774273.344367:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774273.344372:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774273.344385:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612507648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774273.344395:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774273.344398:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774273.344399:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774273.344402:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10245 00000100:00080000:3.0:1775774273.344406:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774273.344410:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774273.344416:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774273.344427:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612507776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774273.344559:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612507264:192.168.201.137@tcp:250:kworker.0 00000800:00000100:0.0:1775774273.344652:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774273.344702:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774273/real 1775774273] req@ffff8de1c7af5180 x1862023612507264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774273.344764:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612507264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774273.344778:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774273.344783:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774273.344788:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612507264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774273.344795:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774273.344835:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774273.344855:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774273/real 1775774273] req@ffff8de1c7af7100 x1862023612507392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774273.344868:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612507392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774273.344876:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774273.344879:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774273.344882:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774273.344889:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774273.344911:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774273.344922:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774273/real 1775774273] req@ffff8de1c7af7800 x1862023612507520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774273.344935:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612507520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774273.344943:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774273.344946:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774273.344949:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774273.344955:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774273.344976:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774273.344986:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774273/real 1775774273] req@ffff8de1c7af5880 x1862023612507648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774273.344997:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612507648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774273.345004:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774273.345007:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774273.345011:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774273.345016:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774273.345044:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774273.345055:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774273/real 1775774273] req@ffff8de1c7af5f80 x1862023612507776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774273.345067:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612507776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774273.345081:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774273.345084:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774273.345086:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612507776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774274.303862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774275.327815:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774276.351952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774277.375932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774278.399862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774278.463794:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774278.463801:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774278.463804:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774278.463810:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10250 00000100:00080000:3.0:1775774278.463819:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774278.463824:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774278.463853:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612507904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774278.463872:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774278.463874:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774278.463875:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774278.463878:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10250 00000100:00080000:3.0:1775774278.463880:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774278.463882:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774278.463888:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774278.463897:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612508032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774278.463906:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774278.463909:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774278.463911:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774278.463918:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10250 00000100:00100000:0.0:1775774278.463919:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612507904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774278.463922:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774278.463929:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774278.463934:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774278.463945:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612508160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774278.463955:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774278.463957:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774278.463959:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774278.463961:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10250 00000100:00080000:3.0:1775774278.463964:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774278.463966:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774278.463969:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774278.463976:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774278.463979:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612508288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774278.463985:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774278.463987:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774278.463989:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774278.463991:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10250 00000100:00080000:3.0:1775774278.463994:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774278.463996:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774278.463998:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774278.464016:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612508416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774278.464034:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774278/real 1775774278] req@ffff8de1c7af4a80 x1862023612507904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774278.464052:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612507904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774278.464062:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774278.464071:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774278.464074:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612507904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774278.464082:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774278.464105:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774278.464118:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774278/real 1775774278] req@ffff8de1c7af6d80 x1862023612508032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774278.464129:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612508032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774278.464143:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774278.464146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774278.464149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774278.464169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774278.464186:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774278.464194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774278/real 1775774278] req@ffff8de1c7af7b80 x1862023612508160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774278.464205:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612508160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774278.464212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774278.464214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774278.464217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774278.464223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774278.464240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774278.464249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774278/real 1775774278] req@ffff8de1c7af4e00 x1862023612508288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774278.464259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612508288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774278.464266:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774278.464269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774278.464272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774278.464278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774278.464294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774278.464303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774278/real 1775774278] req@ffff8de1c7af4380 x1862023612508416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774278.464312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612508416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774278.464317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774278.464319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774278.464320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774279.423869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774280.447855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774281.471876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774282.495859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774283.519850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774283.583825:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774283.583831:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774283.583835:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774283.583842:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10255 00000100:00080000:1.0:1775774283.583851:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774283.583857:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774283.583885:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612508544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774283.583904:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774283.583907:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774283.583908:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774283.583910:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10255 00000100:00080000:1.0:1775774283.583912:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774283.583925:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774283.583934:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774283.583942:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612508672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774283.583949:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774283.583952:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774283.583953:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774283.583956:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10255 00000100:00080000:1.0:1775774283.583959:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774283.583960:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612508544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774283.583963:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774283.583970:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774283.583976:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612508800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774283.583983:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774283.583986:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774283.583987:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774283.583989:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10255 00000100:00080000:1.0:1775774283.584004:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774283.584007:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774283.584010:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774283.584014:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774283.584020:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612508928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774283.584027:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774283.584029:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774283.584030:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774283.584032:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10255 00000100:00080000:1.0:1775774283.584034:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774283.584036:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774283.584039:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774283.584047:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612509056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774283.584052:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774283/real 1775774283] req@ffff8de1c2e17800 x1862023612508544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774283.584072:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612508544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774283.584082:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774283.584086:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774283.584091:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612508544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774283.584097:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774283.584117:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774283.584126:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774283/real 1775774283] req@ffff8de1c2e15500 x1862023612508672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774283.584133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612508672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774283.584140:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774283.584143:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774283.584147:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774283.584169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774283.584188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774283.584198:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774283/real 1775774283] req@ffff8de1c2e14700 x1862023612508800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774283.584209:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612508800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774283.584217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774283.584220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774283.584223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774283.584228:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774283.584242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774283.584250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774283/real 1775774283] req@ffff8de1c2e17480 x1862023612508928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774283.584261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612508928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774283.584269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774283.584271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774283.584274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612508928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774283.584278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774283.584290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774283.584295:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774283/real 1775774283] req@ffff8de1c2e14a80 x1862023612509056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774283.584302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612509056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774283.584306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774283.584308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774283.584309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774284.543935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774285.567910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774286.591855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774287.615901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774288.639859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774288.703818:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774288.703840:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774288.703844:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774288.703852:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10260 00000100:00080000:3.0:1775774288.703863:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774288.703869:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774288.703902:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612509184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774288.703929:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774288.703933:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774288.703934:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774288.703939:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10260 00000100:00080000:3.0:1775774288.703942:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774288.703946:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774288.703955:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774288.703970:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612509312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774288.703971:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612509184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774288.703984:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774288.703986:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774288.703988:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774288.703991:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10260 00000100:00080000:3.0:1775774288.703993:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774288.703995:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774288.703999:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774288.704014:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612509440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774288.704025:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775774288.704027:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774288.704031:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774288.704033:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774288.704038:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10260 00000100:00080000:3.0:1775774288.704043:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774288.704047:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774288.704052:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774288.704064:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774288/real 1775774288] req@ffff8de1c7af4000 x1862023612509184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774288.704065:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612509568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774288.704092:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774288.704097:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612509184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774288.704097:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774288.704105:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774288.704106:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774288.704109:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774288.704116:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612509184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774288.704116:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10260 00000100:00080000:3.0:1775774288.704122:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774288.704128:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774288.704133:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774288.704144:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612509696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774288.704150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774288.704178:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774288.704190:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774288/real 1775774288] req@ffff8de1c7af7480 x1862023612509312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774288.704202:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612509312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774288.704210:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774288.704213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774288.704216:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774288.704230:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774288.704249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774288.704259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774288/real 1775774288] req@ffff8de1c7af5500 x1862023612509440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774288.704270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612509440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774288.704282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774288.704285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774288.704288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774288.704294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774288.704310:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774288.704316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774288/real 1775774288] req@ffff8de1c7af5c00 x1862023612509568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774288.704323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612509568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774288.704327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774288.704329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774288.704331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774288.704344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774288.704361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774288.704370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774288/real 1775774288] req@ffff8de1c7af6300 x1862023612509696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774288.704381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612509696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774288.704388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774288.704391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774288.704394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774289.663925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774290.687841:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774291.711880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774292.735882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774293.759904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774293.823825:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774293.823833:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774293.823838:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774293.823847:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10265 00000100:00080000:0.0:1775774293.823856:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774293.823878:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774293.823909:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612509824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774293.823926:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774293.823929:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774293.823931:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774293.823934:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10265 00000100:00080000:0.0:1775774293.823938:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774293.823942:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774293.823953:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774293.823958:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612509824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774293.823971:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612509952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774293.823987:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774293.823992:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774293.823994:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774293.823999:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10265 00000100:00080000:0.0:1775774293.824010:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774293.824014:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774293.824020:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775774293.824021:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774293.824035:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612510080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774293.824045:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774293.824048:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774293.824050:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774293.824055:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10265 00000100:00100000:1.0:1775774293.824058:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774293/real 1775774293] req@ffff8de1c5683480 x1862023612509824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774293.824060:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774293.824067:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774293.824074:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774293.824084:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612510208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774293.824089:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612509824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774293.824100:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774293.824105:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774293.824109:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774293.824117:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10265 00000100:00080000:0.0:1775774293.824121:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774293.824122:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774293.824125:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775774293.824130:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:0.0:1775774293.824131:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774293.824136:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612509824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774293.824141:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612510336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774293.824163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774293.824188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774293.824200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774293/real 1775774293] req@ffff8de1c5681500 x1862023612509952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774293.824210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612509952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774293.824217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774293.824220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774293.824223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612509952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774293.824229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774293.824247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774293.824257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774293/real 1775774293] req@ffff8de1c5681880 x1862023612510080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774293.824277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612510080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774293.824288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774293.824292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774293.824295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774293.824302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774293.824320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774293.824330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774293/real 1775774293] req@ffff8de1c5680e00 x1862023612510208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774293.824340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612510208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774293.824348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774293.824352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774293.824355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774293.824361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774293.824382:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774293.824394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774293/real 1775774293] req@ffff8de1c5683800 x1862023612510336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774293.824406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612510336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774293.824413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774293.824417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774293.824422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774294.783891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774295.807882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774296.831848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774297.855879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774298.879854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774298.943818:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774298.943825:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774298.943829:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774298.943837:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10270 00000100:00080000:3.0:1775774298.943846:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774298.943852:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774298.943882:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612510464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774298.943902:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774298.943906:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774298.943908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774298.943912:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10270 00000100:00080000:3.0:1775774298.943916:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774298.943920:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774298.943929:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774298.943933:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612510464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774298.943947:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612510592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774298.943958:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774298.943962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774298.943964:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774298.943968:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10270 00000100:00080000:3.0:1775774298.943972:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774298.943976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774298.943981:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774298.943993:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612510720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774298.943994:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774298.944007:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774298.944010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774298.944011:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774298.944014:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10270 00000100:00080000:3.0:1775774298.944017:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774298.944020:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774298.944024:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774298.944027:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774298/real 1775774298] req@ffff8de1c7af6a00 x1862023612510464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774298.944034:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612510848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774298.944052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774298.944055:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774298.944057:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774298.944062:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612510464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774298.944062:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10270 00000100:00080000:3.0:1775774298.944069:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774298.944076:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775774298.944081:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:3.0:1775774298.944083:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775774298.944087:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774298.944091:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612510464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774298.944098:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612510976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774298.944111:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774298.944131:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774298.944141:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774298/real 1775774298] req@ffff8de1c7af6680 x1862023612510592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774298.944149:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612510592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774298.944154:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774298.944156:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774298.944158:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774298.944161:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774298.944170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774298.944175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774298/real 1775774298] req@ffff8de1c7af4700 x1862023612510720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774298.944181:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612510720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774298.944189:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774298.944191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774298.944193:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774298.944196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774298.944204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774298.944208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774298/real 1775774298] req@ffff8de1c7af6300 x1862023612510848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774298.944214:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612510848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774298.944219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774298.944220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774298.944222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774298.944225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774298.944233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774298.944237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774298/real 1775774298] req@ffff8de1c7af5c00 x1862023612510976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774298.944243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612510976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774298.944247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774298.944249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774298.944251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612510976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774299.903893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774300.927836:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774301.951887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774302.975970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774303.999918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774304.063855:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774304.063865:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774304.063869:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774304.063879:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10275 00000100:00080000:3.0:1775774304.063892:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774304.063899:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774304.063946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612511104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774304.063978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774304.063982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774304.063984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774304.063989:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10275 00000100:00080000:3.0:1775774304.063993:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774304.063997:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774304.064009:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774304.064026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612511232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774304.064030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612511104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774304.064052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774304.064054:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774304.064056:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774304.064060:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10275 00000100:00080000:3.0:1775774304.064063:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774304.064066:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774304.064070:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774304.064080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612511360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774304.064086:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774304.064089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774304.064090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774304.064093:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10275 00000100:00080000:3.0:1775774304.064096:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774304.064098:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774304.064101:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774304.064107:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612511488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774304.064114:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774304.064116:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774304.064119:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774304.064120:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774304.064123:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10275 00000100:00080000:3.0:1775774304.064125:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774304.064127:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774304.064130:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774304.064136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612511616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774304.064166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774304/real 1775774304] req@ffff8de1c7af5500 x1862023612511104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774304.064186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612511104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774304.064194:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774304.064197:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774304.064200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612511104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774304.064223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774304.064241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774304.064248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774304/real 1775774304] req@ffff8de1c7af7480 x1862023612511232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774304.064256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612511232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774304.064261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774304.064263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774304.064265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774304.064268:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774304.064277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774304.064283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774304/real 1775774304] req@ffff8de1c7af4000 x1862023612511360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774304.064290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612511360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774304.064294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774304.064295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774304.064297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774304.064302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774304.064320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774304.064330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774304/real 1775774304] req@ffff8de1c7af4380 x1862023612511488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774304.064341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612511488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774304.064348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774304.064352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774304.064355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774304.064360:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774304.064378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774304.064385:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774304/real 1775774304] req@ffff8de1c7af4e00 x1862023612511616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774304.064392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612511616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774304.064398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774304.064400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774304.064401:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774305.023897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774306.047882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774307.071883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774308.095852:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774309.119870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774309.183808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774309.183817:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774309.183821:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774309.183830:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10280 00000100:00080000:3.0:1775774309.183840:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774309.183847:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774309.183880:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612511744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774309.183907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774309.183910:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774309.183912:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774309.183916:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10280 00000100:00080000:3.0:1775774309.183921:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774309.183924:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774309.183933:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774309.183941:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612511744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774309.183950:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612511872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774309.183961:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774309.183964:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774309.183966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774309.183971:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10280 00000100:00080000:3.0:1775774309.183974:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774309.183977:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774309.183982:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774309.183991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612512000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774309.184000:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775774309.184005:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774309.184006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774309.184009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774309.184014:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10280 00000100:00080000:3.0:1775774309.184019:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774309.184028:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774309.184033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774309.184045:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774309/real 1775774309] req@ffff8de1c7af7b80 x1862023612511744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774309.184046:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612512128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774309.184066:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774309.184071:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774309.184072:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774309.184076:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10280 00000100:00080000:3.0:1775774309.184080:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774309.184083:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612511744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774309.184086:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774309.184093:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775774309.184099:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774309.184104:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774309.184108:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612512256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774309.184111:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612511744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774309.184134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774309.184152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774309.184160:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774309/real 1775774309] req@ffff8de1c7af6d80 x1862023612511872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774309.184168:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612511872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774309.184172:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774309.184174:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774309.184176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612511872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774309.184180:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774309.184189:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774309.184194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774309/real 1775774309] req@ffff8de1c7af4a80 x1862023612512000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774309.184200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612512000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774309.184205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774309.184206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774309.184207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774309.184211:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774309.184225:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774309.184230:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774309/real 1775774309] req@ffff8de1c7af5f80 x1862023612512128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774309.184237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612512128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774309.184241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774309.184243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774309.184244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774309.184247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774309.184255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774309.184260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774309/real 1775774309] req@ffff8de1c7af5880 x1862023612512256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774309.184266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612512256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774309.184270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774309.184272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774309.184273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774310.143864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774311.167946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774312.191913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774313.215948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774314.239985:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774314.303890:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774314.303903:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774314.303908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774314.303921:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10286 00000100:00080000:2.0:1775774314.303937:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774314.303945:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774314.304002:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612512384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774314.304033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774314.304037:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774314.304039:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774314.304043:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10286 00000100:00080000:2.0:1775774314.304047:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774314.304051:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774314.304062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774314.304077:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612512384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774314.304084:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612512512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774314.304096:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774314.304100:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774314.304102:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774314.304106:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10286 00000100:00080000:2.0:1775774314.304110:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774314.304114:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774314.304119:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774314.304138:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612512640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774314.304147:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774314.304152:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:1.0:1775774314.304155:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774314.304155:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774314.304162:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10286 00000100:00080000:2.0:1775774314.304166:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774314.304171:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774314.304177:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774314.304188:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612512768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774314.304196:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774314.304200:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775774314.304201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774314/real 1775774314] req@ffff8de1d0f2ca80 x1862023612512384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774314.304203:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774314.304211:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10286 00000100:00080000:2.0:1775774314.304216:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774314.304220:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774314.304224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612512384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775774314.304226:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775774314.304237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774314.304242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774314.304242:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612512896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774314.304247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612512384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774314.304275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774314.304295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774314.304306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774314/real 1775774314] req@ffff8de1d0f2df80 x1862023612512512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774314.304317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612512512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774314.304330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774314.304334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774314.304337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774314.304343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774314.304359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774314.304369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774314/real 1775774314] req@ffff8de1d0f2f100 x1862023612512640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774314.304392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612512640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774314.304400:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774314.304403:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774314.304406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774314.304412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774314.304432:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774314.304440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774314/real 1775774314] req@ffff8de1d0f2c700 x1862023612512768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774314.304448:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612512768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774314.304453:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774314.304455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774314.304457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774314.304461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774314.304472:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774314.304477:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774314/real 1775774314] req@ffff8de1d0f2d500 x1862023612512896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774314.304483:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612512896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774314.304487:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774314.304489:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774314.304491:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612512896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774315.263964:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774316.287900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774317.311961:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774318.335909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774319.359909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774319.423880:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774319.423889:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774319.423894:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774319.423905:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10291 00000100:00080000:3.0:1775774319.423916:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774319.423924:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774319.423970:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612513024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774319.424002:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774319.424007:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774319.424008:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774319.424012:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10291 00000100:00080000:3.0:1775774319.424015:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774319.424018:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774319.424033:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774319.424050:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612513152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774319.424061:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774319.424065:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774319.424067:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774319.424071:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10291 00000100:00080000:3.0:1775774319.424076:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774319.424083:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774319.424094:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774319.424095:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612513024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774319.424111:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612513280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774319.424122:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774319.424125:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774319.424127:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774319.424131:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10291 00000100:00080000:3.0:1775774319.424136:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774319.424142:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774319.424148:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774319.424160:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612513408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774319.424170:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775774319.424173:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774319.424181:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774319.424184:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774319.424191:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10291 00000100:00080000:3.0:1775774319.424195:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774319.424200:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774319.424206:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774319.424218:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612513536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774319.424229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774319/real 1775774319] req@ffff8de1c7af7800 x1862023612513024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774319.424258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612513024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774319.424269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774319.424274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774319.424279:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612513024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774319.424287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774319.424339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774319.424351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774319/real 1775774319] req@ffff8de1c7af7100 x1862023612513152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774319.424362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612513152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774319.424370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774319.424372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774319.424375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774319.424399:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774319.424418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774319.424428:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774319/real 1775774319] req@ffff8de1c7af5180 x1862023612513280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774319.424439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612513280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774319.424446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774319.424449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774319.424451:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774319.424457:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774319.424475:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774319.424484:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774319/real 1775774319] req@ffff8de1c7af5880 x1862023612513408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774319.424494:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612513408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774319.424501:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774319.424504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774319.424508:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774319.424513:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774319.424530:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774319.424540:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774319/real 1775774319] req@ffff8de1c7af5f80 x1862023612513536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774319.424551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612513536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774319.424557:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774319.424560:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774319.424563:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774320.383903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774321.407883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774322.431902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774323.455874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774324.479896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774324.543866:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774324.543874:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774324.543878:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774324.543886:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10296 00000100:00080000:0.0:1775774324.543896:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774324.543901:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774324.543929:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612513664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774324.543951:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774324.543954:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774324.543956:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774324.543959:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10296 00000100:00080000:0.0:1775774324.543962:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774324.543965:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774324.543974:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774324.543985:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612513792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774324.543993:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774324.543996:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775774324.543996:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612513664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774324.543997:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774324.544001:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10296 00000100:00080000:0.0:1775774324.544004:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774324.544007:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774324.544011:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774324.544018:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612513920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774324.544025:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774324.544027:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774324.544029:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774324.544032:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10296 00000100:00080000:0.0:1775774324.544042:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774324.544045:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775774324.544046:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775774324.544048:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774324.544056:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612514048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774324.544062:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774324.544065:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774324.544066:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774324.544069:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10296 00000100:00080000:0.0:1775774324.544071:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774324.544074:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774324.544075:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774324/real 1775774324] req@ffff8de1c5683800 x1862023612513664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775774324.544077:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774324.544084:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612514176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774324.544090:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612513664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774324.544098:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774324.544102:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774324.544105:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612513664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774324.544127:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774324.544143:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774324.544150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774324/real 1775774324] req@ffff8de1c5680e00 x1862023612513792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774324.544157:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612513792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774324.544162:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774324.544164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774324.544165:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774324.544168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774324.544177:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774324.544182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774324/real 1775774324] req@ffff8de1c5681880 x1862023612513920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774324.544188:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612513920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774324.544193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774324.544194:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774324.544196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612513920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774324.544198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774324.544223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774324.544229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774324/real 1775774324] req@ffff8de1c5681500 x1862023612514048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774324.544236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612514048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774324.544241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774324.544243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774324.544244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774324.544247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774324.544256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774324.544261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774324/real 1775774324] req@ffff8de1c5683480 x1862023612514176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774324.544267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612514176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774324.544271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774324.544272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774324.544274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774325.503867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774326.527926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774327.551891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774328.575874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774329.599866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774329.663913:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774329.663923:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774329.663928:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774329.663936:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10301 00000100:00080000:3.0:1775774329.663947:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774329.663953:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774329.663984:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612514304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774329.664013:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774329.664016:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774329.664018:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774329.664022:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10301 00000100:00080000:3.0:1775774329.664025:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774329.664029:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774329.664038:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774329.664050:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612514432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774329.664055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612514304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774329.664063:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774329.664066:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774329.664067:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774329.664070:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10301 00000100:00080000:3.0:1775774329.664073:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774329.664075:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774329.664078:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774329.664087:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612514560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774329.664092:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774329.664094:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774329.664095:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774329.664097:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10301 00000100:00080000:3.0:1775774329.664100:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774329.664101:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774329.664104:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774329.664109:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774329.664125:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612514688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774329.664139:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774329.664141:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774329.664142:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774329.664146:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10301 00000100:00080000:3.0:1775774329.664149:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774329.664152:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774329/real 1775774329] req@ffff8de1c7af4a80 x1862023612514304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774329.664154:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774329.664159:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774329.664172:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612514816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774329.664176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612514304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774329.664193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774329.664197:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774329.664199:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612514304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774329.664217:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774329.664232:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774329.664239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774329/real 1775774329] req@ffff8de1c7af6d80 x1862023612514432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774329.664247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612514432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774329.664252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774329.664254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774329.664256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774329.664260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774329.664271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774329.664276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774329/real 1775774329] req@ffff8de1c7af7b80 x1862023612514560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774329.664282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612514560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774329.664289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774329.664291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774329.664293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774329.664298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774329.664310:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774329.664315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774329/real 1775774329] req@ffff8de1c7af4e00 x1862023612514688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774329.664320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612514688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774329.664325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774329.664328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774329.664330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774329.664334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774329.664347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774329.664369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774329/real 1775774329] req@ffff8de1c7af4380 x1862023612514816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774329.664382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612514816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774329.664390:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774329.664394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774329.664397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612514816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774330.623878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774331.647891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774332.671884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774333.695833:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774334.719859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774334.783891:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774334.783897:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774334.783900:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774334.783908:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10306 00000100:00080000:3.0:1775774334.783916:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774334.783921:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774334.783949:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612514944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774334.783999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612514944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774334.784049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774334.784053:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774334.784054:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774334.784058:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10306 00000100:00080000:3.0:1775774334.784061:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774334.784064:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774334.784074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774334.784087:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612515072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774334.784096:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774334.784099:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774334.784101:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774334.784104:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515072:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774334.784105:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10306 00000100:00080000:3.0:1775774334.784108:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774334.784112:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774334.784116:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774334.784125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612515200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774334.784133:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775774334.784137:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515200:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774334.784137:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774334.784138:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774334.784142:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10306 00000100:00080000:3.0:1775774334.784146:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774334.784149:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774334.784154:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774334.784162:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612515328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774334.784177:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774334.784180:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774334.784182:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774334.784185:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10306 00000100:00080000:3.0:1775774334.784189:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774334.784191:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774334.784196:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774334.784205:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612515456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774334.784206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774334.784233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774335.743886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774336.767840:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774337.791888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775774337.856104:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775774337.856290:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775774337.856310:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774337.856358:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774337.856367:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774337.856374:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774337.856382:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775774337.856435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774334/real 1775774337] req@ffff8de1c7af6300 x1862023612515456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774337.856462:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612515456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774337.856474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774337.856479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774337.856485:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515456:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774337.856493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774334/real 1775774337] req@ffff8de1c7af5c00 x1862023612515328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774337.856507:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612515328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774337.856514:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774337.856518:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774337.856522:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774337.856529:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774334/real 1775774337] req@ffff8de1c7af5500 x1862023612515200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774337.856542:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612515200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774337.856550:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774337.856553:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774337.856556:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774337.856563:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774334/real 1775774337] req@ffff8de1c7af7480 x1862023612515072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774337.856574:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612515072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774337.856581:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774337.856585:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774337.856588:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774337.856595:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774334/real 1775774337] req@ffff8de1c7af4000 x1862023612514944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774337.856607:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612514944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774337.856614:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774337.856618:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774337.856621:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612514944:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775774338.815896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774339.839877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774339.903812:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774339.903821:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774339.903825:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774339.903837:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10311 00000100:00080000:3.0:1775774339.903851:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774339.903860:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774339.903902:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612515584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774339.903962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774339.903966:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774339.903968:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774339.903976:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10311 00000100:00080000:3.0:1775774339.903983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774339.903987:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774339.903999:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774339.904004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612515584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774339.904018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612515712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774339.904036:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774339.904040:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774339.904042:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774339.904047:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10311 00000100:00080000:3.0:1775774339.904050:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774339.904054:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774339.904059:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774339.904071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612515840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774339.904080:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774339.904084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774339.904087:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775774339.904094:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774339.904097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10311 00000100:00080000:3.0:1775774339.904103:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774339.904108:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774339.904113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774339.904126:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612515968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774339.904135:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774339.904138:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774339.904140:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774339.904147:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10311 00000100:00100000:1.0:1775774339.904149:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774339/real 1775774339] req@ffff8de1c7af4700 x1862023612515584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774339.904152:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774339.904158:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774339.904166:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774339.904179:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612516096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774339.904184:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612515584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774339.904199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774339.904205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774339.904209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612515584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774339.904248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774339.904273:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774339.904285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774339/real 1775774339] req@ffff8de1c7af6680 x1862023612515712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774339.904298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612515712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774339.904306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774339.904310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774339.904313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774339.904327:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774339.904346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774339.904357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774339/real 1775774339] req@ffff8de1c7af6a00 x1862023612515840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774339.904369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612515840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774339.904384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774339.904388:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774339.904391:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774339.904397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774339.904417:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774339.904426:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774339/real 1775774339] req@ffff8de1c7af4000 x1862023612515968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774339.904437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612515968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774339.904444:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774339.904447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774339.904450:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612515968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774339.904455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774339.904473:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774339.904482:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774339/real 1775774339] req@ffff8de1c7af7480 x1862023612516096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774339.904492:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612516096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774339.904499:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774339.904502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774339.904506:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774340.863862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774341.887856:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774342.911932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774343.935941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774344.959907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774345.023894:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774345.023904:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774345.023908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774345.023920:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10316 00000100:00080000:2.0:1775774345.023933:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774345.023939:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774345.023979:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612516224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774345.024005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774345.024008:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774345.024010:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774345.024013:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10316 00000100:00080000:2.0:1775774345.024015:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774345.024016:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774345.024025:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774345.024033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612516352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774345.024040:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774345.024042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774345.024044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774345.024046:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10316 00000100:00080000:2.0:1775774345.024048:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774345.024050:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774345.024053:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774345.024060:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612516480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774345.024066:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774345.024068:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1775774345.024069:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612516224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774345.024069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774345.024076:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10316 00000100:00080000:2.0:1775774345.024078:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774345.024080:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774345.024084:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774345.024094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612516608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774345.024103:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774345.024106:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774345.024107:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774345.024111:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10316 00000100:00080000:2.0:1775774345.024116:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774345.024119:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774345.024125:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774345.024136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612516736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774345.024142:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774345.024182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774345/real 1775774345] req@ffff8de1d0f2e300 x1862023612516224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774345.024198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612516224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774345.024205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774345.024209:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774345.024211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612516224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774345.024216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774345.024229:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774345.024236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774345/real 1775774345] req@ffff8de1d0f2e680 x1862023612516352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774345.024243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612516352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774345.024248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774345.024250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774345.024251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774345.024273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774345.024282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774345.024288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774345/real 1775774345] req@ffff8de1d0f2d500 x1862023612516480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774345.024294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612516480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774345.024299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774345.024301:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774345.024303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774345.024306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774345.024318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774345.024326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774345/real 1775774345] req@ffff8de1d0f2c700 x1862023612516608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774345.024337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612516608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774345.024344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774345.024353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774345.024356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774345.024362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774345.024381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774345.024391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774345/real 1775774345] req@ffff8de1d0f2f100 x1862023612516736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774345.024402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612516736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774345.024410:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774345.024414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774345.024416:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774345.983920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774347.007870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774348.031924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774349.055874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774350.079989:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774350.143851:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774350.143865:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774350.143870:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774350.143881:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10321 00000100:00080000:2.0:1775774350.143894:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774350.143900:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774350.143949:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612516864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774350.143978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774350.143981:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774350.143982:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774350.143985:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10321 00000100:00080000:2.0:1775774350.143988:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774350.143992:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774350.144004:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774350.144019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612516992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774350.144027:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612516864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774350.144034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774350.144038:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774350.144040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774350.144045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10321 00000100:00080000:2.0:1775774350.144058:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774350.144062:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774350.144069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774350.144083:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612517120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774350.144093:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774350.144096:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774350.144098:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775774350.144104:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774350.144106:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10321 00000100:00080000:2.0:1775774350.144112:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774350.144117:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774350.144124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774350.144136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612517248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774350.144146:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774350.144149:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774350.144151:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774350.144155:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10321 00000100:00080000:2.0:1775774350.144158:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774350.144160:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774350/real 1775774350] req@ffff8de1d0f2df80 x1862023612516864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774350.144165:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774350.144179:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774350.144185:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612516864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774350.144193:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612517376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774350.144198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774350.144206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774350.144211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612516864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774350.144236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774350.144253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774350.144261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774350/real 1775774350] req@ffff8de1d0f2ca80 x1862023612516992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774350.144269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612516992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774350.144274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774350.144277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774350.144280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612516992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774350.144286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774350.144303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774350.144313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774350/real 1775774350] req@ffff8de1d0f2f100 x1862023612517120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774350.144324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612517120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774350.144332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774350.144335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774350.144337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774350.144344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774350.144363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774350.144386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774350/real 1775774350] req@ffff8de1d0f2c700 x1862023612517248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774350.144398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612517248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774350.144406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774350.144409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774350.144412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774350.144418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774350.144436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774350.144445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774350/real 1775774350] req@ffff8de1d0f2d500 x1862023612517376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774350.144456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612517376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774350.144464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774350.144466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774350.144469:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774351.103941:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774352.127949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774353.151896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774354.175937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774355.199898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774355.263833:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774355.263842:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774355.263847:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774355.263862:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10327 00000100:00080000:2.0:1775774355.263875:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774355.263881:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774355.263922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612517504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774355.263948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774355.263951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774355.263955:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774355.263958:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10327 00000100:00080000:2.0:1775774355.263961:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774355.263963:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774355.263975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774355.263983:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612517632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774355.263992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774355.263995:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774355.263996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774355.264001:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612517504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774355.264001:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10327 00000100:00080000:2.0:1775774355.264005:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774355.264008:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774355.264011:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774355.264020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612517760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774355.264026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774355.264028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774355.264030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774355.264032:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10327 00000100:00080000:2.0:1775774355.264034:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774355.264036:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774355.264039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774355.264045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612517888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774355.264049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774355.264051:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774355.264053:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774355.264055:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10327 00000100:00080000:2.0:1775774355.264058:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774355.264060:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774355.264064:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774355.264067:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774355.264074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612518016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774355.264103:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774355/real 1775774355] req@ffff8de1d0f2e680 x1862023612517504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774355.264125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612517504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774355.264136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774355.264140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774355.264145:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612517504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774355.264167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774355.264183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774355.264191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774355/real 1775774355] req@ffff8de1d0f2e300 x1862023612517632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774355.264199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612517632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774355.264208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774355.264210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774355.264212:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774355.264215:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774355.264225:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774355.264229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774355/real 1775774355] req@ffff8de1d0f2d500 x1862023612517760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774355.264241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612517760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774355.264246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774355.264247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774355.264249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774355.264252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774355.264262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774355.264266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774355/real 1775774355] req@ffff8de1d0f2c700 x1862023612517888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774355.264273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612517888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774355.264277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774355.264278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774355.264281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612517888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774355.264284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774355.264293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774355.264297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774355/real 1775774355] req@ffff8de1d0f2f100 x1862023612518016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774355.264303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612518016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774355.264309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774355.264312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774355.264315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774356.223928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774357.247887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774358.271932:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774359.295910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774360.319929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774360.383877:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774360.383887:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774360.383892:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774360.383902:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10332 00000100:00080000:2.0:1775774360.383917:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774360.383927:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774360.383985:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612518144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774360.384012:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774360.384015:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774360.384016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774360.384020:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10332 00000100:00080000:2.0:1775774360.384023:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774360.384027:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774360.384040:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774360.384056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612518144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774360.384057:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612518272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774360.384072:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774360.384075:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774360.384077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774360.384082:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10332 00000100:00080000:2.0:1775774360.384086:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774360.384090:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774360.384095:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774360.384109:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612518400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774360.384118:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774360.384121:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774360.384122:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774360.384125:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10332 00000100:00080000:2.0:1775774360.384128:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775774360.384133:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774360.384133:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774360.384140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774360.384149:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612518528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774360.384156:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774360.384158:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774360.384160:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774360.384162:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10332 00000100:00080000:2.0:1775774360.384165:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774360.384168:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774360.384172:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774360.384178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612518656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774360.384184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774360/real 1775774360] req@ffff8de1d0f2ca80 x1862023612518144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774360.384206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612518144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774360.384217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774360.384221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774360.384225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612518144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774360.384253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774360.384276:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774360.384288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774360/real 1775774360] req@ffff8de1d0f2df80 x1862023612518272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774360.384298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612518272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774360.384305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774360.384308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774360.384311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774360.384316:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774360.384332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774360.384341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774360/real 1775774360] req@ffff8de1d0f2f100 x1862023612518400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774360.384352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612518400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774360.384358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774360.384361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774360.384363:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774360.384369:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774360.384395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774360.384405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774360/real 1775774360] req@ffff8de1d0f2c700 x1862023612518528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774360.384422:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612518528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774360.384430:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774360.384433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774360.384437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774360.384442:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774360.384460:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774360.384470:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774360/real 1775774360] req@ffff8de1d0f2d500 x1862023612518656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774360.384480:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612518656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774360.384488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774360.384491:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774360.384493:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774361.343925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774362.367913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774363.391960:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774364.415900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774365.439891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774365.503868:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774365.503878:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774365.503883:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774365.503892:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10337 00000100:00080000:2.0:1775774365.503905:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774365.503912:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774365.503953:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612518784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774365.503980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774365.503983:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774365.503984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774365.503987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10337 00000100:00080000:2.0:1775774365.503989:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774365.503992:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774365.504000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774365.504008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612518912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774365.504019:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774365.504021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774365.504022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774365.504025:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10337 00000100:00080000:2.0:1775774365.504028:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774365.504032:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774365.504036:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774365.504044:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612518784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774365.504049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612519040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774365.504061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774365.504064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774365.504066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774365.504070:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10337 00000100:00080000:2.0:1775774365.504073:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774365.504076:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774365.504081:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774365.504090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612519168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774365.504097:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774365.504099:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774365.504100:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774365.504103:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10337 00000100:00080000:2.0:1775774365.504106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774365.504109:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774365.504112:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774365.504118:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612519296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774365.504125:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774365.504159:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774365/real 1775774365] req@ffff8de1d0f2e300 x1862023612518784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774365.504175:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612518784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774365.504183:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774365.504187:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774365.504189:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612518784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774365.504195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774365.504210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774365.504218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774365/real 1775774365] req@ffff8de1d0f2e680 x1862023612518912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774365.504226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612518912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774365.504232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774365.504234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774365.504238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612518912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774365.504259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774365.504274:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774365.504281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774365/real 1775774365] req@ffff8de1d0f2d500 x1862023612519040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774365.504288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612519040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774365.504295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774365.504298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774365.504301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774365.504307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774365.504332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774365.504347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774365/real 1775774365] req@ffff8de1d0f2c700 x1862023612519168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774365.504357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612519168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774365.504362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774365.504368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774365.504373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774365.504378:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774365.504406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774365.504421:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774365/real 1775774365] req@ffff8de1d0f2f100 x1862023612519296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774365.504432:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612519296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774365.504441:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774365.504445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774365.504449:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774366.463833:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774367.487904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774368.511878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774369.535892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774370.559893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774370.623846:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774370.623853:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774370.623857:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774370.623865:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10342 00000100:00080000:3.0:1775774370.623873:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774370.623879:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774370.623909:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612519424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774370.623928:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774370.623931:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774370.623932:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774370.623935:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10342 00000100:00080000:3.0:1775774370.623937:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774370.623940:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774370.623946:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774370.623956:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612519552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774370.623961:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612519424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774370.623968:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774370.623971:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774370.623971:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774370.623974:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10342 00000100:00080000:3.0:1775774370.623976:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774370.623978:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774370.623981:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774370.623988:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612519680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774370.623993:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774370.623995:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774370.623996:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774370.623998:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10342 00000100:00080000:3.0:1775774370.624000:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774370.624001:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774370.624004:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774370.624011:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612519808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774370.624017:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774370.624024:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774370.624027:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774370.624029:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774370.624034:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10342 00000100:00080000:3.0:1775774370.624037:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774370.624041:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774370.624047:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774370.624051:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774370/real 1775774370] req@ffff8de1c7af5500 x1862023612519424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774370.624060:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612519936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774370.624074:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612519424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774370.624092:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774370.624096:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774370.624101:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612519424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774370.624122:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774370.624147:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774370.624158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774370/real 1775774370] req@ffff8de1c7af5c00 x1862023612519552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774370.624170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612519552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774370.624182:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774370.624185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774370.624189:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774370.624195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774370.624212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774370.624220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774370/real 1775774370] req@ffff8de1c7af6300 x1862023612519680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774370.624227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612519680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774370.624232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774370.624233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774370.624235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774370.624239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774370.624249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774370.624253:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774370/real 1775774370] req@ffff8de1c7af4380 x1862023612519808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774370.624260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612519808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774370.624264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774370.624266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774370.624268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774370.624271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774370.624278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774370.624283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774370/real 1775774370] req@ffff8de1c7af4e00 x1862023612519936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774370.624288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612519936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774370.624293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774370.624294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774370.624296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612519936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774371.583906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774372.607878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774373.631883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774374.655901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774375.679911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774375.743813:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774375.743820:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774375.743824:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774375.743831:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10347 00000100:00080000:3.0:1775774375.743840:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774375.743844:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774375.743873:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612520064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774375.743894:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774375.743897:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774375.743898:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774375.743901:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10347 00000100:00080000:3.0:1775774375.743903:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774375.743905:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774375.743911:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774375.743921:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612520192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774375.743931:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774375.743934:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774375.743935:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774375.743941:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612520064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774375.743941:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10347 00000100:00080000:3.0:1775774375.743948:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774375.743953:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774375.743958:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774375.743971:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612520320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774375.743982:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774375.743986:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774375.743987:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774375.743990:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10347 00000800:00000100:1.0:1775774375.743995:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774375.743997:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774375.744002:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774375.744007:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774375.744016:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612520448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774375.744023:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775774375.744025:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774375/real 1775774375] req@ffff8de1c7af7b80 x1862023612520064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774375.744025:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774375.744028:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774375.744041:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10347 00000100:00080000:3.0:1775774375.744046:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774375.744048:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612520064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774375.744052:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774375.744061:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775774375.744064:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774375.744070:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774375.744074:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612520576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774375.744079:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612520064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774375.744100:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774375.744124:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774375.744136:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774375/real 1775774375] req@ffff8de1c7af6d80 x1862023612520192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774375.744148:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612520192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774375.744155:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774375.744158:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774375.744162:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774375.744192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774375.744207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774375.744214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774375/real 1775774375] req@ffff8de1c7af4a80 x1862023612520320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774375.744221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612520320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774375.744229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774375.744231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774375.744233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774375.744236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774375.744245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774375.744250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774375/real 1775774375] req@ffff8de1c7af5f80 x1862023612520448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774375.744256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612520448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774375.744260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774375.744261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774375.744263:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774375.744267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774375.744282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774375.744291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774375/real 1775774375] req@ffff8de1c7af5880 x1862023612520576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774375.744302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612520576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774375.744323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774375.744326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774375.744330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774376.703823:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774377.727893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774378.751855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774379.775883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774380.799875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774380.863831:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774380.863837:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774380.863841:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774380.863848:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10352 00000100:00080000:2.0:1775774380.863856:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774380.863861:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774380.863888:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612520704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774380.863906:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774380.863909:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774380.863910:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774380.863912:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10352 00000100:00080000:2.0:1775774380.863914:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774380.863917:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774380.863925:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774380.863931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612520832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774380.863942:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774380.863944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774380.863945:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774380.863948:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612520704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774380.863949:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10352 00000100:00080000:2.0:1775774380.863953:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774380.863956:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774380.863959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774380.863966:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612520960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774380.863975:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774380.863978:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774380.863979:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774380.863981:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10352 00000100:00080000:2.0:1775774380.863984:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774380.863985:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774380.863989:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774380.863999:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612521088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774380.864006:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774380.864012:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774380.864016:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774380.864018:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774380.864023:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10352 00000100:00080000:2.0:1775774380.864027:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774380.864031:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774380.864036:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774380.864042:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774380/real 1775774380] req@ffff8de1d0f2df80 x1862023612520704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774380.864047:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612521216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774380.864078:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612520704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774380.864089:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774380.864099:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774380.864103:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612520704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774380.864123:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774380.864154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774380.864165:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774380/real 1775774380] req@ffff8de1d0f2ca80 x1862023612520832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774380.864176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612520832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774380.864184:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774380.864187:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774380.864190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774380.864195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774380.864211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774380.864233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774380/real 1775774380] req@ffff8de1d0f2f100 x1862023612520960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774380.864241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612520960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774380.864246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774380.864248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774380.864250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612520960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774380.864253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774380.864265:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774380.864270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774380/real 1775774380] req@ffff8de1d0f2c700 x1862023612521088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774380.864276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612521088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774380.864280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774380.864281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774380.864283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774380.864286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774380.864294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774380.864298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774380/real 1775774380] req@ffff8de1d0f2d500 x1862023612521216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774380.864304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612521216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774380.864308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774380.864310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774380.864312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774381.823853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774382.847896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774383.871861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774384.895943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774385.919913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774385.983861:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774385.983870:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774385.983874:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774385.983884:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10357 00000100:00080000:3.0:1775774385.983896:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774385.983903:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774385.983947:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612521344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774385.983979:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774385.983983:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774385.983985:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774385.983989:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10357 00000100:00080000:3.0:1775774385.983993:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774385.983995:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774385.984005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774385.984018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612521472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774385.984027:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775774385.984030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612521344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774385.984030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774385.984031:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774385.984038:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10357 00000100:00080000:3.0:1775774385.984040:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774385.984042:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774385.984045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774385.984053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612521600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774385.984059:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774385.984061:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774385.984062:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774385.984066:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10357 00000100:00080000:3.0:1775774385.984068:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774385.984070:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774385.984073:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774385.984079:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612521728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774385.984084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774385.984086:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774385.984088:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774385.984090:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10357 00000100:00080000:3.0:1775774385.984092:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774385.984094:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774385.984097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774385.984101:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774385.984105:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612521856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774385.984150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774385/real 1775774385] req@ffff8de1c7af5180 x1862023612521344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774385.984167:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612521344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774385.984175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774385.984179:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774385.984182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612521344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774385.984203:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774385.984219:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774385.984227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774385/real 1775774385] req@ffff8de1c7af7100 x1862023612521472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774385.984234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612521472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774385.984239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774385.984241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774385.984243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774385.984247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774385.984257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774385.984261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774385/real 1775774385] req@ffff8de1c7af7800 x1862023612521600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774385.984268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612521600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774385.984272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774385.984274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774385.984276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774385.984283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774385.984293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774385.984297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774385/real 1775774385] req@ffff8de1c7af5880 x1862023612521728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774385.984304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612521728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774385.984309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774385.984311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774385.984313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774385.984315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774385.984323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774385.984328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774385/real 1775774385] req@ffff8de1c7af5f80 x1862023612521856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774385.984335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612521856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774385.984339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774385.984340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774385.984342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612521856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774386.943904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774387.967870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774388.991891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774390.015877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774391.039904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774391.103870:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774391.103879:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774391.103883:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774391.103892:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10362 00000100:00080000:2.0:1775774391.103903:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774391.103910:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774391.103946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612521984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774391.103977:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774391.103981:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774391.103983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774391.103986:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10362 00000100:00080000:2.0:1775774391.103991:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774391.103995:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774391.104005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774391.104017:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612521984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774391.104019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612522112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774391.104031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774391.104034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774391.104036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774391.104053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10362 00000100:00080000:2.0:1775774391.104057:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774391.104061:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774391.104066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774391.104081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612522240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774391.104083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774391.104094:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774391.104097:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774391.104099:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774391.104104:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10362 00000100:00080000:2.0:1775774391.104108:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774391.104111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774391.104114:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774391/real 1775774391] req@ffff8de1d0f2e680 x1862023612521984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775774391.104118:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774391.104131:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612522368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774391.104135:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612521984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774391.104160:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774391.104163:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774391.104164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774391.104164:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774391.104172:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10362 00000100:00080000:1.0:1775774391.104173:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775774391.104176:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774391.104179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612521984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774391.104182:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774391.104186:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774391.104193:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612522496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774391.104202:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774391.104218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774391.104227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774391/real 1775774391] req@ffff8de1d0f2e300 x1862023612522112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774391.104234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612522112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774391.104243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774391.104245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774391.104247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774391.104250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774391.104259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774391.104264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774391/real 1775774391] req@ffff8de1d0f2d500 x1862023612522240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774391.104270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612522240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774391.104274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774391.104275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774391.104277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774391.104280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774391.104288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774391.104292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774391/real 1775774391] req@ffff8de1d0f2c700 x1862023612522368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774391.104298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612522368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774391.104302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774391.104304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774391.104306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774391.104314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774391.104322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774391.104327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774391/real 1775774391] req@ffff8de1d0f2f100 x1862023612522496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774391.104333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612522496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774391.104337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774391.104339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774391.104340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774392.063951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774393.087866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774394.111853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774395.135929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774396.159909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774396.223840:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774396.223850:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774396.223855:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774396.223868:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10367 00000100:00080000:3.0:1775774396.223883:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774396.223891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774396.223946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612522624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774396.223992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774396.223995:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774396.223997:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774396.224000:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10367 00000100:00080000:3.0:1775774396.224004:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774396.224007:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774396.224017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774396.224030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612522752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774396.224039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774396.224042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774396.224044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774396.224045:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612522624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774396.224049:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10367 00000100:00080000:3.0:1775774396.224054:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774396.224057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774396.224060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774396.224068:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612522880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774396.224080:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774396.224082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774396.224084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774396.224086:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10367 00000100:00080000:3.0:1775774396.224088:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774396.224091:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774396.224094:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774396.224101:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612523008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774396.224106:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774396.224109:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774396.224109:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774396.224112:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10367 00000100:00080000:3.0:1775774396.224115:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774396.224118:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774396.224121:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774396.224127:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612523136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774396.224143:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774396.224188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774396/real 1775774396] req@ffff8de1c7af4a80 x1862023612522624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774396.224212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612522624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774396.224224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774396.224229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774396.224234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612522624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774396.224263:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774396.224295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774396.224309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774396/real 1775774396] req@ffff8de1c7af6d80 x1862023612522752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774396.224323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612522752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774396.224333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774396.224336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774396.224340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774396.224346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774396.224364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774396.224372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774396/real 1775774396] req@ffff8de1c7af7b80 x1862023612522880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774396.224384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612522880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774396.224393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774396.224396:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774396.224399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612522880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774396.224405:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774396.224425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774396.224436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774396/real 1775774396] req@ffff8de1c7af4e00 x1862023612523008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774396.224449:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612523008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774396.224459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774396.224462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774396.224466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774396.224472:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774396.224490:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774396.224498:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774396/real 1775774396] req@ffff8de1c7af4380 x1862023612523136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774396.224510:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612523136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774396.224519:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774396.224522:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774396.224525:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774397.183915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774398.207986:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774399.231879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774400.255928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774401.279897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774401.343814:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774401.343829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774401.343835:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774401.343849:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10373 00000100:00080000:2.0:1775774401.343875:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774401.343885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774401.343931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612523264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774401.343964:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774401.343968:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774401.343970:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774401.343975:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10373 00000100:00080000:2.0:1775774401.343979:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774401.343983:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774401.343994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774401.344006:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612523392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774401.344006:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612523264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774401.344021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774401.344028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774401.344029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774401.344035:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10373 00000100:00080000:2.0:1775774401.344038:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774401.344040:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774401.344044:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774401.344055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612523520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774401.344062:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774401.344065:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774401.344066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774401.344070:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10373 00000100:00080000:2.0:1775774401.344082:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774401.344086:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774401.344092:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774401.344103:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612523648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774401.344111:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774401.344115:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774401.344119:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774401.344123:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10373 00000100:00080000:2.0:1775774401.344126:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774401.344128:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774401.344133:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774401.344141:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774401.344146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612523776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774401.344265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774401.344300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774401.344331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774402.303954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774403.327868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774404.352856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775774404.415982:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775774404.416017:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775774404.416031:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774404.416061:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774404.416068:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774404.416073:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774404.416079:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775774404.416155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774401/real 1775774404] req@ffff8de1d0f2d500 x1862023612523776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774404.416196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612523776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774404.416211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774404.416218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774404.416224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523776:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774404.416236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774401/real 1775774404] req@ffff8de1d0f2df80 x1862023612523392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774404.416253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612523392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774404.416262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774404.416267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774404.416271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774404.416279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774401/real 1775774404] req@ffff8de1d0f2f100 x1862023612523520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774404.416295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612523520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774404.416312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774404.416316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774404.416320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774404.416330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774401/real 1775774404] req@ffff8de1d0f2c700 x1862023612523648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774404.416344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612523648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774404.416353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774404.416357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774404.416360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612523648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774404.416369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774401/real 1775774404] req@ffff8de1d0f2ca80 x1862023612523264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774404.416385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612523264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774404.416394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774404.416399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774404.416403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612523264:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775774405.375838:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774406.399944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774406.463902:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774406.463913:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774406.463918:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774406.463928:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10378 00000100:00080000:0.0:1775774406.463939:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774406.463946:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774406.463979:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612523904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774406.464008:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774406.464012:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774406.464014:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774406.464019:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10378 00000100:00080000:0.0:1775774406.464023:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774406.464027:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774406.464037:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774406.464052:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612524032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774406.464064:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774406.464068:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774406.464070:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774406.464075:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10378 00000100:00080000:0.0:1775774406.464081:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775774406.464092:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612523904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774406.464093:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774406.464110:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774406.464131:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612524160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774406.464146:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774406.464149:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774406.464152:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774406.464157:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10378 00000100:00080000:0.0:1775774406.464163:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774406.464182:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774406.464189:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774406.464202:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774406.464208:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612524288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774406.464220:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774406.464225:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774406.464227:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774406.464234:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10378 00000100:00080000:0.0:1775774406.464239:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774406.464245:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774406.464251:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774406.464267:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612524416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774406.464273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774406/real 1775774406] req@ffff8de1c5680000 x1862023612523904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774406.464335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612523904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774406.464351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774406.464366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774406.464372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612523904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774406.464383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774406.464421:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774406.464437:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774406/real 1775774406] req@ffff8de1c5680380 x1862023612524032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774406.464451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612524032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774406.464460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774406.464464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774406.464468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774406.464513:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774406.464540:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774406.464552:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774406/real 1775774406] req@ffff8de1c5682a00 x1862023612524160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774406.464565:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612524160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774406.464579:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774406.464583:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774406.464586:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774406.464592:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774406.464617:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774406.464800:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774406/real 1775774406] req@ffff8de1c5681f80 x1862023612524288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774406.464814:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612524288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774406.464824:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774406.464828:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774406.464831:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774406.464839:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774406.464864:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774406.464883:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774406/real 1775774406] req@ffff8de1c5681c00 x1862023612524416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774406.464895:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612524416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774406.464902:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774406.464905:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774406.464909:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774407.423847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774408.447862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774409.471942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774410.495968:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774411.519919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774411.583835:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774411.583844:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774411.583849:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774411.583860:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10383 00000100:00080000:3.0:1775774411.583872:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774411.583879:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774411.583923:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612524544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774411.583953:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774411.583956:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774411.583958:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774411.583961:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10383 00000100:00080000:3.0:1775774411.583964:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774411.583967:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774411.583976:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774411.583986:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612524672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774411.583995:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774411.583998:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774411.584001:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774411.584002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612524544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774411.584006:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10383 00000100:00080000:3.0:1775774411.584011:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774411.584015:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774411.584019:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774411.584029:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612524800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774411.584035:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774411.584037:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774411.584039:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774411.584042:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10383 00000100:00080000:3.0:1775774411.584054:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774411.584058:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774411.584063:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774411.584077:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612524928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774411.584081:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774411.584093:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774411.584097:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774411.584099:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774411.584105:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10383 00000100:00080000:3.0:1775774411.584109:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774411.584114:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774411.584121:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774411.584122:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774411/real 1775774411] req@ffff8de1c7af6300 x1862023612524544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774411.584137:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612525056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774411.584145:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612524544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774411.584159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774411.584163:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774411.584167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612524544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774411.584193:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774411.584209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774411.584217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774411/real 1775774411] req@ffff8de1c7af5c00 x1862023612524672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774411.584226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612524672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774411.584231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774411.584233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774411.584236:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774411.584239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774411.584249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774411.584254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774411/real 1775774411] req@ffff8de1c7af5500 x1862023612524800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774411.584262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612524800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774411.584267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774411.584269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774411.584270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774411.584274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774411.584284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774411.584289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774411/real 1775774411] req@ffff8de1c7af7480 x1862023612524928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774411.584298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612524928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774411.584303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774411.584304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774411.584306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612524928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774411.584309:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774411.584319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774411.584324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774411/real 1775774411] req@ffff8de1c7af4000 x1862023612525056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774411.584331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612525056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774411.584336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774411.584338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774411.584340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774412.544038:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774413.567906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774414.591910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774415.615869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774416.639912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774416.703884:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774416.703893:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774416.703898:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774416.703909:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10388 00000100:00080000:0.0:1775774416.703924:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774416.703931:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774416.703974:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612525184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774416.704003:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774416.704006:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774416.704007:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774416.704010:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10388 00000100:00080000:0.0:1775774416.704013:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774416.704015:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774416.704025:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774416.704035:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612525312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774416.704043:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774416.704046:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774416.704047:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774416.704050:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10388 00000100:00080000:0.0:1775774416.704052:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774416.704057:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774416.704058:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612525184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774416.704060:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774416.704071:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612525440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774416.704078:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774416.704082:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774416.704083:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774416.704086:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10388 00000100:00080000:0.0:1775774416.704096:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774416.704099:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774416.704103:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774416.704112:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612525568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774416.704118:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774416.704121:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774416.704122:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774416.704125:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10388 00000100:00080000:0.0:1775774416.704127:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774416.704129:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774416.704132:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774416.704138:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774416.704141:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612525696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774416.704181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774416/real 1775774416] req@ffff8de1c5683b80 x1862023612525184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774416.704198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612525184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774416.704211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774416.704215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774416.704219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612525184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774416.704224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774416.704240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774416.704248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774416/real 1775774416] req@ffff8de1c5682300 x1862023612525312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774416.704256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612525312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774416.704262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774416.704264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774416.704266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774416.704291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774416.704302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774416.704307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774416/real 1775774416] req@ffff8de1c5680700 x1862023612525440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774416.704315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612525440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774416.704320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774416.704323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774416.704325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774416.704329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774416.704339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774416.704354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774416/real 1775774416] req@ffff8de1c5682d80 x1862023612525568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774416.704363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612525568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774416.704368:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774416.704371:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774416.704373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774416.704377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774416.704389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774416.704405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774416/real 1775774416] req@ffff8de1c5682680 x1862023612525696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774416.704413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612525696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774416.704418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774416.704421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774416.704423:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774417.663908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774418.687959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774419.711952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774420.735928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774421.759949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774421.823877:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774421.823887:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774421.823892:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774421.823903:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10393 00000100:00080000:3.0:1775774421.823917:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774421.823924:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774421.823969:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612525824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774421.823995:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774421.824004:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774421.824006:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774421.824009:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10393 00000100:00080000:3.0:1775774421.824012:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774421.824015:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774421.824025:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774421.824037:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612525952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774421.824045:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774421.824048:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774421.824050:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774421.824055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612525824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774421.824055:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10393 00000100:00080000:3.0:1775774421.824058:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774421.824064:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774421.824067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774421.824074:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612526080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774421.824082:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774421.824085:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774421.824086:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774421.824088:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10393 00000100:00080000:3.0:1775774421.824090:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774421.824093:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774421.824096:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774421.824103:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612526208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774421.824108:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774421.824110:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774421.824111:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774421.824114:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10393 00000100:00080000:3.0:1775774421.824117:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774421.824120:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774421.824123:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774421.824129:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612526336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774421.824138:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774421.824175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774421/real 1775774421] req@ffff8de1c7af6a00 x1862023612525824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774421.824193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612525824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774421.824201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774421.824205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774421.824209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612525824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774421.824232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774421.824248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774421.824256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774421/real 1775774421] req@ffff8de1c7af6680 x1862023612525952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774421.824273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612525952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774421.824279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774421.824281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774421.824283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612525952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774421.824287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774421.824299:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774421.824305:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774421/real 1775774421] req@ffff8de1c7af4700 x1862023612526080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774421.824313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612526080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774421.824322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774421.824325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774421.824327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774421.824331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774421.824341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774421.824346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774421/real 1775774421] req@ffff8de1c7af4000 x1862023612526208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774421.824353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612526208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774421.824359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774421.824360:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774421.824362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774421.824365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774421.824376:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774421.824381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774421/real 1775774421] req@ffff8de1c7af7480 x1862023612526336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774421.824388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612526336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774421.824393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774421.824395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774421.824398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774422.783941:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774423.807974:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774424.831896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774425.855945:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774426.879933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774426.943836:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774426.943845:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774426.943850:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774426.943860:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10398 00000100:00080000:3.0:1775774426.943873:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774426.943880:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774426.943928:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612526464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774426.943959:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774426.943962:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774426.943964:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774426.943969:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10398 00000100:00080000:3.0:1775774426.943973:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774426.943976:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774426.943988:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774426.944005:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612526592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774426.944011:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612526464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774426.944016:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774426.944019:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774426.944021:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774426.944024:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10398 00000100:00080000:3.0:1775774426.944027:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774426.944031:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774426.944036:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774426.944048:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612526720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774426.944057:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774426.944061:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774426.944063:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774426.944067:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10398 00000100:00080000:3.0:1775774426.944072:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774426.944076:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775774426.944080:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775774426.944082:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774426.944101:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612526848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774426.944109:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774426.944111:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774426.944112:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774426.944116:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10398 00000100:00100000:1.0:1775774426.944119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774426/real 1775774426] req@ffff8de1c7af5500 x1862023612526464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774426.944119:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774426.944126:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774426.944132:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774426.944141:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612526976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774426.944144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612526464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774426.944163:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774426.944167:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774426.944171:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612526464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774426.944199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774426.944221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774426.944233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774426/real 1775774426] req@ffff8de1c7af5c00 x1862023612526592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774426.944241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612526592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774426.944247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774426.944249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774426.944251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774426.944255:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774426.944267:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774426.944279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774426/real 1775774426] req@ffff8de1c7af6300 x1862023612526720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774426.944286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612526720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774426.944291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774426.944293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774426.944295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774426.944298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774426.944308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774426.944313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774426/real 1775774426] req@ffff8de1c7af4380 x1862023612526848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774426.944323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612526848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774426.944330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774426.944333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774426.944335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774426.944341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774426.944358:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774426.944367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774426/real 1775774426] req@ffff8de1c7af4e00 x1862023612526976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774426.944379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612526976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774426.944387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774426.944390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774426.944393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612526976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774427.903955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774428.927917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774429.951919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774430.975860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774431.999881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774432.063804:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774432.063810:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774432.063814:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774432.063821:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10403 00000100:00080000:3.0:1775774432.063830:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774432.063835:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774432.063861:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612527104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774432.063880:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774432.063882:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774432.063884:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774432.063886:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10403 00000100:00080000:3.0:1775774432.063888:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774432.063890:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774432.063898:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774432.063907:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612527232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774432.063910:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612527104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774432.063918:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774432.063921:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774432.063921:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774432.063924:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10403 00000100:00080000:3.0:1775774432.063926:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774432.063928:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774432.063931:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774432.063938:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612527360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774432.063943:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774432.063945:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774432.063946:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774432.063948:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10403 00000100:00080000:3.0:1775774432.063950:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774432.063953:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774432.063957:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774432.063963:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774432.063968:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612527488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774432.063978:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774432.063981:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774432.063983:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774432.063987:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10403 00000100:00100000:1.0:1775774432.063990:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774432/real 1775774432] req@ffff8de1c7af7b80 x1862023612527104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774432.063993:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774432.064001:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774432.064006:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774432.064009:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612527104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774432.064017:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774432.064022:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774432.064022:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612527616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774432.064027:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612527104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774432.064052:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774432.064075:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774432.064086:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774432/real 1775774432] req@ffff8de1c7af6d80 x1862023612527232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774432.064097:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612527232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774432.064105:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774432.064108:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774432.064111:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774432.064117:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774432.064134:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774432.064141:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774432/real 1775774432] req@ffff8de1c7af4a80 x1862023612527360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774432.064148:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612527360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774432.064153:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774432.064154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774432.064156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774432.064159:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774432.064169:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774432.064173:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774432/real 1775774432] req@ffff8de1c7af5f80 x1862023612527488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774432.064179:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612527488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774432.064184:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774432.064185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774432.064187:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774432.064190:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774432.064198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774432.064202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774432/real 1775774432] req@ffff8de1c7af5880 x1862023612527616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774432.064208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612527616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774432.064212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774432.064214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774432.064215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774433.023863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774434.047968:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774435.071850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774436.095886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774437.119860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774437.183856:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774437.183867:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774437.183873:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774437.183886:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10408 00000100:00080000:3.0:1775774437.183903:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774437.183912:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774437.183957:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612527744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774437.183997:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774437.184001:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774437.184013:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774437.184019:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10408 00000100:00080000:3.0:1775774437.184024:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774437.184029:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774437.184039:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774437.184044:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612527744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774437.184060:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612527872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774437.184072:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774437.184076:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774437.184077:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774437.184082:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10408 00000100:00080000:3.0:1775774437.184086:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774437.184090:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774437.184095:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775774437.184102:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774437.184111:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612528000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774437.184122:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774437.184126:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774437.184128:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774437.184134:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10408 00000100:00100000:0.0:1775774437.184136:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774437/real 1775774437] req@ffff8de1c7af7800 x1862023612527744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774437.184139:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774437.184147:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774437.184159:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774437.184176:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612528128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774437.184177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612527744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774437.184251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774437.184257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775774437.184258:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774437.184265:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775774437.184266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612527744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774437.184271:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774437.184279:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10408 00000100:00080000:3.0:1775774437.184283:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774437.184286:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774437.184292:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774437.184298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774437.184304:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612528256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774437.184324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774437.184337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774437/real 1775774437] req@ffff8de1c7af7100 x1862023612527872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774437.184347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612527872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774437.184352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774437.184355:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774437.184357:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612527872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774437.184361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774437.184371:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774437.184377:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774437/real 1775774437] req@ffff8de1c7af5180 x1862023612528000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774437.184384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612528000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774437.184388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774437.184390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774437.184392:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774437.184395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774437.184404:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774437.184408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774437/real 1775774437] req@ffff8de1c7af5880 x1862023612528128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774437.184415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612528128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774437.184419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774437.184421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774437.184422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774437.184432:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774437.184440:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774437.184445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774437/real 1775774437] req@ffff8de1c7af5f80 x1862023612528256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774437.184451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612528256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774437.184456:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774437.184458:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774437.184460:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774438.143854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774439.167881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774440.191867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774441.215873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774442.239860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774442.303868:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774442.303878:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774442.303883:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774442.303893:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10414 00000100:00080000:2.0:1775774442.303906:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774442.303914:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774442.303960:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612528384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774442.303992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774442.303995:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774442.303997:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774442.304000:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10414 00000100:00080000:2.0:1775774442.304004:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774442.304008:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774442.304019:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774442.304032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612528512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774442.304042:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612528384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774442.304043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774442.304049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774442.304051:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774442.304055:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10414 00000100:00080000:2.0:1775774442.304059:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774442.304063:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774442.304067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774442.304081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612528640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774442.304089:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774442.304092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774442.304094:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774442.304097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10414 00000100:00080000:2.0:1775774442.304101:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774442.304105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774442.304110:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774442.304117:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774442.304121:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612528768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774442.304131:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774442.304135:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774442.304137:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774442.304158:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10414 00000100:00080000:2.0:1775774442.304162:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774442.304165:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774442.304169:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774442.304175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774442/real 1775774442] req@ffff8de1d0f2e300 x1862023612528384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774442.304180:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612528896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774442.304208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612528384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774442.304217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774442.304222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774442.304225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612528384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774442.304246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774442.304263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774442.304271:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774442/real 1775774442] req@ffff8de1d0f2e680 x1862023612528512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774442.304279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612528512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774442.304284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774442.304286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774442.304288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774442.304292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774442.304302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774442.304307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774442/real 1775774442] req@ffff8de1d0f2ca80 x1862023612528640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774442.304314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612528640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774442.304318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774442.304320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774442.304321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774442.304324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774442.304333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774442.304337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774442/real 1775774442] req@ffff8de1d0f2c700 x1862023612528768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774442.304344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612528768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774442.304348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774442.304350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774442.304351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774442.304354:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774442.304363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774442.304367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774442/real 1775774442] req@ffff8de1d0f2f100 x1862023612528896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774442.304373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612528896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774442.304377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774442.304379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774442.304380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612528896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774443.263883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774444.287884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774445.311939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774446.335882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774447.359839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774447.423788:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774447.423797:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774447.423805:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774447.423814:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10419 00000100:00080000:2.0:1775774447.423824:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774447.423830:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774447.423862:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612529024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774447.423886:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774447.423889:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774447.423890:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774447.423893:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10419 00000100:00080000:2.0:1775774447.423896:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774447.423899:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774447.423907:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774447.423916:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612529152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774447.423922:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612529024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774447.423926:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774447.423929:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774447.423930:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774447.423933:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10419 00000100:00080000:2.0:1775774447.423937:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774447.423941:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774447.423946:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774447.423958:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612529280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774447.423966:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774447.423970:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:0.0:1775774447.423974:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774447.423974:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774447.423981:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10419 00000100:00080000:2.0:1775774447.423986:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774447.423990:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774447.423995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774447.424004:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774447/real 1775774447] req@ffff8de1d0f2df80 x1862023612529024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774447.424007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612529408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774447.424029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774447.424031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774447.424032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774447.424035:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612529024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774447.424036:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10419 00000100:00080000:2.0:1775774447.424041:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774447.424047:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775774447.424051:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:2.0:1775774447.424052:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774447.424071:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774447.424075:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612529024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774447.424092:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774447.424092:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612529536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774447.424114:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774447.424125:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774447/real 1775774447] req@ffff8de1d0f2d500 x1862023612529152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774447.424133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612529152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774447.424138:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774447.424140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774447.424142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774447.424145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774447.424155:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774447.424160:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774447/real 1775774447] req@ffff8de1d0f2f100 x1862023612529280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774447.424166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612529280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774447.424170:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774447.424172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774447.424173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774447.424176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774447.424184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774447.424189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774447/real 1775774447] req@ffff8de1d0f2c700 x1862023612529408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774447.424194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612529408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774447.424199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774447.424201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774447.424202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774447.424211:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774447.424224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774447.424232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774447/real 1775774447] req@ffff8de1d0f2ca80 x1862023612529536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774447.424243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612529536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774447.424250:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774447.424253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774447.424255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774448.383849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774449.407871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774450.431839:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774451.455905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774452.479867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774452.543846:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774452.543855:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774452.543859:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774452.543867:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10424 00000100:00080000:0.0:1775774452.543879:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774452.543886:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774452.543920:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612529664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774452.543946:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774452.543949:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774452.543950:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774452.543953:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10424 00000100:00080000:0.0:1775774452.543955:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774452.543958:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774452.543974:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774452.543990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612529664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774452.543992:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612529792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774452.544005:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774452.544009:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774452.544011:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774452.544015:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10424 00000100:00080000:0.0:1775774452.544019:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774452.544023:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774452.544028:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774452.544036:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612529920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774452.544043:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774452.544045:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774452.544048:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774452.544049:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774452.544053:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10424 00000100:00080000:0.0:1775774452.544056:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774452.544060:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774452.544063:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774452.544071:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612530048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774452.544074:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774452/real 1775774452] req@ffff8de1c5682680 x1862023612529664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774452.544083:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774452.544090:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774452.544092:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774452.544095:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10424 00000100:00080000:0.0:1775774452.544097:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774452.544100:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612529664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774452.544103:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774452.544108:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775774452.544115:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775774452.544118:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612530176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774452.544120:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774452.544127:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612529664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774452.544146:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774452.544161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774452.544168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774452/real 1775774452] req@ffff8de1c5682d80 x1862023612529792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774452.544175:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612529792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774452.544188:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774452.544191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774452.544194:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774452.544200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774452.544217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774452.544226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774452/real 1775774452] req@ffff8de1c5680700 x1862023612529920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774452.544236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612529920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774452.544242:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774452.544245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774452.544248:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612529920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774452.544253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774452.544267:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774452.544275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774452/real 1775774452] req@ffff8de1c5682300 x1862023612530048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774452.544284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612530048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774452.544290:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774452.544292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774452.544295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774452.544300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774452.544313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774452.544320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774452/real 1775774452] req@ffff8de1c5683b80 x1862023612530176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774452.544329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612530176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774452.544336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774452.544339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774452.544342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774453.503875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774454.527852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774455.551877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774456.575840:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774457.599905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774457.663788:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774457.663797:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774457.663802:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774457.663811:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10429 00000100:00080000:0.0:1775774457.663823:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774457.663830:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774457.663867:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612530304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774457.663904:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774457.663907:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774457.663908:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774457.663912:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10429 00000100:00080000:0.0:1775774457.663915:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774457.663918:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774457.663927:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774457.663937:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612530432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774457.663945:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612530304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774457.663947:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774457.663953:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774457.663955:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774457.663958:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10429 00000100:00080000:0.0:1775774457.663960:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774457.663962:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774457.663966:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774457.663973:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612530560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774457.663980:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774457.663982:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774457.663983:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774457.663986:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10429 00000100:00080000:0.0:1775774457.663988:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774457.663991:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774457.663995:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774457.664000:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612530688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774457.664006:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774457.664008:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774457.664009:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774457.664015:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10429 00000800:00000100:1.0:1775774457.664016:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774457.664020:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774457.664023:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774457.664027:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774457.664035:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612530816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774457.664052:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774457/real 1775774457] req@ffff8de1c5681c00 x1862023612530304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774457.664068:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612530304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774457.664076:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774457.664078:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774457.664081:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612530304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774457.664099:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774457.664114:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774457.664122:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774457/real 1775774457] req@ffff8de1c5681f80 x1862023612530432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774457.664130:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612530432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774457.664135:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774457.664137:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774457.664140:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774457.664143:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774457.664152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774457.664157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774457/real 1775774457] req@ffff8de1c5682a00 x1862023612530560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774457.664164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612530560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774457.664169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774457.664171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774457.664180:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774457.664184:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774457.664195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774457.664201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774457/real 1775774457] req@ffff8de1c5680380 x1862023612530688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774457.664208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612530688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774457.664214:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774457.664216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774457.664218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774457.664221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774457.664231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774457.664235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774457/real 1775774457] req@ffff8de1c5680000 x1862023612530816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774457.664248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612530816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774457.664254:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774457.664256:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774457.664258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612530816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774458.623944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774459.647831:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774460.671906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774461.695889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774462.719891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774462.783836:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774462.783852:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774462.783857:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774462.783867:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10434 00000100:00080000:3.0:1775774462.783879:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774462.783885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774462.783916:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612530944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774462.783941:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774462.783944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774462.783945:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774462.783948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10434 00000100:00080000:3.0:1775774462.783951:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774462.783953:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774462.783960:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774462.783972:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612531072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774462.783979:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774462.783981:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774462.783982:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774462.783985:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10434 00000100:00080000:3.0:1775774462.783987:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774462.783989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774462.783994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612530944:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774462.783995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774462.784005:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612531200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774462.784011:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774462.784014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774462.784015:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774462.784018:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10434 00000100:00080000:3.0:1775774462.784020:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774462.784022:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774462.784026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774462.784033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612531328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774462.784043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774462.784046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774462.784047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774462.784049:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10434 00000100:00080000:3.0:1775774462.784051:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774462.784054:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775774462.784059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775774462.784060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774462.784069:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612531456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774462.784091:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774462/real 1775774462] req@ffff8de1c7af4a80 x1862023612530944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774462.784107:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612530944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774462.784114:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774462.784117:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774462.784120:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612530944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774462.784126:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774462.784141:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774462.784150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774462/real 1775774462] req@ffff8de1c7af6d80 x1862023612531072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774462.784162:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612531072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774462.784171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774462.784174:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774462.784177:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774462.784202:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774462.784225:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774462.784238:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774462/real 1775774462] req@ffff8de1c7af7b80 x1862023612531200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774462.784251:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612531200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774462.784260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774462.784263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774462.784266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774462.784273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774462.784294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774462.784305:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774462/real 1775774462] req@ffff8de1c7af4e00 x1862023612531328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774462.784318:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612531328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774462.784327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774462.784330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774462.784333:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774462.784340:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774462.784361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774462.784373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774462/real 1775774462] req@ffff8de1c7af4380 x1862023612531456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774462.784386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612531456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774462.784395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774462.784399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774462.784402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774463.743887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774464.767893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774465.791906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774466.815889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774467.839895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774467.903822:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774467.903829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774467.903832:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774467.903841:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10439 00000100:00080000:3.0:1775774467.903851:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774467.903856:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774467.903893:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612531584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774467.903919:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774467.903922:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774467.903923:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774467.903927:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10439 00000100:00080000:3.0:1775774467.903929:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774467.903931:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774467.903939:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774467.903949:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612531712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774467.903957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774467.903960:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774467.903961:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774467.903964:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10439 00000100:00080000:3.0:1775774467.903967:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774467.903972:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774467.903973:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612531584:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774467.903975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774467.903985:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612531840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774467.903991:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774467.903993:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774467.903995:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774467.903997:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10439 00000100:00080000:3.0:1775774467.904000:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774467.904002:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774467.904005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774467.904013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612531968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774467.904019:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774467.904021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774467.904023:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774467.904025:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10439 00000100:00080000:3.0:1775774467.904028:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774467.904031:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774467.904033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774467.904040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612532096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774467.904076:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774467.904109:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774467.904135:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774467.904157:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774468.863889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774469.887880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774470.911852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775774470.975972:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775774470.976007:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775774470.976021:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774470.976053:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774470.976062:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774470.976070:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774470.976078:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775774470.976113:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774467/real 1775774470] req@ffff8de1c7af5500 x1862023612531840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774470.976139:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612531840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774470.976150:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774470.976156:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774470.976160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774470.976168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774467/real 1775774470] req@ffff8de1c7af7480 x1862023612531968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774470.976180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612531968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774470.976187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774470.976191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774470.976194:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774470.976200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774467/real 1775774470] req@ffff8de1c7af4000 x1862023612532096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774470.976212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612532096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774470.976220:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774470.976224:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774470.976227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532096:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774470.976234:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774467/real 1775774470] req@ffff8de1c7af6300 x1862023612531584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774470.976247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612531584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774470.976255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774470.976259:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774470.976262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612531584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774470.976268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774467/real 1775774470] req@ffff8de1c7af5c00 x1862023612531712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774470.976279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612531712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774470.976286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774470.976290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774470.976293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612531712:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775774471.935839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774472.959855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774473.023847:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774473.023855:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774473.023860:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774473.023878:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10444 00000100:00080000:3.0:1775774473.023889:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774473.023895:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774473.023928:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612532224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774473.023962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774473.023966:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774473.023968:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774473.023973:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10444 00000100:00080000:3.0:1775774473.023977:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774473.023982:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774473.023992:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774473.023995:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612532224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774473.024009:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612532352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774473.024021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774473.024025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774473.024027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774473.024032:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10444 00000100:00080000:3.0:1775774473.024047:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774473.024053:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774473.024059:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775774473.024066:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774473.024077:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612532480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774473.024088:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774473.024093:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774473.024095:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774473.024100:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10444 00000100:00080000:3.0:1775774473.024106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774473.024111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774473.024115:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774473/real 1775774473] req@ffff8de1c7af4700 x1862023612532224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775774473.024117:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774473.024133:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612532608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774473.024144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612532224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774473.024145:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774473.024155:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774473.024159:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774473.024169:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10444 00000100:00080000:3.0:1775774473.024179:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774473.024180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774473.024185:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:2.0:1775774473.024187:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774473.024195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612532224:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774473.024195:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774473.024213:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612532736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774473.024232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774473.024266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774473.024281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774473/real 1775774473] req@ffff8de1c7af6680 x1862023612532352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774473.024293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612532352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774473.024302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774473.024322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774473.024326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774473.024332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774473.024354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774473.024366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774473/real 1775774473] req@ffff8de1c7af6a00 x1862023612532480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774473.024378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612532480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774473.024387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774473.024391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774473.024394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774473.024403:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774473.024427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774473.024438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774473/real 1775774473] req@ffff8de1c7af5c00 x1862023612532608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774473.024451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612532608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774473.024459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774473.024462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774473.024465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774473.024472:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774473.024493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774473.024504:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774473/real 1775774473] req@ffff8de1c7af6300 x1862023612532736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774473.024517:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612532736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774473.024525:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774473.024529:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774473.024532:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774473.983841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774475.007821:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774476.031855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774477.055857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774478.079871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774478.143831:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774478.143842:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774478.143847:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774478.143859:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10449 00000100:00080000:3.0:1775774478.143872:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774478.143879:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774478.143924:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612532864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774478.143952:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774478.143955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774478.143957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774478.143960:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10449 00000100:00080000:3.0:1775774478.143962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774478.143965:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774478.143975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774478.143988:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612532992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774478.143996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774478.143999:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774478.144000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774478.144003:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10449 00000100:00080000:3.0:1775774478.144004:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774478.144007:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774478.144010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774478.144016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612533120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774478.144024:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774478.144028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774478.144029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774478.144036:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10449 00000100:00080000:3.0:1775774478.144040:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774478.144044:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612532864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774478.144044:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774478.144056:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774478.144074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612533248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774478.144082:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774478.144084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774478.144085:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774478.144089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10449 00000100:00080000:3.0:1775774478.144092:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774478.144101:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774478.144106:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774478.144113:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612533376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774478.144131:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774478.144184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774478/real 1775774478] req@ffff8de1c7af4000 x1862023612532864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774478.144205:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612532864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774478.144217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774478.144222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774478.144227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612532864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774478.144233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774478.144256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774478.144270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774478/real 1775774478] req@ffff8de1c7af7480 x1862023612532992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774478.144284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612532992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774478.144293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774478.144297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774478.144310:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612532992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774478.144338:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774478.144361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774478.144373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774478/real 1775774478] req@ffff8de1c7af5500 x1862023612533120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774478.144394:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612533120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774478.144403:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774478.144407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774478.144410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774478.144417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774478.144440:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774478.144452:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774478/real 1775774478] req@ffff8de1c7af4380 x1862023612533248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774478.144465:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612533248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774478.144470:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774478.144473:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774478.144475:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774478.144479:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774478.144494:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774478.144500:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774478/real 1775774478] req@ffff8de1c7af4e00 x1862023612533376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774478.144507:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612533376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774478.144516:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774478.144519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774478.144543:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774479.103930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774480.127932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774481.151899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774482.175878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774483.199851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774483.263809:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774483.263817:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774483.263822:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774483.263830:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10455 00000100:00080000:3.0:1775774483.263840:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774483.263845:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774483.263877:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612533504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774483.263900:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774483.263902:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774483.263904:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774483.263907:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10455 00000100:00080000:3.0:1775774483.263909:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774483.263911:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774483.263918:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774483.263927:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612533632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774483.263935:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774483.263938:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774483.263939:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774483.263942:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10455 00000100:00080000:3.0:1775774483.263944:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774483.263946:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774483.263949:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774483.263956:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612533504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774483.263957:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612533760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774483.263969:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774483.263972:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774483.263973:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774483.263975:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10455 00000100:00080000:3.0:1775774483.263977:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774483.263979:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774483.263983:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774483.263991:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612533888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774483.263997:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774483.264000:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774483.264001:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774483.264003:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10455 00000100:00080000:3.0:1775774483.264009:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774483.264012:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774483.264015:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774483.264024:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774483.264042:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612534016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774483.264063:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774483/real 1775774483] req@ffff8de1c7af7b80 x1862023612533504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774483.264083:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612533504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774483.264095:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774483.264099:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774483.264103:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612533504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774483.264111:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774483.264131:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774483.264140:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774483/real 1775774483] req@ffff8de1c7af6d80 x1862023612533632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774483.264148:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612533632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774483.264157:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774483.264160:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774483.264162:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774483.264179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774483.264191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774483.264196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774483/real 1775774483] req@ffff8de1c7af4a80 x1862023612533760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774483.264203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612533760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774483.264208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774483.264210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774483.264212:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774483.264215:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774483.264232:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774483.264242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774483/real 1775774483] req@ffff8de1c7af5f80 x1862023612533888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774483.264255:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612533888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774483.264263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774483.264266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774483.264269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612533888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774483.264275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774483.264294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774483.264303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774483/real 1775774483] req@ffff8de1c7af5880 x1862023612534016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774483.264314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612534016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774483.264323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774483.264326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774483.264329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774484.223888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774485.247899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774486.271907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774487.295870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774488.319908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774488.383808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774488.383819:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774488.383824:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774488.383835:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10460 00000100:00080000:0.0:1775774488.383846:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774488.383853:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774488.383887:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612534144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774488.383914:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774488.383918:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774488.383920:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774488.383925:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10460 00000100:00080000:0.0:1775774488.383929:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774488.383933:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774488.383943:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774488.383959:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612534272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774488.383963:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612534144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774488.383976:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774488.383978:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774488.383980:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774488.383983:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10460 00000100:00080000:0.0:1775774488.383986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774488.383989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774488.383994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774488.384005:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612534400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774488.384012:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774488.384014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774488.384015:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774488.384019:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10460 00000100:00080000:0.0:1775774488.384021:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774488.384023:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774488.384027:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774488.384031:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774488.384037:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612534528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774488.384044:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774488.384046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774488.384047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774488.384050:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10460 00000100:00080000:0.0:1775774488.384052:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774488.384054:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774488.384058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774488.384069:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774488/real 1775774488] req@ffff8de1c5683480 x1862023612534144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774488.384070:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612534656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774488.384113:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612534144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774488.384125:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774488.384130:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774488.384134:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612534144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774488.384155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774488.384178:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774488.384189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774488/real 1775774488] req@ffff8de1c5681500 x1862023612534272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774488.384202:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612534272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774488.384212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774488.384215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774488.384219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774488.384224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774488.384240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774488.384249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774488/real 1775774488] req@ffff8de1c5681880 x1862023612534400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774488.384261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612534400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774488.384269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774488.384272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774488.384276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774488.384283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774488.384304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774488.384314:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774488/real 1775774488] req@ffff8de1c5680e00 x1862023612534528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774488.384334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612534528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774488.384362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774488.384366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774488.384370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774488.384376:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774488.384394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774488.384404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774488/real 1775774488] req@ffff8de1c5683800 x1862023612534656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774488.384417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612534656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774488.384426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774488.384429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774488.384432:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774489.343883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774490.367913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774491.391879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774492.415876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774493.439907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774493.503815:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774493.503827:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774493.503832:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774493.503843:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10465 00000100:00080000:0.0:1775774493.503855:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774493.503863:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774493.503911:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612534784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774493.503944:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774493.503947:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774493.503949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774493.503952:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10465 00000100:00080000:0.0:1775774493.503955:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774493.503958:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774493.503969:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774493.503978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612534912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774493.503987:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774493.503990:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774493.503992:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774493.503997:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612534784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774493.503998:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10465 00000100:00080000:0.0:1775774493.504003:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774493.504007:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774493.504010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774493.504017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612535040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774493.504023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774493.504026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774493.504027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774493.504030:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10465 00000100:00080000:0.0:1775774493.504032:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774493.504034:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774493.504039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774493.504045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612535168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774493.504052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774493.504054:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774493.504055:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774493.504063:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10465 00000100:00080000:0.0:1775774493.504066:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774493.504069:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774493.504073:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774493.504080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612535296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774493.504093:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774493.504133:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774493/real 1775774493] req@ffff8de1c5683800 x1862023612534784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774493.504156:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612534784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774493.504165:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774493.504168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774493.504172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612534784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774493.504194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774493.504210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774493.504218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774493/real 1775774493] req@ffff8de1c5680e00 x1862023612534912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774493.504226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612534912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774493.504232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774493.504234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774493.504236:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612534912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774493.504239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774493.504250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774493.504274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774493/real 1775774493] req@ffff8de1c5681880 x1862023612535040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774493.504283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612535040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774493.504294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774493.504296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774493.504298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774493.504302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774493.504316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774493.504322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774493/real 1775774493] req@ffff8de1c5681500 x1862023612535168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774493.504329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612535168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774493.504334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774493.504336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774493.504338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774493.504341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774493.504352:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774493.504357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774493/real 1775774493] req@ffff8de1c5683480 x1862023612535296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774493.504364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612535296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774493.504369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774493.504370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774493.504380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774494.463932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774495.487892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774496.511949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774497.535923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774498.559892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774498.623858:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774498.623866:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774498.623870:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774498.623878:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10470 00000100:00080000:1.0:1775774498.623896:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774498.623902:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774498.623937:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612535424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774498.623965:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774498.623967:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774498.623968:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774498.623971:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10470 00000100:00080000:1.0:1775774498.623973:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774498.623976:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774498.623984:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774498.623993:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612535552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774498.623999:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774498.624002:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774498.624003:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774498.624006:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10470 00000100:00080000:1.0:1775774498.624008:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774498.624010:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774498.624013:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774498.624018:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612535680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774498.624025:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774498.624027:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774498.624028:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774498.624033:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10470 00000100:00080000:1.0:1775774498.624036:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774498.624039:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774498.624042:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774498.624049:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612535808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774498.624056:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774498.624059:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774498.624061:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774498.624068:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10470 00000100:00080000:1.0:1775774498.624071:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774498.624073:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612535424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774498.624076:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774498.624082:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774498.624090:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612535936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774498.624203:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774498.624254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774498/real 1775774498] req@ffff8de1c2e14e00 x1862023612535424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774498.624277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612535424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774498.624290:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774498.624297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774498.624301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612535424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774498.624311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774498.624338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774498.624352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774498/real 1775774498] req@ffff8de1c2e14a80 x1862023612535552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774498.624366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612535552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774498.624375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774498.624379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774498.624383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774498.624390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774498.624411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774498.624423:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774498/real 1775774498] req@ffff8de1c2e17480 x1862023612535680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774498.624436:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612535680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774498.624445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774498.624449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774498.624452:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774498.624486:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774498.624508:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774498.624520:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774498/real 1775774498] req@ffff8de1c2e14700 x1862023612535808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774498.624533:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612535808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774498.624542:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774498.624545:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774498.624549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774498.624555:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774498.624575:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774498.624586:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774498/real 1775774498] req@ffff8de1c2e15500 x1862023612535936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774498.624605:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612535936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774498.624613:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774498.624617:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774498.624620:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612535936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774499.583892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774500.607857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774501.631935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774502.655880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774503.679973:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774503.743845:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774503.743856:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774503.743860:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774503.743870:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10475 00000100:00080000:0.0:1775774503.743882:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774503.743889:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774503.743928:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612536064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774503.743959:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774503.743963:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774503.743965:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774503.743969:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10475 00000100:00080000:0.0:1775774503.743974:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774503.743978:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774503.743988:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774503.744004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612536064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774503.744005:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612536192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774503.744021:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774503.744025:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774503.744027:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774503.744031:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10475 00000100:00080000:0.0:1775774503.744035:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774503.744039:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774503.744046:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774503.744058:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612536320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774503.744067:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774503.744093:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774503.744098:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774503.744100:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774503.744106:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10475 00000100:00080000:0.0:1775774503.744111:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774503.744116:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774503.744120:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774503/real 1775774503] req@ffff8de1c5680000 x1862023612536064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775774503.744124:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774503.744140:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612536064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774503.744145:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612536448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774503.744152:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774503.744160:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774503.744166:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612536064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774503.744180:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774503.744183:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774503.744186:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774503.744190:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10475 00000100:00080000:0.0:1775774503.744196:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774503.744197:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536192:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775774503.744203:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774503.744210:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774503.744224:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612536576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774503.744233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774503.744251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774503/real 1775774503] req@ffff8de1c5680380 x1862023612536192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774503.744276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612536192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774503.744285:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774503.744289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774503.744293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774503.744299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774503.744321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774503.744332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774503/real 1775774503] req@ffff8de1c5682a00 x1862023612536320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774503.744346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612536320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774503.744353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774503.744357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774503.744360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774503.744366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774503.744387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774503.744399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774503/real 1775774503] req@ffff8de1c5681f80 x1862023612536448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774503.744412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612536448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774503.744427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774503.744431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774503.744435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774503.744455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774503.744471:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774503.744479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774503/real 1775774503] req@ffff8de1c5681c00 x1862023612536576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774503.744487:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612536576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774503.744492:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774503.744495:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774503.744497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774504.703913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774505.727876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774506.751857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774507.775863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774508.799926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774508.863940:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774508.863947:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774508.863951:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774508.863960:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10480 00000100:00080000:0.0:1775774508.863970:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774508.863976:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774508.864025:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612536704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774508.864051:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774508.864054:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774508.864056:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774508.864059:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10480 00000100:00080000:0.0:1775774508.864063:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774508.864066:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774508.864075:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774508.864086:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612536832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774508.864095:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774508.864098:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774508.864099:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774508.864103:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10480 00000100:00080000:0.0:1775774508.864106:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774508.864110:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774508.864114:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612536704:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774508.864116:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774508.864127:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612536960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774508.864135:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774508.864137:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774508.864138:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774508.864141:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10480 00000100:00080000:0.0:1775774508.864143:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774508.864146:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774508.864149:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774508.864156:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612537088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774508.864161:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774508.864163:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774508.864165:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774508.864167:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10480 00000100:00080000:0.0:1775774508.864170:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774508.864173:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774508.864175:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774508.864183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774508.864184:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612537216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774508.864292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774508/real 1775774508] req@ffff8de1c5683b80 x1862023612536704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774508.864314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612536704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774508.864327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774508.864332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774508.864339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612536704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774508.864349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774508.864505:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774508.864520:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774508/real 1775774508] req@ffff8de1c5682300 x1862023612536832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774508.864601:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612536832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774508.864612:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774508.864616:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774508.864619:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774508.864644:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774508.864668:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774508.864680:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774508/real 1775774508] req@ffff8de1c5680700 x1862023612536960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774508.864693:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612536960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774508.864702:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774508.864705:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774508.864709:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612536960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774508.864716:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774508.864793:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774508.864807:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774508/real 1775774508] req@ffff8de1c5682d80 x1862023612537088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774508.864819:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612537088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774508.864828:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774508.864831:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774508.864834:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774508.864841:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774508.864860:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774508.864870:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774508/real 1775774508] req@ffff8de1c5682680 x1862023612537216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774508.864881:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612537216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774508.864889:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774508.864892:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774508.864896:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774509.823869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774510.847845:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774511.871906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774512.895880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774513.919895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774513.983840:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774513.983848:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774513.983852:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774513.983859:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10485 00000100:00080000:1.0:1775774513.983869:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774513.983875:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774513.983919:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612537344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774513.983940:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774513.983943:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774513.983945:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774513.983948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10485 00000100:00080000:1.0:1775774513.983951:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774513.983955:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774513.983963:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774513.983975:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612537472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774513.983975:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612537344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774513.983989:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774513.983991:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774513.983992:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774513.983995:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10485 00000100:00080000:1.0:1775774513.983998:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774513.984000:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774513.984003:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774513.984011:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612537600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774513.984018:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774513.984020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774513.984021:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774513.984024:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10485 00000100:00080000:1.0:1775774513.984029:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774513.984032:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774513.984035:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774513.984039:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774513.984045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612537728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774513.984052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774513.984055:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774513.984056:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774513.984058:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10485 00000100:00080000:1.0:1775774513.984061:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774513.984064:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774513.984067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774513.984071:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774513/real 1775774513] req@ffff8de1c2e17800 x1862023612537344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774513.984075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612537856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774513.984112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612537344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774513.984120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774513.984124:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774513.984127:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612537344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774513.984144:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774513.984159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774513.984167:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774513/real 1775774513] req@ffff8de1c2e16a00 x1862023612537472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774513.984174:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612537472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774513.984180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774513.984182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774513.984184:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774513.984187:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774513.984207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774513.984213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774513/real 1775774513] req@ffff8de1c2e16680 x1862023612537600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774513.984221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612537600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774513.984230:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774513.984232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774513.984234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774513.984238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774513.984247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774513.984252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774513/real 1775774513] req@ffff8de1c2e14380 x1862023612537728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774513.984259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612537728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774513.984264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774513.984266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774513.984274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774513.984278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774513.984292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774513.984298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774513/real 1775774513] req@ffff8de1c2e17100 x1862023612537856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774513.984305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612537856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774513.984310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774513.984312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774513.984315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612537856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774514.943836:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774515.967884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774516.991920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774518.015921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774519.039931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774519.103838:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774519.103848:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774519.103853:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774519.103862:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10490 00000100:00080000:1.0:1775774519.103874:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774519.103882:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774519.103920:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612537984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774519.103958:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774519.103960:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774519.103962:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774519.103965:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10490 00000100:00080000:1.0:1775774519.103969:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774519.103971:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774519.103980:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774519.103992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612538112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774519.104000:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774519.104002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774519.104003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774519.104007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10490 00000100:00080000:1.0:1775774519.104009:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774519.104012:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774519.104015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774519.104021:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612538240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774519.104029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774519.104031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774519.104032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774519.104036:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10490 00000100:00080000:1.0:1775774519.104038:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774519.104043:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774519.104047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774519.104048:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612537984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774519.104056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612538368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774519.104073:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774519.104077:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774519.104079:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774519.104086:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10490 00000100:00080000:1.0:1775774519.104090:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774519.104094:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774519.104100:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774519.104114:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612538496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774519.104142:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774519.104183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774519/real 1775774519] req@ffff8de1c2e17b80 x1862023612537984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774519.104200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612537984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774519.104209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774519.104213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774519.104217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612537984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774519.104223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774519.104239:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774519.104248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774519/real 1775774519] req@ffff8de1c2e17100 x1862023612538112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774519.104256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612538112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774519.104261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774519.104263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774519.104265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774519.104292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774519.104303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774519.104309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774519/real 1775774519] req@ffff8de1c2e14380 x1862023612538240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774519.104317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612538240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774519.104322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774519.104323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774519.104325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774519.104330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774519.104340:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774519.104346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774519/real 1775774519] req@ffff8de1c2e16680 x1862023612538368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774519.104353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612538368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774519.104358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774519.104360:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774519.104362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774519.104365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774519.104375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774519.104380:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774519/real 1775774519] req@ffff8de1c2e16a00 x1862023612538496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774519.104388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612538496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774519.104395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774519.104399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774519.104402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774520.063879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774521.087949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774522.111872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774523.135917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774524.159842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774524.223859:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774524.223866:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774524.223870:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774524.223878:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10495 00000100:00080000:0.0:1775774524.223888:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774524.223895:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774524.223929:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612538624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774524.223953:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774524.223955:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774524.223957:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774524.223960:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10495 00000100:00080000:0.0:1775774524.223962:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774524.223964:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774524.223971:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774524.223979:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612538752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774524.223991:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774524.223994:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774524.223995:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774524.223998:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10495 00000100:00080000:0.0:1775774524.224000:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774524.224003:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774524.224006:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774524.224013:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612538880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774524.224020:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774524.224024:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1775774524.224025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612538624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774524.224026:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774524.224033:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10495 00000100:00080000:0.0:1775774524.224034:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774524.224037:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774524.224040:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774524.224047:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612539008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774524.224053:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774524.224056:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774524.224057:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774524.224059:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10495 00000100:00080000:0.0:1775774524.224064:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774524.224066:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774524.224069:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774524.224076:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612539136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774524.224087:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774524.224119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774524/real 1775774524] req@ffff8de1c5682680 x1862023612538624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774524.224133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612538624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774524.224140:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774524.224143:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774524.224146:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612538624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774524.224151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774524.224164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774524.224171:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774524/real 1775774524] req@ffff8de1c5682d80 x1862023612538752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774524.224179:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612538752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774524.224184:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774524.224186:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774524.224189:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774524.224207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774524.224217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774524.224223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774524/real 1775774524] req@ffff8de1c5680700 x1862023612538880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774524.224230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612538880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774524.224234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774524.224236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774524.224238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612538880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774524.224242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774524.224251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774524.224256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774524/real 1775774524] req@ffff8de1c5682300 x1862023612539008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774524.224263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612539008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774524.224268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774524.224270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774524.224274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774524.224279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774524.224297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774524.224307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774524/real 1775774524] req@ffff8de1c5683b80 x1862023612539136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774524.224320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612539136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774524.224329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774524.224332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774524.224335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774525.183875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774526.207967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774527.231911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774528.255880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774529.279895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774529.343852:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774529.343861:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774529.343865:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774529.343874:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10501 00000100:00080000:3.0:1775774529.343885:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774529.343891:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774529.343925:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612539264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774529.343949:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774529.343952:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774529.343953:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774529.343957:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10501 00000100:00080000:3.0:1775774529.343959:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774529.343961:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774529.343969:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774529.343978:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612539392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774529.343986:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774529.343989:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774529.343990:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774529.343994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612539264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774529.343996:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10501 00000100:00080000:3.0:1775774529.344001:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774529.344004:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774529.344008:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774529.344020:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612539520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774529.344030:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774529.344034:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774529.344036:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774529.344040:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10501 00000100:00080000:3.0:1775774529.344045:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774529.344049:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774529.344055:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774529.344059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774529.344069:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612539648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774529.344077:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774529.344079:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774529.344081:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774529.344084:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10501 00000100:00080000:3.0:1775774529.344087:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774529.344090:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774529.344094:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774529/real 1775774529] req@ffff8de1c7af5180 x1862023612539264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775774529.344096:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774529.344108:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612539776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774529.344115:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612539264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774529.344124:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774529.344128:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774529.344131:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612539264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774529.344152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774529.344167:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774529.344175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774529/real 1775774529] req@ffff8de1c7af7100 x1862023612539392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774529.344182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612539392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774529.344187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774529.344189:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774529.344191:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774529.344195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774529.344204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774529.344209:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774529/real 1775774529] req@ffff8de1c7af7800 x1862023612539520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774529.344228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612539520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774529.344235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774529.344239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774529.344242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774529.344248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774529.344269:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774529.344279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774529/real 1775774529] req@ffff8de1c7af5880 x1862023612539648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774529.344289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612539648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774529.344294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774529.344297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774529.344299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774529.344302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774529.344316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774529.344322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774529/real 1775774529] req@ffff8de1c7af5f80 x1862023612539776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774529.344329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612539776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774529.344338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774529.344340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774529.344352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612539776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774530.303879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774531.327892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774532.351861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774533.375933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774534.399855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774534.463805:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774534.463815:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774534.463820:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774534.463832:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10506 00000100:00080000:3.0:1775774534.463844:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774534.463851:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774534.463889:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612539904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774534.463923:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774534.463928:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774534.463930:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774534.463934:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10506 00000100:00080000:3.0:1775774534.463939:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774534.463944:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774534.463955:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774534.463966:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612539904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774534.463971:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612540032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774534.463980:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774534.463983:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774534.463984:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774534.463988:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10506 00000100:00080000:3.0:1775774534.463991:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774534.463994:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774534.463997:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774534.464005:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612540160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774534.464012:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774534.464015:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774534.464016:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774534.464018:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10506 00000100:00080000:3.0:1775774534.464020:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774534.464023:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774534.464026:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774534.464032:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612540288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774534.464043:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774534.464046:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774534.464047:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774534.464050:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10506 00000100:00080000:3.0:1775774534.464051:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774534.464053:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774534.464057:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774534.464059:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774534.464067:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612540416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774534.464087:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774534.464106:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774534.464122:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774535.423857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774536.447857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774537.471829:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775774537.535993:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775774537.536031:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775774537.536049:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774537.536118:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774537.536128:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774537.536137:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774537.536148:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775774537.536239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774534/real 1775774537] req@ffff8de1c7af4380 x1862023612540416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774537.536266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612540416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774537.536279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774537.536285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774537.536289:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540416:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774537.536297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774534/real 1775774537] req@ffff8de1c7af6d80 x1862023612540032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774537.536312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612540032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774537.536320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774537.536324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774537.536329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774537.536336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774534/real 1775774537] req@ffff8de1c7af7b80 x1862023612540160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774537.536347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612540160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774537.536354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774537.536357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774537.536360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774537.536366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774534/real 1775774537] req@ffff8de1c7af4e00 x1862023612540288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774537.536378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612540288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774537.536386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774537.536390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774537.536394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774537.536401:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774534/real 1775774537] req@ffff8de1c7af4a80 x1862023612539904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774537.536415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612539904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774537.536430:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774537.536434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774537.536438:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612539904:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775774538.495905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774539.519833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774539.583819:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774539.583829:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774539.583834:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774539.583844:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10511 00000100:00080000:3.0:1775774539.583855:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774539.583863:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774539.583894:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612540544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774539.583917:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774539.583920:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774539.583922:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774539.583925:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10511 00000100:00080000:3.0:1775774539.583928:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774539.583931:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774539.583940:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774539.583950:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612540672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774539.583960:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774539.583962:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774539.583963:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774539.583969:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10511 00000100:00100000:2.0:1775774539.583971:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612540544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774539.583971:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774539.583978:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774539.583985:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774539.583996:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612540800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774539.584007:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774539.584010:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774539.584012:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774539.584017:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10511 00000100:00080000:3.0:1775774539.584029:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774539.584033:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775774539.584040:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775774539.584040:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774539.584058:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612540928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774539.584070:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774539.584074:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774539.584077:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775774539.584078:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774539/real 1775774539] req@ffff8de1c7af5500 x1862023612540544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774539.584084:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10511 00000100:00080000:3.0:1775774539.584092:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774539.584098:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774539.584104:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774539.584105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612540544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774539.584118:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612541056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774539.584120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774539.584129:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774539.584137:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612540544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774539.584164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774539.584185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774539.584196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774539/real 1775774539] req@ffff8de1c7af7480 x1862023612540672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774539.584209:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612540672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774539.584241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774539.584245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774539.584249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774539.584256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774539.584275:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774539.584285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774539/real 1775774539] req@ffff8de1c7af4000 x1862023612540800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774539.584298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612540800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774539.584307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774539.584311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774539.584314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774539.584320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774539.584335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774539.584343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774539/real 1775774539] req@ffff8de1c7af6300 x1862023612540928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774539.584354:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612540928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774539.584362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774539.584365:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774539.584369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612540928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774539.584375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774539.584390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774539.584398:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774539/real 1775774539] req@ffff8de1c7af5c00 x1862023612541056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774539.584409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612541056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774539.584418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774539.584421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774539.584424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774540.543823:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774541.567833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774542.591904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774543.615892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774544.639912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774544.703807:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774544.703817:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774544.703822:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774544.703833:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10516 00000100:00080000:3.0:1775774544.703846:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774544.703854:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774544.703897:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612541184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774544.703924:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774544.703928:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774544.703929:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774544.703933:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10516 00000100:00080000:3.0:1775774544.703935:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774544.703938:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774544.703947:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774544.703959:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612541312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774544.703973:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774544.703975:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774544.703977:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774544.703980:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10516 00000100:00080000:3.0:1775774544.703982:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774544.703986:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774544.703989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612541184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774544.703990:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774544.704001:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612541440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774544.704008:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774544.704011:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774544.704012:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774544.704015:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10516 00000100:00080000:3.0:1775774544.704017:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774544.704020:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774544.704023:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774544.704031:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612541568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774544.704037:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774544.704039:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774544.704040:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774544.704043:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10516 00000100:00080000:3.0:1775774544.704060:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774544.704064:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774544.704067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774544.704076:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612541696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774544.704080:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774544.704121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774544/real 1775774544] req@ffff8de1c7af6a00 x1862023612541184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774544.704139:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612541184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774544.704148:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774544.704152:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774544.704155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612541184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774544.704163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774544.704180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774544.704191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774544/real 1775774544] req@ffff8de1c7af6680 x1862023612541312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774544.704199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612541312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774544.704205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774544.704208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774544.704210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774544.704235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774544.704250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774544.704256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774544/real 1775774544] req@ffff8de1c7af4700 x1862023612541440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774544.704265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612541440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774544.704270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774544.704273:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774544.704275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774544.704279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774544.704291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774544.704296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774544/real 1775774544] req@ffff8de1c7af5c00 x1862023612541568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774544.704307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612541568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774544.704312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774544.704315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774544.704317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774544.704320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774544.704334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774544.704341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774544/real 1775774544] req@ffff8de1c7af6300 x1862023612541696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774544.704350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612541696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774544.704357:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774544.704377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774544.704380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774545.664039:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774546.687916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774547.711923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774548.735928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774549.759899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774549.823861:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774549.823870:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774549.823874:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774549.823883:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10521 00000100:00080000:3.0:1775774549.823893:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774549.823899:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774549.823931:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612541824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774549.823967:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774549.823970:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774549.823971:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774549.823974:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10521 00000100:00080000:3.0:1775774549.823977:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774549.823979:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774549.823986:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774549.823996:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612541952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774549.824004:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774549.824007:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774549.824009:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774549.824012:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10521 00000100:00080000:3.0:1775774549.824015:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774549.824019:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774549.824022:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774549.824036:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612542080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774549.824039:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612541824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774549.824067:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774549.824070:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774549.824071:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774549.824074:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10521 00000100:00080000:3.0:1775774549.824075:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774549.824078:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774549.824082:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774549.824092:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612542208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774549.824098:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774549.824100:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774549.824101:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774549.824104:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10521 00000100:00080000:3.0:1775774549.824106:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774549.824109:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774549.824114:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774549.824124:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612542336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774549.824151:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774549.824193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774549/real 1775774549] req@ffff8de1c7af4000 x1862023612541824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774549.824211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612541824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774549.824223:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774549.824229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774549.824234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612541824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774549.824244:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774549.824299:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774549.824316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774549/real 1775774549] req@ffff8de1c7af7480 x1862023612541952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774549.824332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612541952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774549.824366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774549.824370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774549.824373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612541952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774549.824400:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774549.824418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774549.824426:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774549/real 1775774549] req@ffff8de1c7af5500 x1862023612542080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774549.824451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612542080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774549.824457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774549.824460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774549.824462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774549.824468:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774549.824481:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774549.824488:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774549/real 1775774549] req@ffff8de1c7af4a80 x1862023612542208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774549.824496:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612542208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774549.824502:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774549.824504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774549.824506:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774549.824510:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774549.824521:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774549.824526:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774549/real 1775774549] req@ffff8de1c7af4e00 x1862023612542336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774549.824534:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612542336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774549.824539:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774549.824541:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774549.824543:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774550.783982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774551.807843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774552.831980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774553.855854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774554.879922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774554.943915:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774554.943928:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774554.943934:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774554.943948:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10526 00000100:00080000:2.0:1775774554.943963:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774554.943971:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774554.944017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612542464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774554.944052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774554.944056:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774554.944057:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774554.944061:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10526 00000100:00080000:2.0:1775774554.944064:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774554.944067:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774554.944077:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774554.944087:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612542592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774554.944095:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774554.944098:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774554.944100:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774554.944103:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10526 00000100:00080000:2.0:1775774554.944105:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774554.944108:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774554.944112:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774554.944122:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612542464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774554.944125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612542720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774554.944148:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774554.944151:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774554.944152:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774554.944156:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10526 00000100:00080000:2.0:1775774554.944158:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774554.944160:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774554.944164:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774554.944174:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612542848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774554.944203:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774554.944208:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774554.944210:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774554.944215:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10526 00000100:00080000:2.0:1775774554.944223:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774554.944228:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774554.944235:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774554.944242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774554.944253:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612542976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774554.944296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774554/real 1775774554] req@ffff8de1d0f2e680 x1862023612542464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774554.944319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612542464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774554.944332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774554.944337:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774554.944341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612542464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774554.944349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774554.944378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774554.944392:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774554/real 1775774554] req@ffff8de1d0f2e300 x1862023612542592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774554.944405:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612542592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774554.944414:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774554.944418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774554.944421:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774554.944447:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774554.944471:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774554.944483:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774554/real 1775774554] req@ffff8de1d0f2ca80 x1862023612542720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774554.944496:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612542720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774554.944505:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774554.944509:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774554.944512:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774554.944519:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774554.944542:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774554.944554:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774554/real 1775774554] req@ffff8de1d0f2c700 x1862023612542848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774554.944566:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612542848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774554.944575:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774554.944579:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774554.944582:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774554.944589:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774554.944611:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774554.944633:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774554/real 1775774554] req@ffff8de1d0f2f100 x1862023612542976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774554.944654:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612542976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774554.944663:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774554.944666:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774554.944670:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612542976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774555.903924:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774556.927943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774557.951917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774558.975877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774559.999885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774560.063821:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774560.063830:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774560.063834:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774560.063841:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10531 00000100:00080000:3.0:1775774560.063851:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774560.063857:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774560.063891:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612543104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774560.063914:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774560.063916:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774560.063918:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774560.063922:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10531 00000100:00080000:3.0:1775774560.063924:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774560.063927:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774560.063936:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774560.063946:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612543104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774560.063947:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612543232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774560.063966:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774560.063968:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774560.063969:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774560.063971:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10531 00000100:00080000:3.0:1775774560.063974:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774560.063976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774560.063980:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774560.063987:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612543360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774560.063993:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774560.063996:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774560.063997:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774560.063999:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10531 00000100:00080000:3.0:1775774560.064002:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774560.064004:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774560.064007:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774560.064012:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774560.064016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612543488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774560.064023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774560.064026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774560.064027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774560.064030:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10531 00000100:00080000:3.0:1775774560.064033:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774560.064035:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774560.064038:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774560.064048:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612543616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774560.064049:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774560/real 1775774560] req@ffff8de1c7af7b80 x1862023612543104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774560.064082:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612543104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774560.064105:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774560.064108:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774560.064111:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612543104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774560.064129:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774560.064145:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774560.064153:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774560/real 1775774560] req@ffff8de1c7af6d80 x1862023612543232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774560.064161:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612543232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774560.064166:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774560.064168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774560.064170:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774560.064174:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774560.064183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774560.064189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774560/real 1775774560] req@ffff8de1c7af4380 x1862023612543360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774560.064196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612543360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774560.064205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774560.064207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774560.064209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774560.064212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774560.064223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774560.064227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774560/real 1775774560] req@ffff8de1c7af5f80 x1862023612543488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774560.064234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612543488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774560.064239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774560.064241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774560.064242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774560.064246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774560.064254:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774560.064259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774560/real 1775774560] req@ffff8de1c7af5880 x1862023612543616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774560.064266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612543616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774560.064271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774560.064273:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774560.064275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774561.023855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774562.047887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774563.071873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774564.095925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774565.119954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774565.183831:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774565.183843:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774565.183848:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774565.183858:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10536 00000100:00080000:3.0:1775774565.183871:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774565.183879:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774565.183923:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612543744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774565.183951:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774565.183954:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774565.183956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774565.183959:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10536 00000100:00080000:3.0:1775774565.183962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774565.183964:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774565.183979:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774565.183992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612543872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774565.184013:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774565.184017:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774565.184019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774565.184022:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10536 00000100:00080000:3.0:1775774565.184026:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774565.184031:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612543744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774565.184031:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774565.184039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774565.184048:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612544000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774565.184056:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774565.184059:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774565.184061:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774565.184064:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10536 00000100:00080000:3.0:1775774565.184066:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774565.184068:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774565.184072:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774565.184080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612544128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774565.184085:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774565.184088:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774565.184089:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774565.184092:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10536 00000100:00080000:3.0:1775774565.184096:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774565.184098:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774565.184102:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774565.184109:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612544256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774565.184118:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774565.184164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774565/real 1775774565] req@ffff8de1c7af7800 x1862023612543744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774565.184186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612543744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774565.184197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774565.184202:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774565.184207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612543744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774565.184214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774565.184236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774565.184247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774565/real 1775774565] req@ffff8de1c7af7100 x1862023612543872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774565.184259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612543872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774565.184267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774565.184271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774565.184274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612543872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774565.184305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774565.184323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774565.184333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774565/real 1775774565] req@ffff8de1c7af5180 x1862023612544000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774565.184346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612544000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774565.184354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774565.184358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774565.184361:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774565.184367:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774565.184389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774565.184399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774565/real 1775774565] req@ffff8de1c7af5880 x1862023612544128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774565.184410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612544128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774565.184418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774565.184422:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774565.184425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774565.184430:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774565.184446:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774565.184455:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774565/real 1775774565] req@ffff8de1c7af5f80 x1862023612544256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774565.184467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612544256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774565.184475:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774565.184478:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774565.184481:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774566.143900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774567.167892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774568.191874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774569.215901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774570.239890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774570.303829:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774570.303840:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774570.303845:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774570.303856:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10542 00000100:00080000:3.0:1775774570.303867:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774570.303875:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774570.303936:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612544384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774570.303959:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774570.303962:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774570.303963:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774570.303967:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10542 00000100:00080000:3.0:1775774570.303970:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774570.303973:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774570.303980:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774570.303992:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612544512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774570.303999:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774570.304002:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774570.304003:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774570.304005:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10542 00000100:00080000:3.0:1775774570.304008:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774570.304012:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774570.304015:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612544384:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774570.304016:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774570.304025:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612544640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774570.304031:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774570.304034:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774570.304035:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774570.304037:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10542 00000100:00080000:3.0:1775774570.304039:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774570.304041:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774570.304044:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774570.304052:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612544768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774570.304058:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774570.304060:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774570.304062:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774570.304064:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10542 00000100:00080000:3.0:1775774570.304074:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774570.304075:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774570.304083:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774570.304087:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774570.304095:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612544896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774570.304110:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774570/real 1775774570] req@ffff8de1c7af4380 x1862023612544384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774570.304126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612544384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774570.304135:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774570.304139:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774570.304142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612544384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774570.304147:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774570.304162:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774570.304169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774570/real 1775774570] req@ffff8de1c7af6d80 x1862023612544512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774570.304177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612544512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774570.304183:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774570.304185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774570.304188:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774570.304206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774570.304216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774570.304222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774570/real 1775774570] req@ffff8de1c7af7b80 x1862023612544640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774570.304229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612544640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774570.304234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774570.304236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774570.304238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774570.304242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774570.304251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774570.304257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774570/real 1775774570] req@ffff8de1c7af4e00 x1862023612544768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774570.304264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612544768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774570.304269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774570.304280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774570.304283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774570.304287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774570.304298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774570.304304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774570/real 1775774570] req@ffff8de1c7af4a80 x1862023612544896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774570.304312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612544896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774570.304317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774570.304319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774570.304321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612544896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774571.263853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774572.287853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774573.311939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774574.335884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774575.359889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774575.423874:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774575.423884:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774575.423890:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774575.423900:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10547 00000100:00080000:3.0:1775774575.423911:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774575.423918:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774575.423967:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612545024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774575.423999:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774575.424003:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774575.424005:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774575.424010:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10547 00000100:00080000:3.0:1775774575.424014:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774575.424018:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774575.424028:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774575.424044:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612545152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774575.424049:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612545024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774575.424065:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774575.424068:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774575.424070:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774575.424075:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10547 00000100:00080000:3.0:1775774575.424078:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774575.424082:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774575.424089:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774575.424099:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612545280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774575.424110:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774575.424110:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774575.424116:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774575.424117:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774575.424123:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10547 00000100:00080000:3.0:1775774575.424128:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774575.424132:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774575.424139:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774575.424145:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774575/real 1775774575] req@ffff8de1c7af5500 x1862023612545024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774575.424152:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612545408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774575.424165:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612545024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774575.424166:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774575.424175:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774575.424180:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774575.424185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774575.424187:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10547 00000100:00080000:2.0:1775774575.424191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775774575.424193:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774575.424196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612545024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774575.424200:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774575.424210:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774575.424225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774575.424232:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612545536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774575.424245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774575.424258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774575/real 1775774575] req@ffff8de1c7af7480 x1862023612545152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774575.424272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612545152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774575.424281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774575.424285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774575.424288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774575.424295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774575.424316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774575.424327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774575/real 1775774575] req@ffff8de1c7af4000 x1862023612545280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774575.424336:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612545280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774575.424342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774575.424344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774575.424346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774575.424350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774575.424364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774575.424370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774575/real 1775774575] req@ffff8de1c7af6300 x1862023612545408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774575.424378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612545408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774575.424383:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774575.424384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774575.424386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774575.424397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774575.424408:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774575.424413:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774575/real 1775774575] req@ffff8de1c7af5c00 x1862023612545536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774575.424420:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612545536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774575.424425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774575.424427:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774575.424429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774576.383920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774577.407886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774578.431884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774579.455927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774580.479866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774580.543842:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774580.543853:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774580.543858:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774580.543869:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10552 00000100:00080000:3.0:1775774580.543880:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774580.543887:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774580.543924:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612545664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774580.543955:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774580.543960:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774580.543963:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774580.543969:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10552 00000100:00080000:3.0:1775774580.543974:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774580.543978:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774580.543988:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774580.543990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612545664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774580.544008:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612545792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774580.544032:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774580.544036:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774580.544039:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774580.544046:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10552 00000800:00000100:1.0:1775774580.544049:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774580.544054:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774580.544060:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774580.544067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774580.544082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774580/real 1775774580] req@ffff8de1c7af4700 x1862023612545664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774580.544085:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612545920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774580.544116:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612545664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774580.544141:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774580.544146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774580.544151:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612545664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774580.544175:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545792:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774580.544191:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774580.544195:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:1.0:1775774580.544199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774580.544199:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774580.544206:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10552 00000100:00100000:1.0:1775774580.544213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774580/real 1775774580] req@ffff8de1c7af6680 x1862023612545792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774580.544217:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774580.544227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612545792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774580.544234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774580.544236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774580.544238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774580.544246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774580.544258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774580.544264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774580/real 1775774580] req@ffff8de1c7af6a00 x1862023612545920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774580.544272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612545920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774580.544277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774580.544279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774580.544281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612545920:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774580.544342:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774580.544350:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774580.544413:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612546048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774580.544439:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774580.544443:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774580.544446:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774580.544451:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10552 00000100:00080000:3.0:1775774580.544458:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774580.544463:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546048:192.168.201.137@tcp:8:kworker.0 00000100:00080000:3.0:1775774580.544466:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774580.544477:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774580.544492:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612546176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774580.544501:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774580.544523:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774580/real 1775774580] req@ffff8de1c7af6a00 x1862023612546048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774580.544534:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612546048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774580.544544:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774580.544547:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774580.544549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774580.544558:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774580.544570:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774580.544577:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774580/real 1775774580] req@ffff8de1c7af6680 x1862023612546176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774580.544584:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612546176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774580.544589:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774580.544591:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774580.544593:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774581.503975:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774582.527983:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774583.551891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774584.575959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774585.599895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774585.663782:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774585.663789:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774585.663792:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774585.663800:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10557 00000100:00080000:3.0:1775774585.663809:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774585.663815:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774585.663848:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612546304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774585.663870:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774585.663873:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774585.663874:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774585.663877:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10557 00000100:00080000:3.0:1775774585.663880:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774585.663882:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774585.663892:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774585.663903:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612546304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774585.663903:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612546432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774585.663917:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774585.663920:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774585.663921:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774585.663923:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10557 00000100:00080000:3.0:1775774585.663926:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774585.663927:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774585.663931:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774585.663939:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612546560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774585.663945:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774585.663948:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774585.663949:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774585.663951:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10557 00000100:00080000:3.0:1775774585.663955:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774585.663957:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774585.663960:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774585.663964:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774585.663968:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612546688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774585.663975:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774585.663977:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774585.663979:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774585.663981:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10557 00000100:00080000:3.0:1775774585.663984:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774585.663986:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774585.663989:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774585.663998:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774585/real 1775774585] req@ffff8de1c7af4700 x1862023612546304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774585.663998:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612546816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774585.664025:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612546304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774585.664033:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774585.664036:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774585.664040:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612546304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774585.664059:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774585.664075:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774585.664084:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774585/real 1775774585] req@ffff8de1c7af5c00 x1862023612546432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774585.664092:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612546432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774585.664097:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774585.664100:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774585.664102:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774585.664106:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774585.664116:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774585.664121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774585/real 1775774585] req@ffff8de1c7af6300 x1862023612546560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774585.664137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612546560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774585.664142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774585.664144:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774585.664146:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774585.664150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774585.664161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774585.664166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774585/real 1775774585] req@ffff8de1c7af4000 x1862023612546688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774585.664174:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612546688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774585.664179:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774585.664180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774585.664182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774585.664186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774585.664195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774585.664200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774585/real 1775774585] req@ffff8de1c7af7480 x1862023612546816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774585.664207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612546816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774585.664212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774585.664213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774585.664215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612546816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774586.623851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774587.647871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774588.671854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774589.695909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774590.719839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774590.783854:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774590.783861:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774590.783866:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774590.783874:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10562 00000100:00080000:1.0:1775774590.783883:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774590.783889:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774590.783920:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612546944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774590.783945:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774590.783949:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774590.783952:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774590.783956:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10562 00000100:00080000:1.0:1775774590.783959:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774590.783964:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774590.783973:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774590.783986:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612547072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774590.783997:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774590.784000:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774590.784001:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774590.784004:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10562 00000100:00080000:1.0:1775774590.784008:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774590.784010:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774590.784014:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774590.784016:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612546944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774590.784024:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612547200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774590.784033:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774590.784035:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774590.784036:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774590.784038:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10562 00000100:00080000:1.0:1775774590.784041:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774590.784044:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774590.784047:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774590.784055:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612547328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774590.784061:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774590.784063:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774590.784064:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774590.784067:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10562 00000100:00080000:1.0:1775774590.784069:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774590.784071:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774590.784074:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774590.784079:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774590.784083:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612547456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774590.784114:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774590/real 1775774590] req@ffff8de1c2e17800 x1862023612546944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774590.784128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612546944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774590.784136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774590.784140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774590.784144:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612546944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774590.784151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774590.784174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774590.784186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774590/real 1775774590] req@ffff8de1c2e15500 x1862023612547072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774590.784200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612547072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774590.784208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774590.784212:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774590.784215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774590.784239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774590.784261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774590.784272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774590/real 1775774590] req@ffff8de1c2e14700 x1862023612547200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774590.784291:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612547200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774590.784296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774590.784298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774590.784301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774590.784305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774590.784319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774590.784326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774590/real 1775774590] req@ffff8de1c2e17480 x1862023612547328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774590.784333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612547328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774590.784338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774590.784340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774590.784342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774590.784345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774590.784354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774590.784359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774590/real 1775774590] req@ffff8de1c2e14a80 x1862023612547456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774590.784366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612547456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774590.784375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774590.784377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774590.784379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774591.743868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774592.767850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774593.791883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774594.815882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774595.839889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774595.903858:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774595.903866:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774595.903870:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774595.903878:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10567 00000100:00080000:2.0:1775774595.903887:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774595.903893:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774595.903924:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612547584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774595.903948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774595.903951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774595.903952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774595.903955:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10567 00000100:00080000:2.0:1775774595.903957:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774595.903960:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774595.903967:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774595.903975:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612547712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774595.903987:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774595.903990:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774595.903991:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774595.903994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10567 00000100:00080000:2.0:1775774595.903996:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774595.904000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612547584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774595.904001:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774595.904005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774595.904016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612547840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774595.904022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774595.904025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774595.904026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774595.904028:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10567 00000100:00080000:2.0:1775774595.904030:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774595.904033:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774595.904036:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774595.904043:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612547968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774595.904049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774595.904052:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774595.904053:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774595.904055:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10567 00000100:00080000:2.0:1775774595.904058:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774595.904061:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774595.904064:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774595.904072:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612548096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774595.904074:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774595.904119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774595/real 1775774595] req@ffff8de1d0f2d500 x1862023612547584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774595.904139:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612547584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774595.904150:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774595.904155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774595.904159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612547584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774595.904167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774595.904193:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774595.904205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774595/real 1775774595] req@ffff8de1d0f2df80 x1862023612547712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774595.904219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612547712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774595.904227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774595.904231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774595.904234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774595.904258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774595.904279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774595.904290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774595/real 1775774595] req@ffff8de1d0f2f100 x1862023612547840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774595.904302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612547840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774595.904310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774595.904314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774595.904317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774595.904323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774595.904340:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774595.904349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774595/real 1775774595] req@ffff8de1d0f2c700 x1862023612547968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774595.904360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612547968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774595.904369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774595.904372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774595.904375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612547968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774595.904380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774595.904395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774595.904404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774595/real 1775774595] req@ffff8de1d0f2ca80 x1862023612548096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774595.904415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612548096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774595.904423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774595.904426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774595.904429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774596.863968:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774597.887898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774598.911914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774599.935836:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774600.959873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774601.023832:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774601.023851:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774601.023857:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774601.023870:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10572 00000100:00080000:3.0:1775774601.023884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774601.023891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774601.023936:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612548224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774601.023966:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774601.023969:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774601.023970:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774601.023974:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10572 00000100:00080000:3.0:1775774601.023976:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774601.024031:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774601.024044:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774601.024071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612548352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774601.024073:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612548224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774601.024103:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775774601.024212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548352:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774601.024286:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774601.024289:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774601.024296:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10572 00000100:00080000:3.0:1775774601.024302:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774601.024308:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774601.024316:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774601.024339:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612548480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774601.024359:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774601.024363:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774601.024365:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774601.024371:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10572 00000100:00080000:3.0:1775774601.024391:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774601.024397:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774601.024404:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774601.024420:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612548608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774601.024431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548480:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774601.024435:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774601.024450:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774601.024453:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774601.024458:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10572 00000100:00080000:3.0:1775774601.024464:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774601.024468:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774601.024473:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774601.024487:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612548736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774601.024515:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774601.024551:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774601.983862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774603.007860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774604.031827:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1775774604.096053:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:3.0:1775774604.096108:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1775774604.096128:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774604.096161:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774604.096175:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774604.096183:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775774604.096191:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775774604.096264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774601/real 1775774604] req@ffff8de1c7af7b80 x1862023612548608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774604.096292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612548608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774604.096304:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774604.096310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774604.096315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774604.096338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774601/real 1775774604] req@ffff8de1c7af6d80 x1862023612548736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774604.096352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612548736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774604.096359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774604.096363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774604.096366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548736:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774604.096373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774601/real 1775774604] req@ffff8de1c7af4e00 x1862023612548480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774604.096385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612548480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774604.096392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774604.096396:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774604.096399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774604.096407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774601/real 1775774604] req@ffff8de1c7af4a80 x1862023612548352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774604.096419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612548352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774604.096427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774604.096430:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774604.096433:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774604.096440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774601/real 1775774604] req@ffff8de1c7af5500 x1862023612548224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774604.096454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612548224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774604.096463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774604.096466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774604.096470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612548224:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775774605.055862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774606.079867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774606.143913:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774606.143920:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774606.143924:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774606.143933:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10577 00000100:00080000:0.0:1775774606.143942:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774606.143948:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774606.143977:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612548864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774606.144005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774606.144015:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774606.144017:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774606.144021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10577 00000100:00080000:0.0:1775774606.144026:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774606.144030:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774606.144041:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774606.144054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612548864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774606.144061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612548992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774606.144079:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774606.144082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774606.144084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774606.144088:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10577 00000100:00080000:0.0:1775774606.144091:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774606.144095:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774606.144099:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774606.144110:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612549120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774606.144119:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774606.144124:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774606.144126:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775774606.144133:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774606.144135:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10577 00000100:00080000:0.0:1775774606.144141:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774606.144147:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774606.144154:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774606.144167:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612549248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774606.144173:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774606/real 1775774606] req@ffff8de1c5681c00 x1862023612548864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774606.144188:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774606.144194:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774606.144196:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774606.144202:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10577 00000100:00080000:0.0:1775774606.144207:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775774606.144207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612548864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774606.144217:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774606.144225:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775774606.144228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774606.144236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774606.144241:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612549376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774606.144245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612548864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774606.144280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774606.144341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774606.144356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774606/real 1775774606] req@ffff8de1c5681f80 x1862023612548992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774606.144368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612548992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774606.144377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774606.144381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774606.144384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612548992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774606.144391:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774606.144429:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774606.144442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774606/real 1775774606] req@ffff8de1c5682a00 x1862023612549120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774606.144453:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612549120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774606.144461:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774606.144464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774606.144467:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774606.144473:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774606.144496:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774606.144505:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774606/real 1775774606] req@ffff8de1c5680380 x1862023612549248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774606.144516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612549248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774606.144523:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774606.144526:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774606.144528:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774606.144534:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774606.144552:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774606.144561:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774606/real 1775774606] req@ffff8de1c5680000 x1862023612549376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774606.144572:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612549376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774606.144580:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774606.144583:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774606.144585:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774607.103863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774608.127837:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774609.151820:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774610.175930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774611.199895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774611.263894:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774611.263905:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774611.263910:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774611.263922:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10583 00000100:00080000:3.0:1775774611.263937:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774611.263947:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774611.263996:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612549504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774611.264018:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774611.264021:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774611.264023:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774611.264028:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10583 00000100:00080000:3.0:1775774611.264031:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774611.264034:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774611.264044:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774611.264053:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612549504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774611.264061:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612549632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774611.264079:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774611.264081:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774611.264082:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774611.264085:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10583 00000100:00080000:3.0:1775774611.264086:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774611.264089:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774611.264092:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774611.264103:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612549760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774611.264114:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774611.264116:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774611.264118:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774611.264121:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10583 00000100:00080000:3.0:1775774611.264123:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774611.264126:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774611.264129:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774611.264135:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612549888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774611.264140:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774611.264142:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774611.264143:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774611.264146:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10583 00000100:00080000:3.0:1775774611.264149:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775774611.264154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774611.264155:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774611.264167:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774611.264184:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612550016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774611.264228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774611/real 1775774611] req@ffff8de1c7af4380 x1862023612549504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774611.264274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612549504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774611.264286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774611.264292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774611.264296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612549504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774611.264323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774611.264350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774611.264364:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774611/real 1775774611] req@ffff8de1c7af5f80 x1862023612549632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774611.264377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612549632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774611.264386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774611.264390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774611.264393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774611.264401:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774611.264423:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774611.264434:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774611/real 1775774611] req@ffff8de1c7af5880 x1862023612549760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774611.264447:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612549760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774611.264463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774611.264466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774611.264470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774611.264476:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774611.264495:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774611.264505:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774611/real 1775774611] req@ffff8de1c7af5180 x1862023612549888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774611.264516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612549888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774611.264525:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774611.264528:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774611.264531:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612549888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774611.264537:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774611.264554:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774611.264564:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774611/real 1775774611] req@ffff8de1c7af7100 x1862023612550016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774611.264575:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612550016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774611.264583:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774611.264587:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774611.264590:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774612.223923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774613.247949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774614.271926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774615.295946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774616.319912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774616.383846:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774616.383858:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774616.383863:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774616.383873:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10588 00000100:00080000:3.0:1775774616.383887:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774616.383897:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774616.383945:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612550144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774616.383988:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774616.383992:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774616.383994:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774616.384000:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10588 00000100:00080000:3.0:1775774616.384004:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774616.384012:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774616.384024:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774616.384040:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612550272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774616.384052:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774616.384055:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774616.384057:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774616.384063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612550144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774616.384063:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10588 00000100:00080000:3.0:1775774616.384068:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774616.384079:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774616.384084:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774616.384097:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612550400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774616.384105:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775774616.384160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774616.384196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774616/real 1775774616] req@ffff8de1c7af7800 x1862023612550144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774616.384225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612550144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774616.384237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774616.384242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774616.384247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612550144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774616.384271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774616.384295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774616.384308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774616/real 1775774616] req@ffff8de1c7af7100 x1862023612550272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774616.384320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612550272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774616.384329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774616.384334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774616.384338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774616.384345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774616.384368:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774616.384381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774616/real 1775774616] req@ffff8de1c7af5180 x1862023612550400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774616.384393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612550400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774616.384409:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774616.384415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774616.384419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550400:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774616.384428:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774616.384431:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774616.384437:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10588 00000100:00080000:3.0:1775774616.384444:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774616.384490:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774616.384499:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774616.384520:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612550528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774616.384535:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774616.384537:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774616.384539:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774616.384542:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10588 00000100:00080000:3.0:1775774616.384544:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774616.384547:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774616.384553:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774616.384563:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612550656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774616.384578:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774616.384608:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774616.384621:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774616/real 1775774616] req@ffff8de1c7af5880 x1862023612550528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774616.384634:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612550528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774616.384643:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774616.384647:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774616.384650:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774616.384664:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774616.384681:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774616.384691:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774616/real 1775774616] req@ffff8de1c7af5f80 x1862023612550656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774616.384703:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612550656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774616.384712:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774616.384715:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774616.384718:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774617.343904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774618.368016:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774619.391928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774620.415858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774621.439891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774621.503823:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774621.503831:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774621.503835:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774621.503843:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10593 00000100:00080000:3.0:1775774621.503853:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774621.503859:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774621.503893:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612550784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774621.503922:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774621.503927:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774621.503929:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774621.503934:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10593 00000100:00080000:3.0:1775774621.503937:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774621.503942:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774621.503952:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774621.503965:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612550912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774621.503972:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774621.503975:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774621.503977:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774621.503980:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10593 00000100:00080000:3.0:1775774621.503983:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774621.503986:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774621.503989:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774621.503995:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612551040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774621.504003:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774621.504004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612550784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774621.504007:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774621.504011:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774621.504015:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10593 00000100:00080000:3.0:1775774621.504017:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774621.504036:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774621.504041:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774621.504050:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612551168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774621.504056:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774621.504058:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774621.504060:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774621.504063:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10593 00000100:00080000:3.0:1775774621.504066:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774621.504068:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774621.504071:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774621.504077:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612551296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774621.504092:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774621.504121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774621/real 1775774621] req@ffff8de1c7af4380 x1862023612550784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774621.504135:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612550784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774621.504142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774621.504145:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774621.504149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612550784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774621.504154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774621.504168:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774621.504174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774621/real 1775774621] req@ffff8de1c7af5500 x1862023612550912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774621.504182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612550912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774621.504187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774621.504188:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774621.504191:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612550912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774621.504208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774621.504218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774621.504224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774621/real 1775774621] req@ffff8de1c7af4a80 x1862023612551040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774621.504231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612551040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774621.504236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774621.504238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774621.504239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774621.504243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774621.504253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774621.504258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774621/real 1775774621] req@ffff8de1c7af4e00 x1862023612551168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774621.504265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612551168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774621.504270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774621.504273:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774621.504276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774621.504281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774621.504300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774621.504312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774621/real 1775774621] req@ffff8de1c7af6d80 x1862023612551296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774621.504325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612551296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774621.504332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774621.504334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774621.504336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774622.463913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774623.487865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774624.511887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774625.535888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774626.559917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774626.623850:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774626.623861:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774626.623866:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774626.623875:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10598 00000100:00080000:3.0:1775774626.623884:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774626.623890:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774626.623924:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612551424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774626.623970:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774626.623973:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774626.623975:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774626.623978:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10598 00000100:00080000:3.0:1775774626.623981:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774626.623983:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774626.623991:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774626.624002:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612551552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774626.624010:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774626.624012:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774626.624013:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774626.624016:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10598 00000100:00080000:3.0:1775774626.624017:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774626.624020:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774626.624023:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774626.624030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612551424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774626.624031:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612551680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774626.624044:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774626.624046:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774626.624047:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774626.624056:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10598 00000100:00080000:3.0:1775774626.624058:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774626.624060:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774626.624065:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774626.624073:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612551808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774626.624079:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774626.624081:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774626.624082:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774626.624085:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10598 00000100:00080000:3.0:1775774626.624087:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774626.624089:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774626.624092:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774626.624097:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774626.624101:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612551936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774626.624139:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774626/real 1775774626] req@ffff8de1c7af7b80 x1862023612551424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774626.624172:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612551424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774626.624182:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774626.624186:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774626.624190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612551424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774626.624198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774626.624220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774626.624232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774626/real 1775774626] req@ffff8de1c7af7480 x1862023612551552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774626.624244:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612551552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774626.624252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774626.624255:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774626.624258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774626.624280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774626.624300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774626.624312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774626/real 1775774626] req@ffff8de1c7af4000 x1862023612551680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774626.624323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612551680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774626.624331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774626.624334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774626.624337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774626.624343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774626.624360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774626.624370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774626/real 1775774626] req@ffff8de1c7af6300 x1862023612551808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774626.624381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612551808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774626.624389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774626.624392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774626.624395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774626.624400:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774626.624421:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774626.624432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774626/real 1775774626] req@ffff8de1c7af5c00 x1862023612551936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774626.624443:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612551936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774626.624450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774626.624453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774626.624457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612551936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774627.583868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774628.607878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774629.631856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774630.655871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774631.679898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774631.743865:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774631.743874:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774631.743879:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774631.743887:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10603 00000100:00080000:3.0:1775774631.743898:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774631.743904:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774631.743942:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612552064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774631.743971:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774631.743974:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774631.743975:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774631.743979:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10603 00000100:00080000:3.0:1775774631.743982:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774631.743985:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774631.743992:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774631.744003:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612552192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774631.744011:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774631.744014:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774631.744015:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774631.744017:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10603 00000100:00080000:3.0:1775774631.744020:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774631.744024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612552064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774631.744025:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774631.744032:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774631.744038:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612552320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774631.744046:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774631.744048:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774631.744049:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774631.744053:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10603 00000100:00080000:3.0:1775774631.744055:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774631.744057:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774631.744061:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774631.744068:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612552448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774631.744079:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774631.744084:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:0.0:1775774631.744085:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774631.744086:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774631.744091:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10603 00000100:00080000:3.0:1775774631.744094:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774631.744096:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774631.744100:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774631.744107:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612552576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774631.744131:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774631/real 1775774631] req@ffff8de1c7af4700 x1862023612552064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774631.744149:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612552064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774631.744158:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774631.744161:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774631.744164:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612552064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774631.744170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774631.744188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774631.744203:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774631/real 1775774631] req@ffff8de1c7af6680 x1862023612552192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774631.744212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612552192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774631.744217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774631.744219:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774631.744221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774631.744239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774631.744250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774631.744256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774631/real 1775774631] req@ffff8de1c7af6a00 x1862023612552320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774631.744263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612552320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774631.744268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774631.744270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774631.744272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774631.744276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774631.744286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774631.744291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774631/real 1775774631] req@ffff8de1c7af5c00 x1862023612552448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774631.744298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612552448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774631.744303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774631.744305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774631.744307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774631.744312:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774631.744328:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774631.744338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774631/real 1775774631] req@ffff8de1c7af6300 x1862023612552576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774631.744350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612552576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774631.744359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774631.744363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774631.744366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774632.703925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774633.727907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774634.751943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774635.775986:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774636.799906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774636.863877:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774636.863887:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774636.863892:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774636.863904:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10608 00000100:00080000:3.0:1775774636.863919:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774636.863928:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774636.863979:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612552704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774636.864010:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774636.864013:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774636.864014:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774636.864018:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10608 00000100:00080000:3.0:1775774636.864021:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774636.864024:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774636.864035:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774636.864046:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612552832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774636.864054:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774636.864057:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774636.864059:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774636.864062:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10608 00000100:00080000:3.0:1775774636.864064:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774636.864067:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774636.864070:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774636.864078:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612552704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774636.864079:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612552960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774636.864092:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774636.864095:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774636.864096:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774636.864099:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10608 00000100:00080000:3.0:1775774636.864101:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774636.864104:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774636.864108:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774636.864115:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612553088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774636.864121:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774636.864123:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774636.864124:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774636.864127:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10608 00000100:00080000:3.0:1775774636.864130:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774636.864132:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774636.864135:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774636.864141:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612553216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774636.864157:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774636.864197:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774636/real 1775774636] req@ffff8de1c7af4000 x1862023612552704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774636.864213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612552704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774636.864221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774636.864224:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774636.864227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612552704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774636.864233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774636.864248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774636.864255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774636/real 1775774636] req@ffff8de1c7af7480 x1862023612552832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774636.864263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612552832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774636.864269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774636.864271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774636.864272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774636.864299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774636.864318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774636.864330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774636/real 1775774636] req@ffff8de1c7af7b80 x1862023612552960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774636.864344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612552960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774636.864363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774636.864367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774636.864370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612552960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774636.864375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774636.864392:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774636.864399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774636/real 1775774636] req@ffff8de1c7af6d80 x1862023612553088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774636.864408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612553088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774636.864413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774636.864415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774636.864417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774636.864421:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774636.864430:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774636.864442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774636/real 1775774636] req@ffff8de1c7af4e00 x1862023612553216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774636.864450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612553216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774636.864460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774636.864462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774636.864464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774637.823902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774638.847869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774639.871890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774640.895870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774641.919965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774641.983791:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774641.983800:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774641.983804:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774641.983813:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10613 00000100:00080000:3.0:1775774641.983822:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774641.983828:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774641.983860:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612553344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774641.983882:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774641.983885:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774641.983886:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774641.983890:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10613 00000100:00080000:3.0:1775774641.983892:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774641.983894:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774641.983902:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774641.983911:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612553472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774641.983923:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774641.983925:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774641.983927:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774641.983930:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10613 00000100:00080000:3.0:1775774641.983931:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774641.983934:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774641.983937:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774641.983940:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612553344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774641.983946:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612553600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774641.983954:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774641.983957:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774641.983958:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774641.983961:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10613 00000100:00080000:3.0:1775774641.983963:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774641.983965:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774641.983968:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774641.983976:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612553728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774641.983982:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774641.983984:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774641.983985:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774641.983988:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10613 00000100:00080000:3.0:1775774641.983991:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774641.983993:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774641.983996:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774641.984003:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612553856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774641.984012:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774641.984049:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774641/real 1775774641] req@ffff8de1c7af4a80 x1862023612553344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774641.984067:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612553344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774641.984077:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774641.984081:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774641.984085:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612553344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774641.984093:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774641.984114:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774641.984125:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774641/real 1775774641] req@ffff8de1c7af5500 x1862023612553472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774641.984137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612553472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774641.984146:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774641.984149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774641.984152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774641.984175:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774641.984194:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774641.984205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774641/real 1775774641] req@ffff8de1c7af4380 x1862023612553600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774641.984217:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612553600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774641.984225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774641.984228:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774641.984231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774641.984238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774641.984257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774641.984268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774641/real 1775774641] req@ffff8de1c7af5f80 x1862023612553728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774641.984279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612553728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774641.984287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774641.984301:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774641.984309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774641.984315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774641.984334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774641.984344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774641/real 1775774641] req@ffff8de1c7af5880 x1862023612553856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774641.984355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612553856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774641.984363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774641.984366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774641.984369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612553856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774642.943885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774643.967825:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774644.991934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774646.015927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774647.039980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774647.103805:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774647.103814:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774647.103818:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774647.103825:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10618 00000100:00080000:2.0:1775774647.103835:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774647.103844:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774647.103877:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612553984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774647.103898:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774647.103901:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774647.103902:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774647.103905:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10618 00000100:00080000:2.0:1775774647.103908:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774647.103910:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774647.103918:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774647.103926:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612554112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774647.103934:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774647.103937:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774647.103939:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774647.103942:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612553984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774647.103944:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10618 00000100:00080000:2.0:1775774647.103949:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774647.103952:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774647.103956:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774647.103965:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612554240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774647.103972:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774647.103974:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774647.103976:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774647.103978:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10618 00000100:00080000:2.0:1775774647.103982:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774647.103984:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774647.103986:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774647.103993:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612554368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774647.104014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774647.104020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:0.0:1775774647.104021:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775774647.104023:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774647.104028:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10618 00000100:00080000:2.0:1775774647.104033:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774647.104036:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774647.104041:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774647.104051:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612554496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774647.104063:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774647/real 1775774647] req@ffff8de1d0f2e300 x1862023612553984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774647.104081:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612553984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774647.104090:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774647.104093:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774647.104098:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612553984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774647.104116:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774647.104135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774647.104144:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774647/real 1775774647] req@ffff8de1d0f2e680 x1862023612554112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774647.104153:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612554112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774647.104159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774647.104162:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774647.104164:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774647.104168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774647.104179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774647.104185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774647/real 1775774647] req@ffff8de1d0f2ca80 x1862023612554240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774647.104194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612554240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774647.104199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774647.104201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774647.104204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774647.104208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774647.104218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774647.104241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774647/real 1775774647] req@ffff8de1d0f2c700 x1862023612554368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774647.104248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612554368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774647.104253:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774647.104255:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774647.104256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774647.104259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774647.104269:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774647.104274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774647/real 1775774647] req@ffff8de1d0f2f100 x1862023612554496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774647.104280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612554496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774647.104284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774647.104286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774647.104288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774648.063912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774649.087884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774650.111873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774651.135868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774652.159857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774652.223862:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774652.223870:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774652.223875:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774652.223884:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10623 00000100:00080000:0.0:1775774652.223895:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774652.223902:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774652.223942:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612554624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774652.223974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774652.223977:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774652.223979:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774652.223982:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10623 00000100:00080000:0.0:1775774652.223986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774652.223989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774652.223999:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774652.224012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612554752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774652.224021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775774652.224023:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612554624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774652.224024:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774652.224029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774652.224036:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10623 00000100:00080000:0.0:1775774652.224040:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774652.224045:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774652.224051:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774652.224073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612554880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774652.224084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774652.224097:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774652.224101:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774652.224104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774652.224111:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10623 00000100:00080000:0.0:1775774652.224116:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775774652.224117:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774652/real 1775774652] req@ffff8de1c5683480 x1862023612554624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774652.224126:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774652.224136:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774652.224141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612554624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774652.224151:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612555008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774652.224152:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774652.224163:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774652.224166:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774652.224167:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774652.224170:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10623 00000100:00080000:0.0:1775774652.224174:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774652.224177:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774652.224181:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774652.224186:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612555136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774652.224228:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774652.224232:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612554624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774652.224252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774652.224401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774652.224418:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774652/real 1775774652] req@ffff8de1c5681500 x1862023612554752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774652.224430:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612554752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774652.224436:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774652.224438:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774652.224441:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774652.224446:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774652.224459:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774652.224466:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774652/real 1775774652] req@ffff8de1c5681880 x1862023612554880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774652.224473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612554880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774652.224478:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774652.224480:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774652.224500:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612554880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774652.224505:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774652.224520:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774652.224527:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774652/real 1775774652] req@ffff8de1c5680e00 x1862023612555008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774652.224535:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612555008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774652.224540:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774652.224542:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774652.224544:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774652.224548:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774652.224557:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774652.224563:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774652/real 1775774652] req@ffff8de1c5683800 x1862023612555136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774652.224570:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612555136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774652.224575:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774652.224577:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774652.224578:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774653.183912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774654.207857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774655.231923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774656.255874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774657.279894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774657.343871:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774657.343879:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774657.343883:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774657.343891:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10629 00000100:00080000:3.0:1775774657.343901:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774657.343907:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774657.343941:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612555264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774657.343967:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774657.343970:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774657.343972:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774657.343975:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10629 00000100:00080000:3.0:1775774657.343977:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774657.343980:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774657.343989:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774657.343998:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612555392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774657.344004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612555264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774657.344014:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774657.344017:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774657.344019:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774657.344022:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10629 00000100:00080000:3.0:1775774657.344025:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774657.344027:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774657.344030:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774657.344041:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612555520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774657.344047:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774657.344049:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774657.344050:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774657.344053:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10629 00000100:00080000:3.0:1775774657.344057:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774657.344059:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774657.344063:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774657.344068:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774657.344074:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612555648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774657.344082:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774657.344084:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774657.344086:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774657.344088:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10629 00000100:00080000:3.0:1775774657.344092:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774657.344095:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774657.344099:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774657.344103:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774657/real 1775774657] req@ffff8de1c7af5180 x1862023612555264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774657.344110:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612555776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774657.344125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612555264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774657.344134:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774657.344137:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774657.344140:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612555264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774657.344161:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774657.344176:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774657.344185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774657/real 1775774657] req@ffff8de1c7af7100 x1862023612555392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774657.344194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612555392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774657.344199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774657.344201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774657.344204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774657.344208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774657.344236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774657.344242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774657/real 1775774657] req@ffff8de1c7af7800 x1862023612555520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774657.344255:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612555520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774657.344261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774657.344263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774657.344265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774657.344269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774657.344278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774657.344284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774657/real 1775774657] req@ffff8de1c7af5880 x1862023612555648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774657.344291:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612555648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774657.344296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774657.344298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774657.344301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774657.344321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774657.344332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774657.344338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774657/real 1775774657] req@ffff8de1c7af5f80 x1862023612555776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774657.344344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612555776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774657.344354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774657.344356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774657.344358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612555776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774658.303989:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774659.327892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774660.351863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774661.375915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774662.399848:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774662.463811:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774662.463818:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774662.463822:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774662.463830:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10634 00000100:00080000:3.0:1775774662.463839:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774662.463845:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774662.463878:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612555904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774662.463902:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774662.463906:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774662.463908:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774662.463912:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10634 00000100:00080000:3.0:1775774662.463915:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774662.463919:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774662.463929:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774662.463943:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612556032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774662.463954:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774662.463958:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774662.463960:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774662.463961:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612555904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774662.463964:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10634 00000100:00080000:3.0:1775774662.463967:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774662.463970:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774662.463975:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774662.463983:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612556160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774662.463991:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774662.463994:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774662.463995:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774662.463998:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10634 00000100:00080000:3.0:1775774662.464001:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774662.464004:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774662.464008:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774662.464016:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612556288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774662.464019:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774662.464024:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774662.464027:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774662.464029:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774662.464031:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10634 00000100:00080000:3.0:1775774662.464034:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774662.464037:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774662.464042:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774662.464049:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612556416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774662.464052:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774662/real 1775774662] req@ffff8de1c7af4380 x1862023612555904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774662.464070:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612555904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774662.464092:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774662.464096:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774662.464101:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612555904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774662.464124:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774662.464142:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774662.464162:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774662/real 1775774662] req@ffff8de1c7af5500 x1862023612556032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774662.464170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612556032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774662.464175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774662.464177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774662.464179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774662.464183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774662.464193:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774662.464198:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774662/real 1775774662] req@ffff8de1c7af4a80 x1862023612556160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774662.464205:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612556160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774662.464210:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774662.464212:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774662.464213:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774662.464217:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774662.464226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774662.464230:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774662/real 1775774662] req@ffff8de1c7af4e00 x1862023612556288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774662.464236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612556288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774662.464241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774662.464243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774662.464245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774662.464259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774662.464268:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774662.464273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774662/real 1775774662] req@ffff8de1c7af6d80 x1862023612556416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774662.464279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612556416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774662.464284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774662.464286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774662.464288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774663.423850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774664.447869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774665.471886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774666.495844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774667.519948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774667.583870:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774667.583884:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774667.583891:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774667.583904:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10639 00000100:00080000:3.0:1775774667.583920:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774667.583928:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774667.583975:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612556544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774667.584009:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774667.584012:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774667.584013:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774667.584017:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10639 00000100:00080000:3.0:1775774667.584020:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774667.584022:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774667.584032:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774667.584044:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612556672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774667.584052:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774667.584055:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774667.584057:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774667.584059:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10639 00000100:00080000:3.0:1775774667.584063:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774667.584067:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774667.584071:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612556544:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774667.584072:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774667.584084:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612556800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774667.584090:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774667.584092:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774667.584093:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774667.584096:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10639 00000100:00080000:3.0:1775774667.584099:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774667.584102:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774667.584106:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774667.584116:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612556928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774667.584123:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774667.584125:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774667.584127:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774667.584129:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10639 00000100:00080000:3.0:1775774667.584131:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774667.584133:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774667.584136:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774667.584142:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612557056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774667.584191:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774667.584241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774667.584266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774667.584279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774668.543990:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774669.567846:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774670.591850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775774670.655934:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775774670.655971:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775774670.655984:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774670.656015:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774670.656022:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774670.656027:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774670.656032:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775774670.656063:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774667/real 1775774670] req@ffff8de1c7af4000 x1862023612556800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774670.656085:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612556800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774670.656095:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774670.656099:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774670.656104:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774670.656113:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774667/real 1775774670] req@ffff8de1c7af6300 x1862023612556928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774670.656127:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612556928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774670.656136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774670.656140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774670.656144:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774670.656150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774667/real 1775774670] req@ffff8de1c7af5c00 x1862023612557056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774670.656192:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612557056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774670.656201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774670.656205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774670.656209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557056:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774670.656217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774667/real 1775774670] req@ffff8de1c7af7b80 x1862023612556544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774670.656230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612556544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774670.656237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774670.656241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774670.656244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612556544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774670.656251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774667/real 1775774670] req@ffff8de1c7af7480 x1862023612556672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774670.656262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612556672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774670.656271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774670.656274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774670.656278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612556672:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775774671.615905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774672.639828:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774672.703919:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774672.703930:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774672.703933:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774672.703942:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10644 00000100:00080000:1.0:1775774672.703951:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774672.703956:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774672.703996:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612557184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774672.704020:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774672.704023:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774672.704024:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774672.704027:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10644 00000100:00080000:1.0:1775774672.704031:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774672.704035:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774672.704043:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774672.704055:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612557312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774672.704065:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774672.704068:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774672.704070:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774672.704074:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10644 00000100:00080000:1.0:1775774672.704077:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774672.704080:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774672.704084:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774672.704097:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612557440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774672.704107:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774672.704111:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774672.704113:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774672.704118:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10644 00000100:00080000:1.0:1775774672.704121:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774672.704150:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774672.704156:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774672.704167:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612557568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774672.704177:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774672.704180:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774672.704182:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774672.704186:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10644 00000100:00080000:1.0:1775774672.704189:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774672.704193:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774672.704198:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774672.704207:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612557696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774672.704255:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612557184:192.168.201.137@tcp:250:kworker.0 00000800:00000100:0.0:1775774672.704343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774672.704398:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774672/real 1775774672] req@ffff8de1c2e14e00 x1862023612557184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774672.704419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612557184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774672.704432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774672.704436:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774672.704440:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612557184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774672.704448:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774672.704475:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774672.704486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774672/real 1775774672] req@ffff8de1c2e14a80 x1862023612557312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774672.704500:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612557312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774672.704508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774672.704511:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774672.704514:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774672.704521:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774672.704540:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774672.704550:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774672/real 1775774672] req@ffff8de1c2e17480 x1862023612557440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774672.704569:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612557440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774672.704578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774672.704581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774672.704585:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774672.704593:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774672.704615:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774672.704635:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774672/real 1775774672] req@ffff8de1c2e14700 x1862023612557568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774672.704649:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612557568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774672.704659:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774672.704663:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774672.704667:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774672.704673:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774672.704693:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774672.704711:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774672/real 1775774672] req@ffff8de1c2e15500 x1862023612557696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774672.704760:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612557696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774672.704769:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774672.704772:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774672.704776:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774673.663821:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774674.687839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774675.711872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774676.735880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774677.759850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774677.823832:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774677.823840:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774677.823844:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774677.823855:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10649 00000100:00080000:3.0:1775774677.823867:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774677.823874:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774677.823923:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612557824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774677.823945:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774677.823948:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774677.823950:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774677.823953:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10649 00000100:00080000:3.0:1775774677.823956:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774677.823959:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774677.823966:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774677.823977:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612557952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774677.823986:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774677.823991:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775774677.823992:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612557824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774677.823992:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774677.824000:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10649 00000100:00080000:3.0:1775774677.824002:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774677.824004:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774677.824008:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774677.824016:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612558080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774677.824022:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774677.824024:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774677.824025:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774677.824027:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10649 00000100:00080000:3.0:1775774677.824030:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774677.824032:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774677.824049:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774677.824060:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612558208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774677.824069:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774677.824072:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774677.824076:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775774677.824077:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774677.824085:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10649 00000100:00080000:3.0:1775774677.824090:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774677.824095:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774677.824101:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774677.824112:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774677/real 1775774677] req@ffff8de1c7af6a00 x1862023612557824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774677.824117:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612558336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774677.824135:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612557824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774677.824144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774677.824149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774677.824152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612557824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774677.824171:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774677.824187:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774677.824194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774677/real 1775774677] req@ffff8de1c7af6680 x1862023612557952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774677.824203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612557952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774677.824208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774677.824210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774677.824212:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612557952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774677.824216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774677.824226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774677.824231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774677/real 1775774677] req@ffff8de1c7af4700 x1862023612558080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774677.824239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612558080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774677.824244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774677.824245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774677.824247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774677.824250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774677.824260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774677.824265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774677/real 1775774677] req@ffff8de1c7af7480 x1862023612558208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774677.824271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612558208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774677.824276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774677.824277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774677.824279:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774677.824282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774677.824291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774677.824296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774677/real 1775774677] req@ffff8de1c7af7b80 x1862023612558336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774677.824302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612558336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774677.824311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774677.824313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774677.824315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774678.783891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774679.807842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774680.831876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774681.855987:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774682.879872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774682.943814:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774682.943822:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774682.943825:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774682.943833:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10654 00000100:00080000:0.0:1775774682.943842:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774682.943848:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774682.943882:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612558464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774682.943907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774682.943911:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774682.943913:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774682.943919:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10654 00000100:00080000:0.0:1775774682.943924:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774682.943929:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774682.943935:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612558464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774682.943940:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774682.943975:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612558592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774682.943990:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774682.943994:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774682.943996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774682.944002:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10654 00000800:00000100:3.0:1775774682.944004:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774682.944010:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774682.944017:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774682.944023:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774682.944038:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774682/real 1775774682] req@ffff8de1c5683800 x1862023612558464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774682.944040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612558720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774682.944067:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774682.944071:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774682.944072:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774682.944077:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612558464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774682.944078:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10654 00000100:00080000:0.0:1775774682.944086:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774682.944089:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774682.944094:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:3.0:1775774682.944097:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774682.944103:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612558464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774682.944113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774682.944123:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774682.944128:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612558848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774682.944138:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774682.944141:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774682.944142:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775774682.944146:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774682.944150:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10654 00000100:00080000:0.0:1775774682.944155:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774682.944158:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774682.944163:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774682.944166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774682/real 1775774682] req@ffff8de1c5680e00 x1862023612558592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774682.944174:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612558976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774682.944201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612558592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774682.944211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774682.944215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774682.944218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774682.944225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774682.944247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774682.944258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774682/real 1775774682] req@ffff8de1c5681880 x1862023612558720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774682.944274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612558720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774682.944279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774682.944282:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774682.944284:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774682.944295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774682.944309:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774682.944315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774682/real 1775774682] req@ffff8de1c5681500 x1862023612558848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774682.944323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612558848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774682.944328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774682.944330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774682.944332:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774682.944335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774682.944344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774682.944349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774682/real 1775774682] req@ffff8de1c5683480 x1862023612558976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774682.944356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612558976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774682.944365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774682.944367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774682.944369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612558976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774683.903882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774684.927943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774685.951848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774686.975888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774687.999877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774688.063809:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774688.063816:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774688.063821:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774688.063829:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10659 00000100:00080000:0.0:1775774688.063837:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774688.063842:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774688.063888:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612559104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774688.063909:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774688.063913:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774688.063915:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774688.063918:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10659 00000100:00080000:0.0:1775774688.063921:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774688.063924:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774688.063931:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774688.063944:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612559232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774688.063958:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774688.063960:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774688.063962:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774688.063969:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10659 00000100:00100000:3.0:1775774688.063975:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612559104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774688.063977:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774688.063991:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774688.064000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774688.064024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612559360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774688.064033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774688.064036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774688.064038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774688.064045:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10659 00000100:00080000:0.0:1775774688.064050:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774688.064055:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774688.064061:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774688.064070:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612559488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774688.064079:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774688.064083:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774688.064084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774688.064088:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10659 00000100:00080000:0.0:1775774688.064092:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774688.064094:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774688.064098:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774688.064105:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612559616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774688.064318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774688.064405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774688/real 1775774688] req@ffff8de1c5680000 x1862023612559104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774688.064427:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612559104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774688.064437:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774688.064441:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774688.064444:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612559104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774688.064468:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774688.064489:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774688.064498:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774688/real 1775774688] req@ffff8de1c5680380 x1862023612559232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774688.064507:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612559232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774688.064513:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774688.064515:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774688.064517:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774688.064522:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774688.064534:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774688.064540:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774688/real 1775774688] req@ffff8de1c5682a00 x1862023612559360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774688.064548:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612559360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774688.064553:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774688.064555:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774688.064557:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774688.064561:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774688.064571:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774688.064577:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774688/real 1775774688] req@ffff8de1c5681f80 x1862023612559488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774688.064584:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612559488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774688.064589:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774688.064591:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774688.064593:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774688.064597:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774688.064606:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774688.064611:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774688/real 1775774688] req@ffff8de1c5681c00 x1862023612559616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774688.064619:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612559616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774688.064624:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774688.064626:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774688.064628:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774689.023866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774690.047853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774691.071872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774692.095900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774693.119889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774693.183853:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774693.183862:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774693.183865:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774693.183876:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10664 00000100:00080000:2.0:1775774693.183887:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774693.183895:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774693.183931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612559744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774693.183956:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774693.183959:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774693.183960:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774693.183964:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10664 00000100:00080000:2.0:1775774693.183967:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774693.183970:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774693.183979:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774693.183988:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612559872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774693.183997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774693.184000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775774693.184001:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612559744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774693.184002:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774693.184009:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10664 00000100:00080000:2.0:1775774693.184011:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774693.184013:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774693.184016:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774693.184026:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612560000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774693.184033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774693.184036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774693.184037:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774693.184040:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10664 00000100:00080000:2.0:1775774693.184049:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774693.184052:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774693.184055:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774693.184062:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774693.184064:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612560128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774693.184071:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774693.184074:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774693.184076:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774693.184079:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10664 00000100:00080000:2.0:1775774693.184082:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774693.184084:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774693.184087:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774693.184094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612560256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774693.184106:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774693/real 1775774693] req@ffff8de1d0f2df80 x1862023612559744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774693.184126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612559744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774693.184137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774693.184142:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774693.184146:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612559744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774693.184169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774693.184195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774693.184205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774693/real 1775774693] req@ffff8de1d0f2d500 x1862023612559872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774693.184213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612559872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774693.184224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774693.184226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774693.184228:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612559872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774693.184232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774693.184244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774693.184249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774693/real 1775774693] req@ffff8de1d0f2f100 x1862023612560000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774693.184256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612560000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774693.184261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774693.184263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774693.184264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774693.184268:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774693.184278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774693.184283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774693/real 1775774693] req@ffff8de1d0f2c700 x1862023612560128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774693.184290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612560128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774693.184294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774693.184296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774693.184299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774693.184302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774693.184312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774693.184316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774693/real 1775774693] req@ffff8de1d0f2ca80 x1862023612560256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774693.184323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612560256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774693.184328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774693.184329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774693.184331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774694.143872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774695.167912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774696.191876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774697.215846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774698.239886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774698.303845:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774698.303856:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774698.303861:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774698.303871:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10670 00000100:00080000:1.0:1775774698.303884:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774698.303891:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774698.303928:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612560384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774698.303957:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774698.303962:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774698.303964:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774698.303969:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10670 00000100:00080000:1.0:1775774698.303973:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774698.303978:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774698.303989:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774698.303999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612560384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774698.304005:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612560512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774698.304018:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774698.304022:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774698.304024:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774698.304028:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10670 00000100:00080000:1.0:1775774698.304033:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774698.304038:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774698.304043:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774698.304056:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612560640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774698.304064:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774698.304086:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774698.304090:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774698.304093:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774698.304097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774698/real 1775774698] req@ffff8de1c2e17800 x1862023612560384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774698.304100:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10670 00000100:00080000:1.0:1775774698.304108:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774698.304114:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774698.304119:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612560384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:1.0:1775774698.304120:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775774698.304133:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774698.304138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774698.304139:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612560768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774698.304142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612560384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774698.304159:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774698.304163:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774698.304164:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774698.304170:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10670 00000100:00100000:3.0:1775774698.304173:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560512:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775774698.304176:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774698.304183:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774698.304189:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774698.304202:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612560896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774698.304207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774698.304225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774698/real 1775774698] req@ffff8de1c2e16a00 x1862023612560512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774698.304236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612560512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774698.304243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774698.304246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774698.304248:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774698.304252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774698.304272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774698.304283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774698/real 1775774698] req@ffff8de1c2e16680 x1862023612560640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774698.304296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612560640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774698.304306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774698.304309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774698.304312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774698.304319:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774698.304340:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774698.304351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774698/real 1775774698] req@ffff8de1c2e14380 x1862023612560768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774698.304364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612560768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774698.304373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774698.304376:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774698.304379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774698.304393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774698.304408:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774698.304414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774698/real 1775774698] req@ffff8de1c2e17100 x1862023612560896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774698.304422:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612560896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774698.304427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774698.304429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774698.304431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612560896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774699.263850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774700.287952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774701.311884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774702.335873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774703.359885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774703.423814:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774703.423821:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774703.423826:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774703.423833:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10675 00000100:00080000:3.0:1775774703.423842:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774703.423848:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774703.423879:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612561024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774703.423902:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774703.423905:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774703.423907:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774703.423910:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10675 00000100:00080000:3.0:1775774703.423912:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774703.423914:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774703.423922:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774703.423930:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612561152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774703.423938:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774703.423942:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775774703.423943:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612561024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774703.423943:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774703.423951:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10675 00000100:00080000:3.0:1775774703.423953:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774703.423955:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774703.423958:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774703.423967:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612561280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774703.423972:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774703.423975:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774703.423976:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774703.423979:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10675 00000100:00080000:3.0:1775774703.423982:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774703.423984:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774703.423988:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774703.423994:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612561408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774703.424000:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775774703.424005:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774703.424005:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774703.424009:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774703.424013:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10675 00000100:00080000:3.0:1775774703.424015:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774703.424018:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774703.424021:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774703.424028:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612561536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774703.424042:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774703/real 1775774703] req@ffff8de1c7af5c00 x1862023612561024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774703.424057:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612561024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774703.424065:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774703.424068:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774703.424071:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612561024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774703.424089:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774703.424104:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774703.424113:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774703/real 1775774703] req@ffff8de1c7af6300 x1862023612561152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774703.424121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612561152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774703.424126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774703.424129:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774703.424131:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774703.424135:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774703.424145:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774703.424150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774703/real 1775774703] req@ffff8de1c7af4000 x1862023612561280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774703.424157:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612561280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774703.424162:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774703.424164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774703.424172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774703.424176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774703.424187:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774703.424192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774703/real 1775774703] req@ffff8de1c7af6d80 x1862023612561408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774703.424199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612561408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774703.424205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774703.424207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774703.424209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774703.424213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774703.424238:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774703.424250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774703/real 1775774703] req@ffff8de1c7af4e00 x1862023612561536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774703.424263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612561536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774703.424272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774703.424276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774703.424279:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774704.383881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774705.407860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774706.431909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774707.455874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774708.479841:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774708.543869:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774708.543879:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774708.543883:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774708.543891:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10680 00000100:00080000:1.0:1775774708.543902:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774708.543908:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774708.543939:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612561664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774708.543962:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774708.543965:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774708.543966:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774708.543969:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10680 00000100:00080000:1.0:1775774708.543971:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774708.543974:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774708.543982:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774708.543994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612561664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774708.543994:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612561792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774708.544008:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774708.544010:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774708.544012:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774708.544015:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10680 00000100:00080000:1.0:1775774708.544018:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774708.544020:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774708.544023:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774708.544032:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612561920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774708.544038:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774708.544040:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774708.544042:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774708.544045:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10680 00000100:00080000:1.0:1775774708.544047:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774708.544049:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774708.544052:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774708.544053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774708.544064:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612562048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774708.544071:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774708.544074:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774708.544075:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774708.544077:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10680 00000100:00080000:1.0:1775774708.544080:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774708.544082:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774708.544093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774708/real 1775774708] req@ffff8de1c2e17b80 x1862023612561664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:1.0:1775774708.544094:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774708.544104:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612562176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774708.544126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612561664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774708.544139:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774708.544145:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774708.544149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612561664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774708.544170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774708.544206:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774708.544220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774708/real 1775774708] req@ffff8de1c2e17100 x1862023612561792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774708.544231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612561792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774708.544237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774708.544239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774708.544242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774708.544246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774708.544261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774708.544267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774708/real 1775774708] req@ffff8de1c2e14380 x1862023612561920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774708.544274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612561920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774708.544279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774708.544281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774708.544283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612561920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774708.544287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774708.544297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774708.544302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774708/real 1775774708] req@ffff8de1c2e16680 x1862023612562048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774708.544309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612562048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774708.544314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774708.544316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774708.544317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774708.544320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774708.544329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774708.544334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774708/real 1775774708] req@ffff8de1c2e16a00 x1862023612562176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774708.544340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612562176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774708.544344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774708.544346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774708.544348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774709.503871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774710.527863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774711.551839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774712.575860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774713.599889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774713.663842:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774713.663852:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774713.663857:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774713.663867:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10685 00000100:00080000:1.0:1775774713.663880:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774713.663887:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774713.663937:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612562304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774713.663969:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774713.663973:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774713.663975:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774713.663980:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10685 00000100:00080000:1.0:1775774713.663984:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774713.663988:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774713.663998:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774713.664013:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612562432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774713.664025:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775774713.664026:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612562304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774713.664032:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774713.664036:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774713.664042:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10685 00000100:00080000:1.0:1775774713.664045:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774713.664050:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774713.664056:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774713.664071:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612562560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774713.664082:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774713.664085:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774713.664087:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774713.664091:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10685 00000800:00000100:0.0:1775774713.664096:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774713.664098:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774713.664105:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774713.664113:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774713.664126:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612562688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774713.664137:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774713/real 1775774713] req@ffff8de1c2e17800 x1862023612562304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774713.664138:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774713.664148:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774713.664152:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774713.664162:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10685 00000100:00080000:1.0:1775774713.664167:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774713.664171:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612562304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774713.664175:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774713.664185:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774713.664188:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774713.664194:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774713.664201:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612562816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774713.664202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612562304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774713.664233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774713.664257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774713.664269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774713/real 1775774713] req@ffff8de1c2e15500 x1862023612562432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774713.664282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612562432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774713.664306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774713.664310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774713.664314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774713.664320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774713.664342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774713.664353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774713/real 1775774713] req@ffff8de1c2e14700 x1862023612562560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774713.664366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612562560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774713.664382:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774713.664385:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774713.664388:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774713.664395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774713.664430:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774713.664439:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774713/real 1775774713] req@ffff8de1c2e17480 x1862023612562688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774713.664447:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612562688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774713.664452:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774713.664455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774713.664457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774713.664461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774713.664474:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774713.664479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774713/real 1775774713] req@ffff8de1c2e14a80 x1862023612562816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774713.664487:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612562816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774713.664491:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774713.664493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774713.664495:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612562816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774714.623877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774715.647857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774716.671859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774717.695894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774718.719846:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774718.783846:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774718.783854:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774718.783858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774718.783865:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10690 00000100:00080000:0.0:1775774718.783874:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774718.783880:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774718.783915:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612562944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774718.783940:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774718.783942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774718.783944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774718.783947:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10690 00000100:00080000:0.0:1775774718.783949:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774718.783951:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774718.783959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774718.783967:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612563072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774718.783976:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774718.783979:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774718.783981:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774718.783985:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10690 00000100:00100000:3.0:1775774718.783986:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612562944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774718.783988:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774718.783995:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774718.783999:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774718.784012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612563200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774718.784022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774718.784026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774718.784028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774718.784032:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10690 00000100:00080000:0.0:1775774718.784038:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774718.784043:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775774718.784047:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775774718.784049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774718.784064:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612563328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774718.784079:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774718/real 1775774718] req@ffff8de1c5683b80 x1862023612562944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774718.784083:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774718.784095:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774718.784098:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774718.784105:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10690 00000100:00100000:3.0:1775774718.784107:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612562944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774718.784112:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774718.784121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:3.0:1775774718.784125:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:0.0:1775774718.784128:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775774718.784133:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774718.784139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612562944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774718.784146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612563456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774718.784169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774718.784198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774718.784212:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774718/real 1775774718] req@ffff8de1c5682300 x1862023612563072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774718.784224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612563072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774718.784233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774718.784237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774718.784240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774718.784246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774718.784271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774718.784283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774718/real 1775774718] req@ffff8de1c5680700 x1862023612563200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774718.784297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612563200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774718.784302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774718.784305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774718.784307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774718.784311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774718.784342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774718.784351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774718/real 1775774718] req@ffff8de1c5682d80 x1862023612563328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774718.784363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612563328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774718.784369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774718.784371:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774718.784373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774718.784377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774718.784388:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774718.784393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774718/real 1775774718] req@ffff8de1c5682680 x1862023612563456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774718.784400:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612563456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774718.784405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774718.784407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774718.784409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774719.743907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774720.767879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774721.791937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774722.815888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774723.839875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774723.903822:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774723.903833:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774723.903838:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774723.903849:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10695 00000100:00080000:0.0:1775774723.903872:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774723.903881:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774723.903958:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612563584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774723.903994:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774723.904000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774723.904002:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774723.904009:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10695 00000100:00080000:0.0:1775774723.904015:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774723.904036:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774723.904047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774723.904075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612563712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774723.904079:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612563584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774723.904097:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774723.904101:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774723.904103:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774723.904108:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10695 00000100:00080000:0.0:1775774723.904112:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774723.904116:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774723.904121:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774723.904143:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612563840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774723.904152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774723.904158:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774723.904160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774723.904162:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774723.904165:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10695 00000100:00080000:0.0:1775774723.904168:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774723.904171:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774723.904175:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774723.904183:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612563968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774723.904201:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774723.904204:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774723.904205:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774723.904209:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10695 00000100:00080000:0.0:1775774723.904211:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774723.904214:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774723.904219:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774723.904229:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612564096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774723.904411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774723/real 1775774723] req@ffff8de1c5682680 x1862023612563584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774723.904433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612563584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774723.904443:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774723.904449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774723.904454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612563584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774723.904567:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774723.904588:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774723.904598:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774723/real 1775774723] req@ffff8de1c5682d80 x1862023612563712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774723.904606:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612563712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774723.904612:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774723.904614:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774723.904617:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774723.904621:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774723.904632:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774723.904638:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774723/real 1775774723] req@ffff8de1c5680700 x1862023612563840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774723.904645:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612563840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774723.904654:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774723.904656:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774723.904658:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774723.904663:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774723.904679:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774723.904690:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774723/real 1775774723] req@ffff8de1c5682300 x1862023612563968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774723.904702:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612563968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774723.904749:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774723.904755:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774723.904759:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612563968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774723.904769:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774723.904790:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774723.904799:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774723/real 1775774723] req@ffff8de1c5683b80 x1862023612564096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774723.904807:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612564096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774723.904828:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774723.904831:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774723.904833:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774724.863863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774725.887861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774726.911877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774727.935937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774728.959866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774729.023878:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774729.023892:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774729.023929:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774729.023942:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10700 00000100:00080000:1.0:1775774729.023957:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774729.023967:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774729.024034:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612564224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774729.024071:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774729.024075:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774729.024078:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774729.024083:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10700 00000100:00080000:1.0:1775774729.024106:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774729.024111:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774729.024123:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774729.024180:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612564352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774729.024194:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774729.024200:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775774729.024202:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612564224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774729.024203:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774729.024214:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10700 00000100:00080000:1.0:1775774729.024219:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774729.024223:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774729.024229:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774729.024242:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612564480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774729.024258:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774729.024262:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774729.024264:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774729.024269:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10700 00000100:00080000:1.0:1775774729.024284:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775774729.024290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774729.024296:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774729.024306:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774729.024327:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612564608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774729.024334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774729/real 1775774729] req@ffff8de1c2e14e00 x1862023612564224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774729.024363:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774729.024367:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774729.024371:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774729.024372:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612564224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774729.024383:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10700 00000100:00080000:1.0:1775774729.024391:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774729.024394:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774729.024401:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775774729.024402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774729.024413:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774729.024421:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612564736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774729.024422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612564224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774729.024459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774729.024483:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774729.024496:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774729/real 1775774729] req@ffff8de1c2e14a80 x1862023612564352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774729.024516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612564352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774729.024528:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774729.024533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774729.024538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774729.024547:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774729.024577:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774729.024592:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774729/real 1775774729] req@ffff8de1c2e17480 x1862023612564480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774729.024611:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612564480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774729.024621:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774729.024624:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774729.024627:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774729.024633:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774729.024654:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774729.024663:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774729/real 1775774729] req@ffff8de1c2e14700 x1862023612564608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774729.024673:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612564608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774729.024680:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774729.024683:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774729.024685:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774729.024690:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774729.024704:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774729.024711:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774729/real 1775774729] req@ffff8de1c2e15500 x1862023612564736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774729.024762:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612564736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774729.024770:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774729.024773:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774729.024776:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774729.983964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774731.007847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774732.031857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774733.055890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774734.079940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774734.143835:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774734.143845:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774734.143850:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774734.143862:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10705 00000100:00080000:3.0:1775774734.143876:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774734.143885:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774734.143936:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612564864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774734.143966:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774734.143970:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774734.143971:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774734.143975:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10705 00000100:00080000:3.0:1775774734.143979:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774734.143981:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774734.143992:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774734.144001:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612564992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774734.144008:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774734.144011:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774734.144012:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774734.144015:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10705 00000100:00080000:3.0:1775774734.144017:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774734.144026:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774734.144030:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774734.144038:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612565120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774734.144044:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774734.144046:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774734.144047:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774734.144051:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10705 00000100:00080000:3.0:1775774734.144069:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774734.144074:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774734.144082:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612564864:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774734.144083:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774734.144102:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612565248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774734.144112:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774734.144115:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774734.144117:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774734.144121:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10705 00000100:00080000:3.0:1775774734.144123:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774734.144126:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774734.144130:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774734.144139:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612565376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774734.144189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774734.144209:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774734.144233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774734.144247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774735.103939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774736.127855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774737.151892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775774737.216033:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775774737.216074:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775774737.216091:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774737.216135:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774737.216143:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774737.216151:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774737.216159:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775774737.216260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774734/real 1775774737] req@ffff8de1c7af5f80 x1862023612565248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774737.216288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612565248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774737.216300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774737.216305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774737.216311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774737.216319:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774734/real 1775774737] req@ffff8de1c7af5880 x1862023612565376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774737.216331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612565376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774737.216339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774737.216343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774737.216346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565376:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774737.216354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774734/real 1775774737] req@ffff8de1c7af4a80 x1862023612564864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774737.216366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612564864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774737.216380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774737.216383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774737.216386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612564864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774737.216392:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774734/real 1775774737] req@ffff8de1c7af5500 x1862023612564992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774737.216404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612564992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774737.216410:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774737.216414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774737.216417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612564992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774737.216423:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774734/real 1775774737] req@ffff8de1c7af4380 x1862023612565120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774737.216433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612565120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774737.216440:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774737.216443:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774737.216446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565120:192.168.201.137@tcp:38:kworker.0 00010000:00010000:3.0:1775774738.175844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774739.199859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774739.263798:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774739.263806:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774739.263810:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774739.263818:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10711 00000100:00080000:3.0:1775774739.263828:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774739.263834:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774739.263864:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612565504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774739.263887:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774739.263889:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774739.263891:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774739.263894:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10711 00000100:00080000:3.0:1775774739.263896:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774739.263898:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774739.263906:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774739.263915:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612565632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774739.263923:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774739.263925:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774739.263927:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774739.263929:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10711 00000100:00080000:3.0:1775774739.263931:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774739.263933:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774739.263936:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774739.263945:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612565760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774739.263952:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612565504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774739.263960:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774739.263994:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774739.263996:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774739.264002:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10711 00000100:00080000:3.0:1775774739.264007:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774739.264011:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774739.264017:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774739.264034:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612565888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774739.264036:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774739.264048:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774739.264052:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774739.264055:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774739.264059:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10711 00000100:00080000:3.0:1775774739.264065:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774739.264069:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774739.264074:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774739.264082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774739/real 1775774739] req@ffff8de1c7af7800 x1862023612565504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774739.264087:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612566016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774739.264123:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612565504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774739.264135:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774739.264140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774739.264151:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612565504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774739.264160:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774739.264186:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774739.264201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774739/real 1775774739] req@ffff8de1c7af7100 x1862023612565632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774739.264215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612565632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774739.264224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774739.264227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774739.264231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774739.264259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774739.264286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774739.264297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774739/real 1775774739] req@ffff8de1c7af5180 x1862023612565760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774739.264310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612565760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774739.264325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774739.264329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774739.264332:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774739.264339:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774739.264360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774739.264373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774739/real 1775774739] req@ffff8de1c7af4380 x1862023612565888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774739.264385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612565888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774739.264394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774739.264397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774739.264400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612565888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774739.264406:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774739.264425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774739.264437:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774739/real 1775774739] req@ffff8de1c7af5500 x1862023612566016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774739.264449:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612566016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774739.264457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774739.264460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774739.264464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774740.223832:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774741.247860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774742.271949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774743.295883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774744.319900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774744.383891:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774744.383902:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774744.383907:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774744.383917:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10716 00000100:00080000:1.0:1775774744.383932:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774744.383939:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774744.383991:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612566144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774744.384018:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774744.384021:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774744.384022:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774744.384025:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10716 00000100:00080000:1.0:1775774744.384027:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774744.384030:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774744.384042:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774744.384057:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612566272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774744.384067:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612566144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774744.384073:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774744.384078:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774744.384080:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774744.384086:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10716 00000100:00080000:1.0:1775774744.384091:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774744.384095:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774744.384101:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774744.384113:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612566400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774744.384120:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774744.384124:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774744.384125:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774744.384128:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10716 00000100:00080000:1.0:1775774744.384133:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774744.384135:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774744.384139:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774744.384144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774744.384148:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612566528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774744.384156:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774744.384158:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774744.384160:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774744.384163:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10716 00000100:00080000:1.0:1775774744.384168:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774744.384170:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774744.384173:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774744.384181:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612566656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774744.384190:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774744/real 1775774744] req@ffff8de1c2e17800 x1862023612566144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774744.384208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612566144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774744.384217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774744.384221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774744.384224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612566144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774744.384247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774744.384263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774744.384272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774744/real 1775774744] req@ffff8de1c2e16a00 x1862023612566272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774744.384280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612566272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774744.384285:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774744.384287:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774744.384289:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774744.384303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774744.384316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774744.384328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774744/real 1775774744] req@ffff8de1c2e16680 x1862023612566400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774744.384336:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612566400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774744.384342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774744.384344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774744.384346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774744.384350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774744.384361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774744.384367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774744/real 1775774744] req@ffff8de1c2e14380 x1862023612566528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774744.384374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612566528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774744.384379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774744.384380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774744.384382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774744.384385:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774744.384395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774744.384400:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774744/real 1775774744] req@ffff8de1c2e17100 x1862023612566656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774744.384407:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612566656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774744.384412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774744.384415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774744.384417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774745.343968:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774746.367930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774747.391984:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774748.415839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774749.439912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774749.503854:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774749.503862:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774749.503866:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774749.503874:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10721 00000100:00080000:0.0:1775774749.503883:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774749.503889:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774749.503921:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612566784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774749.503945:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774749.503948:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774749.503950:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774749.503952:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10721 00000100:00080000:0.0:1775774749.503955:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774749.503957:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774749.503964:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774749.503972:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612566912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774749.503979:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774749.503982:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774749.503984:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774749.503986:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10721 00000100:00080000:0.0:1775774749.503989:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774749.503991:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774749.503994:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774749.504000:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612567040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774749.504005:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612566784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774749.504009:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774749.504012:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774749.504014:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774749.504017:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10721 00000100:00080000:0.0:1775774749.504019:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774749.504021:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774749.504025:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774749.504032:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612567168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774749.504038:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774749.504040:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774749.504041:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774749.504044:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10721 00000100:00080000:0.0:1775774749.504046:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774749.504048:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774749.504051:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774749.504058:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612567296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774749.504068:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774749.504105:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774749/real 1775774749] req@ffff8de1c5681c00 x1862023612566784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774749.504119:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612566784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774749.504127:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774749.504130:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774749.504133:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612566784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774749.504138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774749.504154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774749.504161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774749/real 1775774749] req@ffff8de1c5681f80 x1862023612566912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774749.504173:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612566912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774749.504178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774749.504180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774749.504182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612566912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774749.504200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774749.504211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774749.504216:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774749/real 1775774749] req@ffff8de1c5682a00 x1862023612567040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774749.504231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612567040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774749.504236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774749.504238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774749.504240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774749.504244:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774749.504255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774749.504260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774749/real 1775774749] req@ffff8de1c5680380 x1862023612567168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774749.504267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612567168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774749.504276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774749.504278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774749.504280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774749.504284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774749.504293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774749.504298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774749/real 1775774749] req@ffff8de1c5680000 x1862023612567296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774749.504304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612567296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774749.504309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774749.504311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774749.504313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774750.463843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774751.487881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774752.511887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774753.535891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774754.559904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774754.623800:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774754.623809:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774754.623813:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774754.623823:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10726 00000100:00080000:0.0:1775774754.623834:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774754.623840:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774754.623882:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612567424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774754.623918:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774754.623933:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774754.623936:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774754.623942:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10726 00000100:00080000:0.0:1775774754.623949:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774754.623956:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774754.623969:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774754.623972:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612567424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774754.623990:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612567552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774754.624003:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774754.624006:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774754.624009:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774754.624012:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10726 00000100:00080000:0.0:1775774754.624019:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774754.624023:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774754.624028:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774754.624040:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612567680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774754.624049:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774754.624058:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774754.624062:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774754.624064:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774754.624070:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10726 00000100:00080000:0.0:1775774754.624075:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774754.624079:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774754.624085:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774754.624097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774754/real 1775774754] req@ffff8de1c5683480 x1862023612567424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774754.624098:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612567808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774754.624144:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774754.624148:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774754.624150:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774754.624155:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612567424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774754.624156:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10726 00000100:00080000:0.0:1775774754.624163:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774754.624170:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774754.624179:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774754.624194:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612567936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774754.624208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774754.624215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774754.624221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612567424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774754.624246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774754.624270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774754.624281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774754/real 1775774754] req@ffff8de1c5681500 x1862023612567552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774754.624293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612567552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774754.624300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774754.624303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774754.624306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774754.624311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774754.624325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774754.624343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774754/real 1775774754] req@ffff8de1c5681880 x1862023612567680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774754.624355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612567680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774754.624362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774754.624365:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774754.624367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774754.624373:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774754.624389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774754.624396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774754/real 1775774754] req@ffff8de1c5680e00 x1862023612567808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774754.624406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612567808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774754.624413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774754.624415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774754.624418:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774754.624423:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774754.624435:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774754.624442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774754/real 1775774754] req@ffff8de1c5683800 x1862023612567936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774754.624452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612567936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774754.624458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774754.624461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774754.624463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612567936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774755.583839:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774756.607864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774757.631848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774758.655836:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774759.679911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774759.743804:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774759.743813:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774759.743817:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774759.743826:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10731 00000100:00080000:0.0:1775774759.743836:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774759.743842:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774759.743876:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612568064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774759.743904:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774759.743907:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774759.743909:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774759.743917:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10731 00000100:00080000:0.0:1775774759.743920:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774759.743925:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774759.743934:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774759.743945:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612568192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774759.743953:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774759.743955:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774759.743957:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774759.743960:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10731 00000100:00080000:0.0:1775774759.743962:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774759.743965:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774759.743969:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774759.743976:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612568064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774759.743984:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612568320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774759.744006:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774759.744008:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774759.744009:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774759.744012:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10731 00000100:00080000:0.0:1775774759.744015:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774759.744017:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774759.744023:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774759.744034:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612568448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774759.744041:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774759.744044:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774759.744046:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774759.744049:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10731 00000100:00080000:0.0:1775774759.744053:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774759.744058:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774759.744062:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774759.744070:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612568576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774759.744089:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774759.744202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774759/real 1775774759] req@ffff8de1c5683800 x1862023612568064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774759.744220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612568064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774759.744228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774759.744355:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774759.744359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612568064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774759.744368:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774759.744450:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774759.744467:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774759/real 1775774759] req@ffff8de1c5680e00 x1862023612568192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774759.744476:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612568192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774759.744481:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774759.744484:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774759.744486:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774759.744510:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774759.744524:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774759.744530:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774759/real 1775774759] req@ffff8de1c5681880 x1862023612568320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774759.744543:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612568320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774759.744548:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774759.744550:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774759.744552:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774759.744556:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774759.744566:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774759.744572:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774759/real 1775774759] req@ffff8de1c5681500 x1862023612568448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774759.744579:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612568448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774759.744584:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774759.744586:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774759.744588:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774759.744591:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774759.744624:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774759.744632:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774759/real 1775774759] req@ffff8de1c5683480 x1862023612568576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774759.744640:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612568576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774759.744650:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774759.744652:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774759.744655:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774760.703993:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774761.727864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774762.751880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774763.775850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774764.799873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774764.863865:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774764.863873:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774764.863877:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774764.863884:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10736 00000100:00080000:3.0:1775774764.863894:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774764.863899:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774764.863932:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612568704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774764.863962:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774764.863967:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774764.863969:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774764.863974:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10736 00000100:00080000:3.0:1775774764.863978:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774764.863982:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774764.863991:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774764.863997:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612568704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774764.864005:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612568832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774764.864022:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774764.864026:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774764.864028:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774764.864032:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10736 00000100:00080000:3.0:1775774764.864036:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774764.864040:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774764.864045:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775774764.864052:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774764.864072:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612568960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774764.864084:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774764.864088:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774764.864090:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774764.864093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774764/real 1775774764] req@ffff8de1c7af4a80 x1862023612568704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774764.864097:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10736 00000100:00080000:3.0:1775774764.864104:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774764.864110:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774764.864121:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774764.864128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612568704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774764.864136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775774764.864137:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612569088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774764.864141:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774764.864148:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612568704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774764.864161:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774764.864165:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774764.864167:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774764.864171:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10736 00000100:00080000:3.0:1775774764.864175:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774764.864176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568832:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774764.864181:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774764.864187:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774764.864199:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612569216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774764.864211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774764.864228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774764/real 1775774764] req@ffff8de1c7af5880 x1862023612568832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774764.864242:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612568832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774764.864251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774764.864253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774764.864256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774764.864260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774764.864277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774764.864284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774764/real 1775774764] req@ffff8de1c7af5f80 x1862023612568960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774764.864292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612568960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774764.864301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774764.864303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774764.864305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612568960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774764.864308:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774764.864318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774764.864332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774764/real 1775774764] req@ffff8de1c7af4e00 x1862023612569088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774764.864340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612569088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774764.864345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774764.864347:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774764.864349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774764.864362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774764.864373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774764.864379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774764/real 1775774764] req@ffff8de1c7af6d80 x1862023612569216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774764.864386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612569216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774764.864391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774764.864392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774764.864395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774765.823861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774766.847900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774767.871853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774768.895900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774769.919852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774769.983842:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774769.983850:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774769.983854:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774769.983862:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10741 00000100:00080000:0.0:1775774769.983872:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774769.983877:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774769.983909:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612569344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774769.983932:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774769.983935:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774769.983936:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774769.983939:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10741 00000100:00080000:0.0:1775774769.983941:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774769.983944:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774769.983951:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774769.983959:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612569472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774769.983968:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775774769.983970:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612569344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774769.983971:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774769.983974:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774769.983981:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10741 00000100:00080000:0.0:1775774769.983984:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774769.983986:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774769.983989:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774769.983997:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612569600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774769.984003:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774769.984005:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774769.984007:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774769.984009:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10741 00000100:00080000:0.0:1775774769.984012:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774769.984014:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774769.984017:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774769.984024:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612569728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774769.984029:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774769.984032:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774769.984034:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774769.984037:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10741 00000100:00080000:0.0:1775774769.984041:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775774769.984057:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774769.984061:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774769.984067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774769.984081:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612569856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774769.984097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774769/real 1775774769] req@ffff8de1c5680000 x1862023612569344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774769.984119:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612569344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774769.984129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774769.984133:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774769.984137:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612569344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774769.984162:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774769.984186:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774769.984199:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774769/real 1775774769] req@ffff8de1c5680380 x1862023612569472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774769.984211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612569472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774769.984225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774769.984229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774769.984232:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774769.984238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774769.984256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774769.984275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774769/real 1775774769] req@ffff8de1c5682a00 x1862023612569600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774769.984285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612569600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774769.984293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774769.984296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774769.984299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774769.984305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774769.984333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774769.984346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774769/real 1775774769] req@ffff8de1c5681f80 x1862023612569728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774769.984357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612569728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774769.984365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774769.984368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774769.984371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774769.984377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774769.984396:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774769.984405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774769/real 1775774769] req@ffff8de1c5681c00 x1862023612569856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774769.984416:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612569856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774769.984453:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774769.984456:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774769.984459:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612569856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774770.943874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774771.967883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774772.991857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774774.015879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774775.039891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774775.103842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774775.103853:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774775.103858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774775.103869:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10746 00000100:00080000:1.0:1775774775.103881:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774775.103889:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774775.103926:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612569984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774775.103950:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774775.103953:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774775.103954:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774775.103957:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10746 00000100:00080000:1.0:1775774775.103960:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774775.103964:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774775.103972:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774775.103984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612569984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774775.103985:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612570112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774775.103999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774775.104001:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774775.104002:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774775.104005:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10746 00000100:00080000:1.0:1775774775.104007:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774775.104009:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774775.104012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774775.104020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612570240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774775.104026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774775.104029:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774775.104030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774775.104032:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10746 00000100:00080000:1.0:1775774775.104038:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774775.104040:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774775.104044:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774775.104048:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774775.104054:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612570368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774775.104061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774775.104064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774775.104065:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774775.104076:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10746 00000100:00080000:1.0:1775774775.104079:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775774775.104080:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774775/real 1775774775] req@ffff8de1c2e17b80 x1862023612569984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774775.104086:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774775.104093:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774775.104102:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612570496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774775.104114:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612569984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774775.104127:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774775.104130:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774775.104133:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612569984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774775.104153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774775.104170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774775.104177:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774775/real 1775774775] req@ffff8de1c2e17100 x1862023612570112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774775.104186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612570112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774775.104191:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774775.104193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774775.104195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774775.104199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774775.104209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774775.104214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774775/real 1775774775] req@ffff8de1c2e14380 x1862023612570240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774775.104221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612570240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774775.104226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774775.104227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774775.104229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774775.104232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774775.104241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774775.104246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774775/real 1775774775] req@ffff8de1c2e16680 x1862023612570368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774775.104254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612570368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774775.104259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774775.104261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774775.104262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774775.104266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774775.104275:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774775.104280:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774775/real 1775774775] req@ffff8de1c2e16a00 x1862023612570496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774775.104286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612570496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774775.104290:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774775.104292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774775.104293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774776.063911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774777.087856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774778.112003:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774779.135899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774780.159825:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774780.223791:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774780.223799:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774780.223803:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774780.223811:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10751 00000100:00080000:1.0:1775774780.223821:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774780.223826:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774780.223856:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612570624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774780.223878:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774780.223881:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774780.223883:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774780.223887:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10751 00000100:00080000:1.0:1775774780.223891:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774780.223895:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774780.223905:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774780.223921:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612570752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774780.223922:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612570624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774780.223940:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774780.223944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774780.223946:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774780.223951:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10751 00000100:00080000:1.0:1775774780.223954:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774780.223958:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774780.223962:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774780.223972:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612570880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774780.223979:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774780.223982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774780.223983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774780.223986:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10751 00000100:00080000:1.0:1775774780.223989:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774780.223993:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775774780.223994:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775774780.223998:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774780.224006:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612571008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774780.224013:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774780.224015:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774780.224016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774780.224019:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10751 00000100:00080000:1.0:1775774780.224021:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774780.224023:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774780.224027:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774780.224037:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774780/real 1775774780] req@ffff8de1c2e17800 x1862023612570624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774780.224038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612571136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774780.224080:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612570624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774780.224093:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774780.224098:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774780.224103:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612570624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774780.224125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774780.224150:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774780.224162:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774780/real 1775774780] req@ffff8de1c2e15500 x1862023612570752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774780.224176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612570752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774780.224190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774780.224194:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774780.224197:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774780.224205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774780.224226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774780.224237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774780/real 1775774780] req@ffff8de1c2e14700 x1862023612570880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774780.224264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612570880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774780.224274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774780.224277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774780.224281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612570880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774780.224288:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774780.224308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774780.224319:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774780/real 1775774780] req@ffff8de1c2e17480 x1862023612571008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774780.224331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612571008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774780.224340:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774780.224343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774780.224347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774780.224353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774780.224372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774780.224382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774780/real 1775774780] req@ffff8de1c2e14a80 x1862023612571136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774780.224395:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612571136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774780.224402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774780.224406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774780.224409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774781.183926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774782.207876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774783.231861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774784.255915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774785.279844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774785.343837:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774785.343847:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774785.343852:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774785.343862:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10757 00000100:00080000:0.0:1775774785.343873:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774785.343881:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774785.343918:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612571264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774785.343943:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774785.343945:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774785.343947:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774785.343950:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10757 00000100:00080000:0.0:1775774785.343954:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774785.343956:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774785.343964:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774785.343973:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612571392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774785.343981:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774785.343983:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774785.343985:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774785.343987:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10757 00000100:00080000:0.0:1775774785.343989:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774785.343991:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774785.343994:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774785.343999:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612571520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774785.344006:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612571264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774785.344009:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774785.344015:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774785.344017:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774785.344022:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10757 00000100:00080000:0.0:1775774785.344025:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774785.344028:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774785.344034:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774785.344047:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612571648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774785.344058:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774785.344061:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774785.344063:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774785.344069:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10757 00000800:00000100:3.0:1775774785.344069:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774785.344077:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774785.344082:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774785.344088:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774785.344103:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612571776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774785.344106:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774785/real 1775774785] req@ffff8de1c5683b80 x1862023612571264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774785.344138:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612571264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774785.344146:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774785.344149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774785.344153:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612571264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774785.344182:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774785.344202:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774785.344211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774785/real 1775774785] req@ffff8de1c5682300 x1862023612571392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774785.344219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612571392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774785.344225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774785.344227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774785.344229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774785.344248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774785.344259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774785.344264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774785/real 1775774785] req@ffff8de1c5680700 x1862023612571520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774785.344276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612571520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774785.344281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774785.344283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774785.344285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774785.344288:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774785.344298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774785.344303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774785/real 1775774785] req@ffff8de1c5682d80 x1862023612571648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774785.344310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612571648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774785.344315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774785.344316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774785.344326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774785.344330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774785.344341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774785.344347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774785/real 1775774785] req@ffff8de1c5682680 x1862023612571776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774785.344354:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612571776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774785.344363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774785.344365:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774785.344367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612571776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774786.303854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774787.327848:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774788.351885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774789.376007:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774790.399918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774790.463853:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774790.463862:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774790.463866:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774790.463873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10762 00000100:00080000:1.0:1775774790.463883:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774790.463889:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774790.463922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612571904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774790.463945:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774790.463948:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774790.463949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774790.463952:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10762 00000100:00080000:1.0:1775774790.463955:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774790.463958:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774790.463965:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774790.463976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612572032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774790.463984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774790.463986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774790.463988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774790.463992:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612571904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774790.463993:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10762 00000100:00080000:1.0:1775774790.463998:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774790.464003:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774790.464006:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774790.464013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612572160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774790.464019:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774790.464021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774790.464022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774790.464025:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10762 00000100:00080000:1.0:1775774790.464027:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774790.464030:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774790.464033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774790.464039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612572288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774790.464049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774790.464052:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774790.464055:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775774790.464056:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774790.464060:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10762 00000100:00080000:1.0:1775774790.464063:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774790.464066:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774790.464069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774790.464094:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612572416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774790.464115:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774790/real 1775774790] req@ffff8de1c2e14e00 x1862023612571904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774790.464138:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612571904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774790.464149:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774790.464153:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774790.464156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612571904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774790.464176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774790.464195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774790.464204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774790/real 1775774790] req@ffff8de1c2e14a80 x1862023612572032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774790.464213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612572032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774790.464218:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774790.464221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774790.464223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774790.464227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774790.464241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774790.464251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774790/real 1775774790] req@ffff8de1c2e17480 x1862023612572160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774790.464263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612572160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774790.464271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774790.464275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774790.464278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774790.464285:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774790.464305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774790.464315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774790/real 1775774790] req@ffff8de1c2e14700 x1862023612572288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774790.464323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612572288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774790.464329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774790.464331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774790.464333:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774790.464337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774790.464349:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774790.464355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774790/real 1775774790] req@ffff8de1c2e15500 x1862023612572416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774790.464362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612572416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774790.464376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774790.464378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774790.464380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774791.423955:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774792.447873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774793.471858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774794.495884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774795.519907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774795.583793:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774795.583803:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774795.583807:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774795.583818:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10767 00000100:00080000:1.0:1775774795.583829:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774795.583836:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774795.583870:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612572544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774795.583904:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774795.583907:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774795.583910:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774795.583915:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10767 00000100:00080000:1.0:1775774795.583918:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774795.583922:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774795.583932:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774795.583946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612572672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774795.583952:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612572544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774795.583969:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774795.583972:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774795.583974:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774795.583979:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10767 00000100:00080000:1.0:1775774795.584003:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774795.584009:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774795.584015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774795.584031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612572800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774795.584034:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774795.584046:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774795.584050:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774795.584052:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774795.584057:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10767 00000100:00080000:1.0:1775774795.584062:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774795.584067:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774795.584074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774795.584074:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774795/real 1775774795] req@ffff8de1c2e17800 x1862023612572544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774795.584090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612572928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774795.584098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774795.584102:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1775774795.584102:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612572544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774795.584104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774795.584111:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10767 00000100:00080000:1.0:1775774795.584115:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774795.584121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774795.584125:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775774795.584126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1775774795.584132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612573056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774795.584135:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774795.584146:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612572544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774795.584186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774795.584217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774795.584234:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774795/real 1775774795] req@ffff8de1c2e16a00 x1862023612572672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774795.584248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612572672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774795.584255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774795.584258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774795.584260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774795.584265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774795.584280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774795.584288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774795/real 1775774795] req@ffff8de1c2e16680 x1862023612572800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774795.584296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612572800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774795.584301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774795.584303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774795.584305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774795.584311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774795.584332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774795.584353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774795/real 1775774795] req@ffff8de1c2e14380 x1862023612572928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774795.584366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612572928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774795.584372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774795.584375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774795.584378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612572928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774795.584384:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774795.584403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774795.584412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774795/real 1775774795] req@ffff8de1c2e17100 x1862023612573056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774795.584431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612573056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774795.584440:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774795.584444:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774795.584447:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774796.543872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774797.567886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774798.591858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774799.615864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774800.639856:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775774800.703863:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774800.703871:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775774800.703875:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774800.703883:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10772 00000100:00080000:2.0:1775774800.703918:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774800.703924:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774800.703958:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612573184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774800.703982:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774800.703985:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775774800.703987:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774800.703989:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10772 00000100:00080000:2.0:1775774800.703992:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774800.703994:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774800.704002:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774800.704013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612573312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774800.704022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775774800.704023:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612573184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775774800.704026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775774800.704030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774800.704034:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10772 00000100:00080000:2.0:1775774800.704036:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774800.704038:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774800.704042:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774800.704051:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612573440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774800.704057:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774800.704060:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775774800.704061:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774800.704064:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10772 00000100:00080000:2.0:1775774800.704073:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775774800.704076:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774800.704078:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774800.704085:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612573568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774800.704093:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774800.704097:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775774800.704099:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775774800.704105:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10772 00000100:00080000:2.0:1775774800.704110:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775774800.704114:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573312:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775774800.704117:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775774800.704127:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774800.704142:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612573696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774800.704148:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774800.704175:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774800.704193:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774801.663927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774802.687844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774803.711833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775774803.775992:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775774803.776028:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775774803.776041:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774803.776085:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774803.776094:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774803.776102:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775774803.776109:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775774803.776204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774800/real 1775774803] req@ffff8de1d0f2f100 x1862023612573696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774803.776236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612573696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774803.776248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774803.776253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774803.776257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573696:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774803.776265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774800/real 1775774803] req@ffff8de1d0f2e300 x1862023612573312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774803.776280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612573312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774803.776287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774803.776291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774803.776295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774803.776302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774800/real 1775774803] req@ffff8de1d0f2ca80 x1862023612573440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774803.776314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612573440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774803.776323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774803.776327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774803.776330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774803.776337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774800/real 1775774803] req@ffff8de1d0f2c700 x1862023612573568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774803.776350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612573568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774803.776358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774803.776362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774803.776365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774803.776371:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774800/real 1775774803] req@ffff8de1d0f2e680 x1862023612573184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774803.776384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612573184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774803.776391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774803.776394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774803.776397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612573184:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775774804.735865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774805.759904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774805.823915:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774805.823925:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774805.823929:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774805.823939:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10777 00000100:00080000:0.0:1775774805.823950:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774805.823956:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774805.823988:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612573824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774805.824016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774805.824020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774805.824022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774805.824026:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10777 00000100:00080000:0.0:1775774805.824029:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774805.824033:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774805.824043:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774805.824057:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612573952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774805.824069:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775774805.824072:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612573824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774805.824074:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774805.824078:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774805.824085:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10777 00000100:00080000:0.0:1775774805.824089:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774805.824093:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774805.824099:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774805.824113:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612574080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774805.824123:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774805.824126:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774805.824128:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774805.824132:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10777 00000100:00080000:0.0:1775774805.824137:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774805.824141:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774805.824147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774805.824148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774805.824164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612574208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774805.824175:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774805.824179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774805.824181:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774805.824186:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10777 00000100:00100000:3.0:1775774805.824191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774805/real 1775774805] req@ffff8de1c5682680 x1862023612573824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774805.824192:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774805.824201:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774805.824211:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774805.824225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612573824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774805.824226:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612574336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774805.824261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774805.824271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774805.824278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612573824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774805.824304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774805.824327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774805.824339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774805/real 1775774805] req@ffff8de1c5682d80 x1862023612573952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774805.824352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612573952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774805.824360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774805.824364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774805.824367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612573952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774805.824373:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774805.824390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774805.824399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774805/real 1775774805] req@ffff8de1c5680700 x1862023612574080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774805.824410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612574080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774805.824418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774805.824422:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774805.824425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774805.824431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774805.824447:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774805.824456:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774805/real 1775774805] req@ffff8de1c5682300 x1862023612574208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774805.824467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612574208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774805.824476:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774805.824479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774805.824483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774805.824488:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774805.824503:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774805.824511:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774805/real 1775774805] req@ffff8de1c5683b80 x1862023612574336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774805.824523:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612574336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774805.824603:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774805.824608:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774805.824611:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774806.783912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774807.807824:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774808.831852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774809.855860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774810.879875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774810.943855:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774810.943866:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774810.943872:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774810.943884:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10782 00000100:00080000:3.0:1775774810.943897:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774810.943906:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774810.943954:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612574464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774810.943992:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774810.943997:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774810.944000:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774810.944007:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10782 00000100:00080000:3.0:1775774810.944013:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774810.944016:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774810.944025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612574464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774810.944028:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774810.944042:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612574592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774810.944051:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774810.944054:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774810.944056:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774810.944058:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10782 00000100:00080000:3.0:1775774810.944061:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774810.944063:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774810.944067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774810.944075:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612574720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774810.944082:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774810.944085:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774810.944087:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774810.944090:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10782 00000100:00080000:3.0:1775774810.944093:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774810.944096:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774810.944100:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774810.944107:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612574848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774810.944114:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774810.944119:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774810.944122:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774810.944123:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774810.944126:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10782 00000100:00080000:3.0:1775774810.944129:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774810.944131:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774810.944134:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774810.944141:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612574976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774810.944162:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774810/real 1775774810] req@ffff8de1c7af4000 x1862023612574464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774810.944179:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612574464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774810.944187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774810.944191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774810.944194:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612574464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774810.944217:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774810.944234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774810.944242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774810/real 1775774810] req@ffff8de1c7af6300 x1862023612574592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774810.944250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612574592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774810.944255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774810.944258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774810.944260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774810.944263:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774810.944273:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774810.944279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774810/real 1775774810] req@ffff8de1c7af5c00 x1862023612574720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774810.944286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612574720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774810.944292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774810.944293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774810.944295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774810.944298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774810.944308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774810.944313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774810/real 1775774810] req@ffff8de1c7af7b80 x1862023612574848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774810.944319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612574848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774810.944325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774810.944327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774810.944328:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774810.944332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774810.944342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774810.944346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774810/real 1775774810] req@ffff8de1c7af7480 x1862023612574976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774810.944353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612574976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774810.944358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774810.944361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774810.944363:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612574976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774811.903837:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774812.927901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774813.951857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774814.975893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774815.999935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774816.063920:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774816.063931:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774816.063937:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774816.063965:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10787 00000100:00080000:0.0:1775774816.063978:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774816.063985:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774816.064024:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612575104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774816.064073:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774816.064078:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774816.064081:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774816.064097:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10787 00000100:00080000:0.0:1775774816.064102:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774816.064105:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774816.064115:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774816.064129:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612575232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774816.064141:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774816.064145:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774816.064149:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774816.064156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612575104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774816.064157:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10787 00000100:00080000:0.0:1775774816.064178:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774816.064185:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774816.064190:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774816.064201:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612575360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774816.064222:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774816.064227:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774816.064230:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774816.064235:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10787 00000100:00080000:0.0:1775774816.064239:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774816.064245:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774816.064252:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774816.064269:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612575488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774816.064274:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774816.064291:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774816.064296:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774816.064299:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774816.064306:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10787 00000100:00080000:0.0:1775774816.064313:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775774816.064318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774816/real 1775774816] req@ffff8de1c5681c00 x1862023612575104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774816.064320:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774816.064333:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774816.064347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612575104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774816.064356:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612575616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774816.064384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774816.064394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774816.064402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612575104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774816.064433:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774816.064458:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774816.064470:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774816/real 1775774816] req@ffff8de1c5681f80 x1862023612575232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774816.064481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612575232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774816.064488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774816.064491:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774816.064494:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774816.064499:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774816.064514:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774816.064522:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774816/real 1775774816] req@ffff8de1c5682a00 x1862023612575360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774816.064531:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612575360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774816.064538:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774816.064540:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774816.064543:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774816.064548:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774816.064561:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774816.064568:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774816/real 1775774816] req@ffff8de1c5680380 x1862023612575488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774816.064578:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612575488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774816.064583:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774816.064586:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774816.064588:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774816.064593:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774816.064605:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774816.064612:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774816/real 1775774816] req@ffff8de1c5680000 x1862023612575616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774816.064621:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612575616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774816.064648:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774816.064651:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774816.064654:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774817.023866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774818.047914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774819.071967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774820.095881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774821.119912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774821.183910:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774821.183921:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774821.183926:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774821.183938:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10792 00000100:00080000:0.0:1775774821.183953:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774821.183961:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774821.184009:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612575744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774821.184034:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774821.184037:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774821.184039:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774821.184047:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10792 00000100:00080000:0.0:1775774821.184049:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774821.184052:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774821.184063:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774821.184073:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612575872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774821.184081:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774821.184086:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774821.184087:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775774821.184087:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612575744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774821.184095:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10792 00000100:00080000:0.0:1775774821.184100:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774821.184104:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774821.184107:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774821.184115:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612576000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774821.184121:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774821.184124:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774821.184126:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774821.184128:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10792 00000100:00080000:0.0:1775774821.184130:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774821.184133:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774821.184137:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774821.184144:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612576128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774821.184149:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774821.184151:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774821.184152:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774821.184155:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10792 00000100:00080000:0.0:1775774821.184158:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774821.184160:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774821.184164:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774821.184168:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612576256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774821.184185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774821.184228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774821/real 1775774821] req@ffff8de1c5683480 x1862023612575744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774821.184245:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612575744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774821.184253:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774821.184256:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774821.184260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612575744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774821.184282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774821.184307:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774821.184316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774821/real 1775774821] req@ffff8de1c5681500 x1862023612575872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774821.184325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612575872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774821.184330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774821.184333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774821.184335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612575872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774821.184339:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774821.184350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774821.184355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774821/real 1775774821] req@ffff8de1c5681880 x1862023612576000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774821.184367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612576000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774821.184372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774821.184374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774821.184376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774821.184379:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774821.184390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774821.184398:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774821/real 1775774821] req@ffff8de1c5680e00 x1862023612576128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774821.184410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612576128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774821.184418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774821.184422:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774821.184425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774821.184431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774821.184452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774821.184462:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774821/real 1775774821] req@ffff8de1c5683800 x1862023612576256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774821.184473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612576256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774821.184483:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774821.184486:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774821.184488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774822.143844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774823.167926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774824.191873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774825.215887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774826.239842:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774826.303851:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774826.303859:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774826.303863:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774826.303871:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10798 00000100:00080000:3.0:1775774826.303882:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774826.303888:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774826.303920:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612576384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774826.303944:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774826.303946:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774826.303948:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774826.303951:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10798 00000100:00080000:3.0:1775774826.303954:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774826.303957:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774826.303965:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774826.303976:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612576512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774826.303977:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612576384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774826.303996:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774826.303998:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774826.304000:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774826.304002:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10798 00000100:00080000:3.0:1775774826.304004:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774826.304006:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774826.304010:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774826.304017:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612576640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774826.304023:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774826.304025:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774826.304026:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774826.304028:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10798 00000100:00080000:3.0:1775774826.304031:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774826.304034:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774826.304037:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774826.304041:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774826.304051:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612576768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774826.304060:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774826.304064:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774826.304066:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774826.304070:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10798 00000100:00080000:3.0:1775774826.304076:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774826.304080:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774826/real 1775774826] req@ffff8de1c7af4700 x1862023612576384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774826.304083:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774826.304092:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774826.304109:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612576384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774826.304109:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612576896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774826.304140:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774826.304146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774826.304152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612576384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774826.304176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774826.304198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774826.304208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774826/real 1775774826] req@ffff8de1c7af6680 x1862023612576512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774826.304217:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612576512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774826.304222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774826.304226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774826.304228:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774826.304232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774826.304243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774826.304248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774826/real 1775774826] req@ffff8de1c7af6a00 x1862023612576640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774826.304259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612576640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774826.304264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774826.304266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774826.304268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774826.304271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774826.304280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774826.304285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774826/real 1775774826] req@ffff8de1c7af7480 x1862023612576768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774826.304292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612576768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774826.304296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774826.304298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774826.304300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774826.304303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774826.304312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774826.304316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774826/real 1775774826] req@ffff8de1c7af7b80 x1862023612576896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774826.304323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612576896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774826.304331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774826.304333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774826.304335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612576896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774827.263850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774828.287854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774829.311855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774830.335934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774831.359869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774831.423938:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774831.423945:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774831.423950:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774831.423958:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10803 00000100:00080000:0.0:1775774831.423968:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774831.423974:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774831.424005:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612577024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774831.424023:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774831.424025:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774831.424027:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774831.424032:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10803 00000100:00080000:0.0:1775774831.424035:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774831.424038:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774831.424046:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774831.424052:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612577024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774831.424060:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612577152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774831.424069:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774831.424072:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774831.424073:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774831.424076:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10803 00000100:00080000:0.0:1775774831.424078:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774831.424081:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774831.424084:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774831.424092:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612577280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774831.424098:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774831.424101:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774831.424102:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774831.424105:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10803 00000100:00080000:0.0:1775774831.424108:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775774831.424111:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774831.424114:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774831.424120:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774831.424130:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612577408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774831.424136:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774831.424139:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774831.424140:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774831.424145:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10803 00000100:00100000:3.0:1775774831.424146:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774831/real 1775774831] req@ffff8de1c5683800 x1862023612577024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774831.424148:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774831.424154:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774831.424161:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774831.424169:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612577024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774831.424172:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612577536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774831.424273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774831.424279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774831.424284:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612577024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774831.424310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774831.424339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774831.424353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774831/real 1775774831] req@ffff8de1c5680e00 x1862023612577152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774831.424386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612577152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774831.424514:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774831.424518:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774831.424521:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774831.424527:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774831.424586:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774831.424601:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774831/real 1775774831] req@ffff8de1c5681880 x1862023612577280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774831.424611:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612577280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774831.424616:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774831.424618:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774831.424621:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774831.424625:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774831.424638:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774831.424643:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774831/real 1775774831] req@ffff8de1c5681500 x1862023612577408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774831.424651:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612577408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774831.424655:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774831.424657:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774831.424660:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774831.424664:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774831.424673:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774831.424678:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774831/real 1775774831] req@ffff8de1c5683480 x1862023612577536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774831.424685:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612577536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774831.424690:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774831.424691:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774831.424693:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774832.383944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774833.407966:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774834.431894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774835.455852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774836.479842:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774836.543818:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774836.543826:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774836.543829:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774836.543837:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10808 00000100:00080000:0.0:1775774836.543847:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774836.543854:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774836.543886:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612577664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774836.543909:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774836.543911:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774836.543913:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774836.543916:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10808 00000100:00080000:0.0:1775774836.543919:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774836.543921:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774836.543929:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774836.543937:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612577792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774836.543945:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774836.543950:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775774836.543950:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612577664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774836.543951:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774836.543958:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10808 00000100:00080000:0.0:1775774836.543960:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774836.543963:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774836.543966:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774836.543974:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612577920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774836.543980:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774836.543983:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774836.543984:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774836.543987:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10808 00000100:00080000:0.0:1775774836.543990:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774836.543992:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774836.543995:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774836.544002:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612578048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774836.544007:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774836.544009:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774836.544012:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775774836.544013:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774836.544018:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10808 00000100:00080000:0.0:1775774836.544021:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774836.544024:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774836.544028:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774836.544035:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612578176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774836.544049:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774836/real 1775774836] req@ffff8de1c5680000 x1862023612577664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774836.544064:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612577664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774836.544072:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774836.544074:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774836.544077:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612577664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774836.544097:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774836.544113:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774836.544121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774836/real 1775774836] req@ffff8de1c5680380 x1862023612577792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774836.544129:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612577792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774836.544134:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774836.544137:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774836.544139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774836.544143:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774836.544153:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774836.544158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774836/real 1775774836] req@ffff8de1c5682a00 x1862023612577920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774836.544166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612577920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774836.544171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774836.544173:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774836.544175:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612577920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774836.544178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774836.544187:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774836.544193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774836/real 1775774836] req@ffff8de1c5681f80 x1862023612578048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774836.544201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612578048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774836.544206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774836.544207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774836.544209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774836.544212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774836.544222:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774836.544227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774836/real 1775774836] req@ffff8de1c5681c00 x1862023612578176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774836.544233:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612578176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774836.544238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774836.544240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774836.544242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774837.503885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774838.527885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774839.551874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774840.575904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774841.599909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774841.663847:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774841.663855:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774841.663859:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774841.663868:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10813 00000100:00080000:1.0:1775774841.663878:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774841.663884:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774841.663917:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612578304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774841.663940:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774841.663943:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774841.663944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774841.663948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10813 00000100:00080000:1.0:1775774841.663950:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774841.663952:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774841.663977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774841.663995:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612578432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774841.663999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612578304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774841.664015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774841.664017:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774841.664019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774841.664023:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10813 00000100:00080000:1.0:1775774841.664026:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774841.664028:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774841.664031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774841.664040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612578560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774841.664046:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774841.664049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774841.664051:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774841.664053:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10813 00000100:00080000:1.0:1775774841.664055:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774841.664057:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774841.664060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774841.664065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774841.664072:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612578688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774841.664079:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774841.664081:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774841.664083:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774841.664085:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10813 00000100:00080000:1.0:1775774841.664088:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774841.664091:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774841.664094:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774841.664101:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612578816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774841.664107:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774841/real 1775774841] req@ffff8de1c2e17b80 x1862023612578304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774841.664127:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612578304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774841.664136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774841.664139:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774841.664142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612578304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774841.664173:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774841.664217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774841.664226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774841/real 1775774841] req@ffff8de1c2e17100 x1862023612578432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774841.664235:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612578432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774841.664240:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774841.664242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774841.664244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774841.664248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774841.664259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774841.664264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774841/real 1775774841] req@ffff8de1c2e14380 x1862023612578560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774841.664272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612578560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774841.664276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774841.664278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774841.664280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774841.664284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774841.664294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774841.664299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774841/real 1775774841] req@ffff8de1c2e16680 x1862023612578688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774841.664306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612578688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774841.664311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774841.664313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774841.664314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774841.664317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774841.664327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774841.664331:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774841/real 1775774841] req@ffff8de1c2e16a00 x1862023612578816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774841.664338:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612578816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774841.664342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774841.664344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774841.664346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612578816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774842.623919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774843.647948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774844.671905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774845.695877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774846.720015:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774846.783878:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774846.783888:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774846.783893:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774846.783905:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10818 00000100:00080000:0.0:1775774846.783919:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774846.783928:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774846.783989:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612578944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774846.784024:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774846.784027:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774846.784029:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774846.784033:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10818 00000100:00080000:0.0:1775774846.784036:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774846.784039:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774846.784060:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774846.784071:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612579072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774846.784080:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774846.784083:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774846.784084:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774846.784102:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10818 00000100:00080000:0.0:1775774846.784105:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774846.784108:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774846.784114:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774846.784121:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612578944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774846.784127:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612579200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774846.784145:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774846.784149:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774846.784152:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774846.784155:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10818 00000100:00080000:0.0:1775774846.784158:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774846.784160:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774846.784163:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774846.784173:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612579328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774846.784180:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774846.784183:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774846.784184:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774846.784187:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10818 00000100:00080000:0.0:1775774846.784190:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774846.784192:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774846.784195:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774846.784202:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612579456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774846.784227:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774846.784265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774846/real 1775774846] req@ffff8de1c5683b80 x1862023612578944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774846.784286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612578944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774846.784298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774846.784304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774846.784308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612578944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774846.784317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774846.784343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774846.784356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774846/real 1775774846] req@ffff8de1c5682300 x1862023612579072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774846.784370:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612579072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774846.784379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774846.784392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774846.784397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774846.784426:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774846.784452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774846.784464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774846/real 1775774846] req@ffff8de1c5680700 x1862023612579200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774846.784486:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612579200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774846.784495:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774846.784498:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774846.784502:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774846.784509:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774846.784531:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774846.784543:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774846/real 1775774846] req@ffff8de1c5682d80 x1862023612579328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774846.784556:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612579328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774846.784565:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774846.784568:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774846.784572:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774846.784578:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774846.784601:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774846.784612:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774846/real 1775774846] req@ffff8de1c5682680 x1862023612579456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774846.784626:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612579456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774846.784652:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774846.784656:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774846.784659:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774847.743874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774848.767858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774849.791907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774850.815888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774851.839930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774851.903828:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774851.903836:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774851.903840:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774851.903849:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10823 00000100:00080000:0.0:1775774851.903860:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774851.903868:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774851.903905:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612579584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774851.903927:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774851.903930:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774851.903932:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774851.903935:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10823 00000100:00080000:0.0:1775774851.903938:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774851.903941:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774851.903950:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774851.903963:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612579712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774851.903967:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612579584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774851.903980:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774851.903984:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774851.903985:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774851.903988:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10823 00000100:00080000:0.0:1775774851.903990:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774851.903992:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774851.903997:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774851.904041:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612579840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774851.904048:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774851.904051:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774851.904052:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774851.904055:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10823 00000100:00080000:0.0:1775774851.904060:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774851.904063:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774851.904067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775774851.904072:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774851.904077:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612579968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774851.904099:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774851.904101:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774851.904103:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774851.904105:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10823 00000100:00080000:0.0:1775774851.904107:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774851.904109:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774851.904112:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774851.904120:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612580096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774851.904135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774851/real 1775774851] req@ffff8de1c5682680 x1862023612579584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774851.904156:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612579584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774851.904167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774851.904172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774851.904176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612579584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774851.904200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774851.904224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774851.904236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774851/real 1775774851] req@ffff8de1c5682d80 x1862023612579712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774851.904250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612579712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774851.904259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774851.904263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774851.904267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774851.904273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774851.904291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774851.904299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774851/real 1775774851] req@ffff8de1c5680700 x1862023612579840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774851.904311:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612579840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774851.904320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774851.904323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774851.904326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774851.904332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774851.904347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774851.904355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774851/real 1775774851] req@ffff8de1c5682300 x1862023612579968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774851.904376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612579968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774851.904385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774851.904388:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774851.904391:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612579968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774851.904397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774851.904414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774851.904422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774851/real 1775774851] req@ffff8de1c5683b80 x1862023612580096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774851.904434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612580096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774851.904442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774851.904445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774851.904448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774852.863867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774853.887911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774854.911862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774855.935883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774856.959886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774857.023846:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774857.023854:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774857.023859:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774857.023867:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10828 00000100:00080000:3.0:1775774857.023878:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774857.023884:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774857.023931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612580224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774857.023953:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774857.023955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774857.023957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774857.023960:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10828 00000100:00080000:3.0:1775774857.023962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774857.023966:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774857.023974:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774857.023983:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612580352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774857.023990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612580224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774857.023993:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774857.023997:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774857.023999:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774857.024001:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10828 00000100:00080000:3.0:1775774857.024003:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774857.024006:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774857.024009:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774857.024016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612580480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774857.024023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774857.024025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774857.024027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774857.024036:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10828 00000100:00080000:3.0:1775774857.024041:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774857.024046:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775774857.024051:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775774857.024052:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774857.024067:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612580608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774857.024078:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774857.024081:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774857.024084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775774857.024085:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774857/real 1775774857] req@ffff8de1c7af5c00 x1862023612580224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774857.024091:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10828 00000100:00080000:3.0:1775774857.024099:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774857.024105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774857.024109:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612580224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775774857.024112:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775774857.024126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775774857.024131:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612580736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774857.024134:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774857.024141:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612580224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774857.024166:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774857.024184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774857.024192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774857/real 1775774857] req@ffff8de1c7af6300 x1862023612580352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774857.024200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612580352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774857.024206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774857.024209:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774857.024213:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774857.024220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774857.024238:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774857.024249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774857/real 1775774857] req@ffff8de1c7af4000 x1862023612580480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774857.024262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612580480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774857.024270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774857.024274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774857.024278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774857.024284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774857.024305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774857.024316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774857/real 1775774857] req@ffff8de1c7af6d80 x1862023612580608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774857.024328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612580608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774857.024334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774857.024337:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774857.024339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774857.024343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774857.024357:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774857.024364:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774857/real 1775774857] req@ffff8de1c7af4e00 x1862023612580736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774857.024371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612580736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774857.024376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774857.024377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774857.024379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774857.983924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774859.007847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774860.031909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774861.055889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774862.079898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774862.143879:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774862.143890:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774862.143895:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774862.143906:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10833 00000100:00080000:0.0:1775774862.143917:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774862.143933:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774862.143969:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612580864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774862.143994:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774862.143998:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774862.144001:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774862.144006:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10833 00000100:00080000:0.0:1775774862.144012:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774862.144017:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774862.144024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612580864:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774862.144039:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774862.144059:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612580992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774862.144072:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774862.144077:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774862.144079:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774862.144083:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10833 00000800:00000100:3.0:1775774862.144087:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774862.144092:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774862.144099:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774862.144107:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774862.144121:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612581120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774862.144125:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774862/real 1775774862] req@ffff8de1c5681c00 x1862023612580864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774862.144164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612580864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774862.144167:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774862.144178:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774862.144183:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774862.144186:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774862.144191:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10833 00000100:00080000:3.0:1775774862.144192:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774862.144200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612580864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774862.144201:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774862.144211:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774862.144218:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774862.144225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774862.144235:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612581248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774862.144245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774862.144263:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775774862.144270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774862/real 1775774862] req@ffff8de1c5681f80 x1862023612580992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774862.144274:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774862.144278:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774862.144288:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10833 00000100:00080000:0.0:1775774862.144295:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774862.144303:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774862.144310:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774862.144316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612580992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774862.144334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775774862.144340:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612581376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774862.144341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774862.144351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612580992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774862.144362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774862.144386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774862.144404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774862/real 1775774862] req@ffff8de1c5682a00 x1862023612581120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774862.144413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612581120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774862.144419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774862.144421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774862.144423:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774862.144435:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774862.144448:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774862.144454:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774862/real 1775774862] req@ffff8de1c5680380 x1862023612581248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774862.144472:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612581248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774862.144481:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774862.144484:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774862.144486:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774862.144489:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774862.144499:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774862.144504:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774862/real 1775774862] req@ffff8de1c5680000 x1862023612581376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774862.144511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612581376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774862.144516:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774862.144518:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774862.144520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774863.103903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774864.127912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774865.151857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774866.175901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774867.199837:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774867.263856:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774867.263862:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774867.263870:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774867.263879:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10839 00000100:00080000:0.0:1775774867.263889:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774867.263895:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774867.263925:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612581504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774867.263947:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774867.263950:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774867.263952:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774867.263955:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10839 00000100:00080000:0.0:1775774867.263959:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774867.263963:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774867.263971:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774867.263979:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612581504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774867.263985:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612581632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774867.263995:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774867.263998:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774867.264000:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774867.264003:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10839 00000100:00080000:0.0:1775774867.264005:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774867.264009:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774867.264013:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774867.264023:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612581760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774867.264031:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774867.264035:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774867.264036:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774867.264040:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10839 00000100:00080000:0.0:1775774867.264045:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774867.264048:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774867.264053:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774867.264062:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612581888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774867.264069:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774867.264071:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774867.264073:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774867.264075:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10839 00000100:00080000:0.0:1775774867.264078:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774867.264083:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774867.264084:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581632:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775774867.264087:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774867.264099:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612582016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774867.264123:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774867.264140:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774867.264155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774868.223861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774869.247816:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774870.271835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775774870.336011:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775774870.336055:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775774870.336071:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774870.336111:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774870.336119:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774870.336127:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775774870.336135:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775774870.336175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774867/real 1775774870] req@ffff8de1c5683800 x1862023612582016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774870.336203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612582016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774870.336216:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774870.336221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774870.336226:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582016:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774870.336235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774867/real 1775774870] req@ffff8de1c5681500 x1862023612581632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774870.336249:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612581632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774870.336258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774870.336262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774870.336266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774870.336273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774867/real 1775774870] req@ffff8de1c5681880 x1862023612581760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774870.336286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612581760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774870.336294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774870.336298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774870.336302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774870.336309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774867/real 1775774870] req@ffff8de1c5680e00 x1862023612581888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774870.336320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612581888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774870.336328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774870.336332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774870.336335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612581888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774870.336343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774867/real 1775774870] req@ffff8de1c5683480 x1862023612581504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774870.336356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612581504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774870.336364:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774870.336368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774870.336371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612581504:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775774871.295839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774872.319845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774872.383929:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774872.383940:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774872.383945:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774872.383956:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10844 00000100:00080000:3.0:1775774872.383969:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774872.383976:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774872.384022:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612582144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774872.384054:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774872.384057:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774872.384059:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774872.384063:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10844 00000100:00080000:3.0:1775774872.384065:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774872.384068:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774872.384079:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774872.384087:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612582272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774872.384098:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774872.384102:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774872.384104:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774872.384109:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10844 00000100:00080000:3.0:1775774872.384113:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774872.384116:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774872.384122:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612582144:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774872.384124:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774872.384140:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612582400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774872.384151:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774872.384155:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774872.384157:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774872.384162:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10844 00000100:00080000:3.0:1775774872.384167:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774872.384170:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774872.384177:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774872.384189:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612582528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774872.384200:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774872.384204:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774872.384205:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774872.384209:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10844 00000100:00080000:3.0:1775774872.384213:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775774872.384215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774872.384222:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774872.384228:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774872.384240:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612582656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774872.384272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774872/real 1775774872] req@ffff8de1c7af5f80 x1862023612582144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774872.384298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612582144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774872.384310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774872.384314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774872.384319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612582144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774872.384326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774872.384354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774872.384367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774872/real 1775774872] req@ffff8de1c7af5880 x1862023612582272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774872.384380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612582272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774872.384389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774872.384392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774872.384396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774872.384433:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774872.384456:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774872.384467:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774872/real 1775774872] req@ffff8de1c7af4a80 x1862023612582400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774872.384481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612582400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774872.384490:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774872.384495:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774872.384498:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774872.384505:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774872.384525:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774872.384535:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774872/real 1775774872] req@ffff8de1c7af5500 x1862023612582528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774872.384548:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612582528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774872.384557:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774872.384560:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774872.384564:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774872.384571:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774872.384591:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774872.384602:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774872/real 1775774872] req@ffff8de1c7af4380 x1862023612582656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774872.384615:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612582656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774872.384624:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774872.384628:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774872.384632:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774873.343829:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774874.367832:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774875.391964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774876.415875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774877.439983:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774877.503801:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774877.503809:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774877.503813:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774877.503821:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10849 00000100:00080000:0.0:1775774877.503830:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774877.503836:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774877.503867:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612582784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774877.503892:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774877.503895:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774877.503896:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774877.503899:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10849 00000100:00080000:0.0:1775774877.503901:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774877.503904:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774877.503912:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774877.503921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612582912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774877.503928:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774877.503930:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774877.503931:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774877.503934:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10849 00000100:00080000:0.0:1775774877.503936:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774877.503938:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774877.503942:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774877.503949:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612583040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774877.503964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774877.503966:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774877.503967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774877.503970:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10849 00000100:00080000:0.0:1775774877.503973:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774877.503976:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774877.503980:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774877.503988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612582784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774877.503995:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612583168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774877.504009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774877.504012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774877.504013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774877.504015:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10849 00000100:00080000:0.0:1775774877.504018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774877.504020:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774877.504023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774877.504036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612583296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774877.504087:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774877.504126:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774877/real 1775774877] req@ffff8de1c5683480 x1862023612582784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774877.504144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612582784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774877.504153:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774877.504157:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774877.504160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612582784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774877.504166:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774877.504181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774877.504189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774877/real 1775774877] req@ffff8de1c5680e00 x1862023612582912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774877.504197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612582912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774877.504207:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774877.504210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774877.504213:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612582912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774877.504237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774877.504250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774877.504260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774877/real 1775774877] req@ffff8de1c5681880 x1862023612583040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774877.504272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612583040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774877.504280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774877.504284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774877.504288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774877.504295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774877.504325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774877.504337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774877/real 1775774877] req@ffff8de1c5681500 x1862023612583168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774877.504350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612583168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774877.504359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774877.504363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774877.504367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774877.504374:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774877.504394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774877.504402:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774877/real 1775774877] req@ffff8de1c5683800 x1862023612583296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774877.504410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612583296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774877.504415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774877.504418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774877.504419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774878.463945:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774879.487917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774880.511955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774881.535950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774882.559951:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774882.623852:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774882.623864:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774882.623871:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774882.623903:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10854 00000100:00080000:0.0:1775774882.623920:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774882.623930:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774882.623987:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612583424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774882.624026:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774882.624032:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774882.624035:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774882.624041:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10854 00000100:00080000:0.0:1775774882.624045:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774882.624051:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774882.624066:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774882.624084:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612583424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774882.624088:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612583552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774882.624107:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774882.624111:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774882.624114:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774882.624121:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10854 00000100:00080000:0.0:1775774882.624125:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774882.624128:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774882.624133:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774882.624145:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612583680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774882.624154:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774882.624158:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774882.624160:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774882.624180:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10854 00000100:00080000:0.0:1775774882.624195:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774882.624198:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774882.624203:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774882.624211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774882.624216:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612583808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774882.624252:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774882.624257:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774882.624259:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774882.624265:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10854 00000100:00080000:0.0:1775774882.624271:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774882.624276:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774882.624284:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774882.624286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774882/real 1775774882] req@ffff8de1c5680000 x1862023612583424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774882.624303:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612583936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774882.624320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612583424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774882.624353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774882.624359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774882.624365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612583424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774882.624398:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774882.624429:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774882.624446:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774882/real 1775774882] req@ffff8de1c5680380 x1862023612583552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774882.624496:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612583552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774882.624508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774882.624513:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774882.624518:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774882.624526:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774882.624554:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774882.624569:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774882/real 1775774882] req@ffff8de1c5682a00 x1862023612583680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774882.624584:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612583680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774882.624595:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774882.624599:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774882.624603:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774882.624611:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774882.624636:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774882.624650:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774882/real 1775774882] req@ffff8de1c5681f80 x1862023612583808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774882.624667:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612583808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774882.624679:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774882.624683:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774882.624687:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774882.624695:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774882.624746:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774882.624762:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774882/real 1775774882] req@ffff8de1c5681c00 x1862023612583936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774882.624777:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612583936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774882.624788:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774882.624792:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774882.624796:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612583936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774883.583912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774884.607835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774885.631867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774886.655881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774887.679869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774887.743843:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774887.743852:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774887.743857:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774887.743868:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10859 00000100:00080000:0.0:1775774887.743880:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774887.743887:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774887.743923:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612584064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774887.743951:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774887.743955:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774887.743957:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774887.743961:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10859 00000100:00080000:0.0:1775774887.743966:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774887.743970:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774887.743980:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774887.743993:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612584192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774887.744000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612584064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774887.744010:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774887.744014:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774887.744015:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774887.744020:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10859 00000100:00080000:0.0:1775774887.744024:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774887.744027:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774887.744032:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774887.744042:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612584320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774887.744052:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774887.744056:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774887.744058:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775774887.744063:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774887.744067:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10859 00000100:00080000:0.0:1775774887.744073:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774887.744078:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774887.744084:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774887.744097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774887/real 1775774887] req@ffff8de1c5683b80 x1862023612584064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774887.744099:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612584448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774887.744136:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775774887.744136:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612584064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774887.744146:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774887.744154:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774887.744157:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:0.0:1775774887.744159:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774887.744160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612584064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774887.744172:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10859 00000100:00080000:0.0:1775774887.744177:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774887.744181:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774887.744185:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584192:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775774887.744188:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774887.744206:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612584576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775774887.744210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774887.744222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774887/real 1775774887] req@ffff8de1c5682300 x1862023612584192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774887.744231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612584192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774887.744237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774887.744240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774887.744242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774887.744247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774887.744257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774887.744263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774887/real 1775774887] req@ffff8de1c5680700 x1862023612584320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774887.744270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612584320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774887.744275:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774887.744277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774887.744278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774887.744282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774887.744291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774887.744296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774887/real 1775774887] req@ffff8de1c5682d80 x1862023612584448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774887.744303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612584448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774887.744307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774887.744309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774887.744311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774887.744321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774887.744330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774887.744335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774887/real 1775774887] req@ffff8de1c5682680 x1862023612584576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774887.744341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612584576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774887.744346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774887.744348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774887.744350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774888.703840:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774889.727844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774890.751866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774891.775871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774892.799898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774892.863827:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774892.863834:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774892.863839:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774892.863846:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10864 00000100:00080000:1.0:1775774892.863856:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774892.863861:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774892.863891:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612584704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774892.863916:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774892.863919:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774892.863920:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774892.863923:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10864 00000100:00080000:1.0:1775774892.863925:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774892.863927:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774892.863935:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774892.863943:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612584832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774892.863950:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774892.863953:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774892.863954:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774892.863957:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10864 00000100:00080000:1.0:1775774892.863958:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774892.863961:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774892.863966:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774892.863968:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612584704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774892.863980:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612584960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774892.863991:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774892.863994:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774892.863997:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774892.864001:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10864 00000100:00080000:1.0:1775774892.864006:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774892.864011:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774892.864016:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774892.864029:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612585088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775774892.864036:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774892.864040:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774892.864043:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774892.864044:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774892.864048:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10864 00000100:00080000:1.0:1775774892.864051:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774892.864054:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774892.864058:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774892.864064:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612585216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775774892.864081:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774892/real 1775774892] req@ffff8de1c2e17800 x1862023612584704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774892.864105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612584704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774892.864116:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774892.864121:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774892.864125:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612584704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775774892.864132:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774892.864156:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774892.864168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774892/real 1775774892] req@ffff8de1c2e15500 x1862023612584832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774892.864180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612584832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774892.864189:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774892.864192:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774892.864195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774892.864218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775774892.864233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774892.864242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774892/real 1775774892] req@ffff8de1c2e14700 x1862023612584960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774892.864260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612584960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774892.864268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774892.864271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774892.864274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612584960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774892.864279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774892.864314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774892.864322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774892/real 1775774892] req@ffff8de1c2e17480 x1862023612585088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774892.864330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612585088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774892.864335:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774892.864338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774892.864339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774892.864343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775774892.864353:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774892.864358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774892/real 1775774892] req@ffff8de1c2e14a80 x1862023612585216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774892.864365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612585216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774892.864374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775774892.864376:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775774892.864378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774893.823874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774894.847892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774895.871844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774896.895861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774897.919925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774897.983854:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774897.983862:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774897.983866:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774897.983874:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10869 00000100:00080000:3.0:1775774897.983883:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774897.983889:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774897.983919:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612585344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774897.983942:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774897.983945:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774897.983946:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774897.983949:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10869 00000100:00080000:3.0:1775774897.983959:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774897.983962:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774897.983971:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774897.983980:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612585472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774897.983986:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612585344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774897.983990:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774897.984002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774897.984004:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774897.984009:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10869 00000100:00080000:3.0:1775774897.984013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774897.984017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774897.984023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774897.984035:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612585600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774897.984045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774897.984050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:1.0:1775774897.984054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774897.984054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774897.984062:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10869 00000100:00080000:3.0:1775774897.984067:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774897.984071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774897.984077:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774897.984097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774897/real 1775774897] req@ffff8de1c7af5180 x1862023612585344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774897.984103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612585728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774897.984129:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774897.984132:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774897.984133:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774897.984138:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612585344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775774897.984139:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10869 00000100:00080000:3.0:1775774897.984145:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774897.984152:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774897.984156:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774897.984164:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612585856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774897.984179:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774897.984186:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774897.984192:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612585344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774897.984235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774897.984261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774897.984276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774897/real 1775774897] req@ffff8de1c7af7100 x1862023612585472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774897.984290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612585472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774897.984299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774897.984303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774897.984307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774897.984313:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774897.984333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774897.984344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774897/real 1775774897] req@ffff8de1c7af7800 x1862023612585600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774897.984356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612585600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774897.984365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774897.984368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774897.984371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774897.984377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774897.984398:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774897.984410:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774897/real 1775774897] req@ffff8de1c7af4380 x1862023612585728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774897.984423:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612585728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774897.984432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774897.984435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774897.984439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774897.984444:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774897.984466:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774897.984478:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774897/real 1775774897] req@ffff8de1c7af5500 x1862023612585856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774897.984491:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612585856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774897.984501:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774897.984504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774897.984508:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612585856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774898.943912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774899.967850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774900.991875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774902.015862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774903.039912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774903.103833:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774903.103841:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774903.103846:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774903.103854:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10874 00000100:00080000:3.0:1775774903.103863:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774903.103868:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774903.103914:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612585984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774903.103949:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774903.103953:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774903.103955:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774903.103960:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10874 00000100:00080000:3.0:1775774903.103964:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774903.103967:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774903.103976:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774903.103991:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612586112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774903.103992:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612585984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774903.104007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774903.104010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774903.104011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774903.104015:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10874 00000100:00080000:3.0:1775774903.104019:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774903.104022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774903.104027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774903.104037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612586240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774903.104044:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774903.104047:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774903.104049:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774903.104053:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10874 00000800:00000100:0.0:1775774903.104057:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774903.104059:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774903.104063:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774903.104067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774903.104078:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612586368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774903.104086:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774903.104089:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774903.104091:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774903.104094:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10874 00000100:00080000:3.0:1775774903.104099:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775774903.104100:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774903/real 1775774903] req@ffff8de1c7af4a80 x1862023612585984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774903.104145:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612585984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774903.104156:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774903.104160:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774903.104165:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612585984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774903.104191:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774903.104195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586112:192.168.201.137@tcp:38:kworker.0 00000008:00100000:3.0:1775774903.104199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774903.104214:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612586496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774903.104230:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774903.104246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774903/real 1775774903] req@ffff8de1c7af5880 x1862023612586112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774903.104261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612586112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774903.104267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774903.104269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774903.104272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774903.104277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774903.104294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774903.104302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774903/real 1775774903] req@ffff8de1c7af5f80 x1862023612586240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774903.104315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612586240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774903.104324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774903.104327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774903.104331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774903.104338:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774903.104364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774903.104381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774903/real 1775774903] req@ffff8de1c7af4e00 x1862023612586368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774903.104404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612586368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774903.104414:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774903.104417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774903.104420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774903.104446:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774903.104473:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774903.104486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774903/real 1775774903] req@ffff8de1c7af6d80 x1862023612586496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774903.104497:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612586496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774903.104506:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774903.104510:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774903.104513:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774904.063957:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774905.087939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774906.111912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774907.135870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774908.159879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774908.223803:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774908.223812:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774908.223816:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774908.223826:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10879 00000100:00080000:3.0:1775774908.223837:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774908.223844:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774908.223883:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612586624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774908.223909:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774908.223912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774908.223913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774908.223916:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10879 00000100:00080000:3.0:1775774908.223920:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774908.223922:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774908.223930:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774908.223941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612586752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774908.223948:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774908.223951:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774908.223952:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774908.223955:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10879 00000100:00080000:3.0:1775774908.223957:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774908.223959:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774908.223964:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612586624:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775774908.223965:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774908.223975:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612586880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774908.223982:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774908.223984:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774908.223986:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774908.223988:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10879 00000100:00080000:3.0:1775774908.223990:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774908.223992:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774908.223995:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774908.224003:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612587008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774908.224009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774908.224012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774908.224013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774908.224037:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10879 00000100:00080000:3.0:1775774908.224040:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774908.224043:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774908.224047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774908.224055:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612587136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775774908.224061:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774908.224106:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774908/real 1775774908] req@ffff8de1c7af4000 x1862023612586624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774908.224125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612586624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774908.224133:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774908.224136:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774908.224139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612586624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774908.224144:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774908.224171:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774908.224178:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774908/real 1775774908] req@ffff8de1c7af6300 x1862023612586752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774908.224186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612586752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774908.224191:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774908.224193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774908.224195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774908.224214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774908.224223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774908.224229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774908/real 1775774908] req@ffff8de1c7af5c00 x1862023612586880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774908.224236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612586880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774908.224245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774908.224247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774908.224249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612586880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774908.224252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774908.224261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774908.224265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774908/real 1775774908] req@ffff8de1c7af7b80 x1862023612587008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774908.224272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612587008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774908.224277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774908.224279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774908.224281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774908.224284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774908.224293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774908.224298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774908/real 1775774908] req@ffff8de1c7af7480 x1862023612587136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774908.224304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612587136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774908.224309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774908.224311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774908.224313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774909.183862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774910.207889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774911.231909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774912.255892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774913.279868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774913.343832:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774913.343840:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774913.343843:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774913.343851:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10885 00000100:00080000:0.0:1775774913.343861:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774913.343866:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774913.343900:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612587264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774913.343921:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774913.343924:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774913.343935:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774913.343940:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10885 00000100:00080000:0.0:1775774913.343944:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774913.343947:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774913.343956:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774913.343967:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612587392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774913.343981:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775774913.343984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612587264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774913.343985:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774913.343987:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774913.343994:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10885 00000100:00080000:0.0:1775774913.343997:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774913.344000:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774913.344003:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774913.344013:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612587520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774913.344020:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774913.344022:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774913.344024:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774913.344026:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10885 00000100:00080000:0.0:1775774913.344040:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774913.344043:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774913.344046:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774913.344051:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774913.344055:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612587648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774913.344062:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774913.344065:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774913.344066:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774913.344069:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10885 00000100:00080000:0.0:1775774913.344072:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774913.344075:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774913.344078:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774913.344084:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612587776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774913.344093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774913/real 1775774913] req@ffff8de1c5682680 x1862023612587264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774913.344119:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612587264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774913.344136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774913.344141:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774913.344146:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612587264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774913.344168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774913.344191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774913.344203:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774913/real 1775774913] req@ffff8de1c5682d80 x1862023612587392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774913.344215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612587392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774913.344223:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774913.344226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774913.344229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774913.344236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774913.344253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774913.344263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774913/real 1775774913] req@ffff8de1c5680700 x1862023612587520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774913.344275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612587520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774913.344282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774913.344285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774913.344289:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774913.344295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774913.344313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774913.344323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774913/real 1775774913] req@ffff8de1c5682300 x1862023612587648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774913.344334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612587648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774913.344341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774913.344344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774913.344347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774913.344353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774913.344371:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774913.344382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774913/real 1775774913] req@ffff8de1c5683b80 x1862023612587776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774913.344394:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612587776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774913.344402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774913.344405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774913.344408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612587776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774914.303955:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774915.327860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774916.351952:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774917.375988:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774918.399997:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774918.463921:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774918.463931:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774918.463937:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774918.463950:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10890 00000100:00080000:3.0:1775774918.463966:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774918.463975:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774918.464025:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612587904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774918.464064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774918.464069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774918.464072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774918.464078:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10890 00000100:00080000:3.0:1775774918.464082:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774918.464087:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774918.464098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774918.464114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612588032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774918.464127:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774918.464131:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774918.464134:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774918.464137:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612587904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774918.464141:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10890 00000100:00080000:3.0:1775774918.464149:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774918.464154:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774918.464160:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774918.464175:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612588160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774918.464193:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774918.464197:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774918.464199:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774918.464204:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10890 00000100:00080000:3.0:1775774918.464208:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774918.464212:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774918.464218:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774918.464226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774918.464234:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612588288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774918.464245:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774918.464249:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774918.464251:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774918.464256:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10890 00000100:00080000:3.0:1775774918.464261:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774918.464266:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774918.464272:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774918.464276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774918/real 1775774918] req@ffff8de1c7af6a00 x1862023612587904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775774918.464287:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612588416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774918.464317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612587904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774918.464331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774918.464337:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774918.464342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612587904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774918.464371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774918.464394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774918.464406:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774918/real 1775774918] req@ffff8de1c7af6680 x1862023612588032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774918.464419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612588032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774918.464428:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774918.464431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774918.464435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774918.464441:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774918.464458:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774918.464466:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774918/real 1775774918] req@ffff8de1c7af4700 x1862023612588160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774918.464479:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612588160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774918.464494:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774918.464498:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774918.464501:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774918.464508:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774918.464524:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774918.464532:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774918/real 1775774918] req@ffff8de1c7af7480 x1862023612588288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774918.464545:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612588288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774918.464553:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774918.464556:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774918.464560:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774918.464566:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774918.464582:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774918.464591:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774918/real 1775774918] req@ffff8de1c7af7b80 x1862023612588416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774918.464603:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612588416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774918.464621:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774918.464625:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774918.464629:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774919.423938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774920.447898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774921.471889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774922.495898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774923.519941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774923.583814:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774923.583821:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774923.583824:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774923.583831:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10895 00000100:00080000:3.0:1775774923.583840:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774923.583845:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774923.583874:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612588544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774923.583900:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774923.583904:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774923.583905:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774923.583909:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10895 00000100:00080000:3.0:1775774923.583912:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774923.583916:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774923.583925:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774923.583941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612588672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774923.583950:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612588544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774923.583954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774923.583958:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774923.583960:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774923.583965:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10895 00000100:00080000:3.0:1775774923.583969:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774923.583972:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774923.583978:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774923.583989:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612588800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774923.583998:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774923.584002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774923.584003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774923.584007:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10895 00000800:00000100:1.0:1775774923.584011:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775774923.584013:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774923.584018:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774923.584023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774923.584031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612588928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774923.584037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774923.584039:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774923.584040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774923.584042:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10895 00000100:00080000:3.0:1775774923.584045:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774923.584050:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774923.584051:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774923/real 1775774923] req@ffff8de1c7af5c00 x1862023612588544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775774923.584053:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774923.584065:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612589056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774923.584074:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612588544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774923.584084:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774923.584089:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774923.584094:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612588544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774923.584113:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774923.584132:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774923.584142:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774923/real 1775774923] req@ffff8de1c7af6300 x1862023612588672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774923.584153:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612588672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774923.584160:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774923.584163:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774923.584166:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774923.584171:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774923.584186:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774923.584194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774923/real 1775774923] req@ffff8de1c7af4000 x1862023612588800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774923.584205:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612588800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774923.584211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774923.584214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774923.584217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774923.584222:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774923.584235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774923.584243:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774923/real 1775774923] req@ffff8de1c7af6d80 x1862023612588928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774923.584253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612588928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774923.584260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774923.584263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774923.584265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612588928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774923.584270:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774923.584283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774923.584290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774923/real 1775774923] req@ffff8de1c7af4e00 x1862023612589056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774923.584300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612589056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774923.584307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774923.584309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774923.584312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774924.543935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774925.567936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774926.591933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774927.615887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774928.639856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774928.703831:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774928.703838:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774928.703842:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774928.703849:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10900 00000100:00080000:0.0:1775774928.703858:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774928.703862:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774928.703890:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612589184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774928.703911:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774928.703914:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774928.703916:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774928.703920:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10900 00000100:00080000:0.0:1775774928.703923:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774928.703926:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774928.703934:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774928.703945:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612589312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774928.703956:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612589184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774928.703960:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774928.703962:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774928.703963:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774928.703967:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10900 00000100:00080000:0.0:1775774928.703970:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774928.703973:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774928.703976:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774928.703984:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612589440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774928.703991:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774928.703993:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774928.703994:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774928.703998:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10900 00000100:00080000:0.0:1775774928.704000:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774928.704003:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774928.704006:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774928.704007:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774928.704014:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612589568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774928.704021:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774928.704023:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774928.704024:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774928.704028:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10900 00000100:00080000:0.0:1775774928.704030:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774928.704033:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774928.704035:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774928/real 1775774928] req@ffff8de1c5681c00 x1862023612589184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775774928.704037:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774928.704044:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612589696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774928.704051:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612589184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774928.704060:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774928.704063:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774928.704066:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612589184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774928.704088:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774928.704104:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774928.704112:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774928/real 1775774928] req@ffff8de1c5681f80 x1862023612589312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774928.704119:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612589312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774928.704130:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774928.704132:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774928.704134:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774928.704138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774928.704148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774928.704153:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774928/real 1775774928] req@ffff8de1c5682a00 x1862023612589440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774928.704160:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612589440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774928.704164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774928.704166:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774928.704167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774928.704170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774928.704179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774928.704183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774928/real 1775774928] req@ffff8de1c5680380 x1862023612589568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774928.704189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612589568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774928.704193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774928.704195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774928.704197:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774928.704199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774928.704207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774928.704211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774928/real 1775774928] req@ffff8de1c5680000 x1862023612589696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774928.704217:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612589696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774928.704221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774928.704222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774928.704224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774929.663902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774930.687869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774931.711886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774932.735822:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774933.759915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774933.823854:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774933.823864:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774933.823869:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774933.823879:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10905 00000100:00080000:3.0:1775774933.823889:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774933.823897:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774933.823930:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612589824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774933.823959:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774933.823963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774933.823965:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774933.823969:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10905 00000100:00080000:3.0:1775774933.823973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774933.823976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774933.823986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774933.823999:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612589952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774933.824008:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612589824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774933.824014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774933.824017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774933.824019:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774933.824024:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10905 00000100:00080000:3.0:1775774933.824027:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774933.824031:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774933.824036:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774933.824047:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612590080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774933.824057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774933.824061:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774933.824062:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774933.824066:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10905 00000100:00080000:3.0:1775774933.824072:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774933.824076:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774933.824082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774933.824088:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775774933.824095:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612590208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774933.824108:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774933.824111:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775774933.824113:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590080:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775774933.824115:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774933.824122:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10905 00000100:00080000:3.0:1775774933.824127:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774933.824131:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774933.824135:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774933.824136:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775774933.824153:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612590336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774933.824192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774934.783876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774935.807843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774936.831820:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775774936.895977:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775774936.896017:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775774936.896034:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774936.896066:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774936.896074:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774936.896082:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775774936.896091:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775774936.896108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774933/real 1775774936] req@ffff8de1c7af5500 x1862023612590208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774936.896133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612590208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774936.896143:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774936.896148:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774936.896152:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774936.896158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774933/real 1775774936] req@ffff8de1c7af5880 x1862023612589952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774936.896170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612589952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774936.896187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774936.896191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774936.896194:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612589952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774936.896200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774933/real 1775774936] req@ffff8de1c7af4a80 x1862023612590080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774936.896212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612590080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774936.896219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774936.896222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774936.896224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774936.896229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774933/real 1775774936] req@ffff8de1c7af5f80 x1862023612589824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774936.896241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612589824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774936.896248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774936.896251:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774936.896254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612589824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774936.896282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774933/real 1775774936] req@ffff8de1c7af4380 x1862023612590336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774936.896294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612590336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774936.896302:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774936.896306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774936.896311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774937.855884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774938.879894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774938.943944:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774938.943958:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774938.943962:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774938.943974:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10910 00000100:00080000:0.0:1775774938.943988:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774938.943996:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774938.944037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612590464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774938.944074:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774938.944077:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774938.944079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774938.944083:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10910 00000100:00080000:0.0:1775774938.944086:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774938.944089:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774938.944102:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774938.944114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612590592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774938.944124:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774938.944127:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774938.944129:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774938.944132:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10910 00000100:00080000:0.0:1775774938.944135:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774938.944140:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774938.944143:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612590464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775774938.944152:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774938.944162:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612590720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774938.944170:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774938.944173:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774938.944175:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774938.944178:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10910 00000100:00080000:0.0:1775774938.944181:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774938.944184:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774938.944190:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774938.944198:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612590848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774938.944205:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774938.944208:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774938.944210:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774938.944213:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10910 00000100:00080000:0.0:1775774938.944216:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774938.944219:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774938.944223:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774938.944231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774938.944234:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612590976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774938.944291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774938/real 1775774938] req@ffff8de1c5683800 x1862023612590464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774938.944313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612590464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774938.944324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774938.944329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774938.944332:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612590464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774938.944366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774938.944392:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774938.944408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774938/real 1775774938] req@ffff8de1c5681500 x1862023612590592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774938.944421:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612590592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774938.944429:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774938.944432:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774938.944435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774938.944440:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774938.944462:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774938.944472:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774938/real 1775774938] req@ffff8de1c5681880 x1862023612590720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774938.944495:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612590720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774938.944508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774938.944512:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774938.944515:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774938.944522:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774938.944545:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774938.944558:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774938/real 1775774938] req@ffff8de1c5680e00 x1862023612590848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774938.944569:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612590848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774938.944577:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774938.944582:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774938.944586:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774938.944592:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774938.944609:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774938.944619:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774938/real 1775774938] req@ffff8de1c5683480 x1862023612590976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774938.944630:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612590976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774938.944637:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774938.944640:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774938.944644:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612590976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774939.903852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774940.927911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774941.951891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774942.975875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774943.999919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775774944.063875:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774944.063881:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775774944.063885:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774944.063892:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10915 00000100:00080000:3.0:1775774944.063901:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774944.063906:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775774944.063936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612591104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774944.063957:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774944.063960:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775774944.063961:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774944.063963:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10915 00000100:00080000:3.0:1775774944.063965:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774944.063968:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774944.063976:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774944.063984:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612591232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774944.063993:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612591104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775774944.063993:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774944.063996:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775774944.063999:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774944.064004:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10915 00000100:00080000:3.0:1775774944.064006:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774944.064008:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774944.064010:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775774944.064017:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612591360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774944.064021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774944.064023:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775774944.064025:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774944.064027:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10915 00000100:00080000:3.0:1775774944.064029:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774944.064031:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774944.064035:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775774944.064040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612591488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775774944.064045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775774944.064048:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775774944.064048:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775774944.064050:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10915 00000100:00080000:3.0:1775774944.064052:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775774944.064054:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775774944.064057:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774944.064058:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775774944.064064:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612591616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774944.064092:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774944/real 1775774944] req@ffff8de1c7af7800 x1862023612591104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774944.064106:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612591104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774944.064113:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774944.064115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774944.064118:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612591104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774944.064134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774944.064149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774944.064157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774944/real 1775774944] req@ffff8de1c7af7100 x1862023612591232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774944.064164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612591232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774944.064169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774944.064171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774944.064172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774944.064176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774944.064184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774944.064189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774944/real 1775774944] req@ffff8de1c7af5180 x1862023612591360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774944.064196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612591360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774944.064200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774944.064202:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774944.064204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774944.064207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774944.064215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774944.064219:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774944/real 1775774944] req@ffff8de1c7af4380 x1862023612591488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774944.064225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612591488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774944.064229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774944.064231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774944.064240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774944.064243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774944.064255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774944.064261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774944/real 1775774944] req@ffff8de1c7af5f80 x1862023612591616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774944.064267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612591616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774944.064272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774944.064274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774944.064275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774945.023861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774946.047955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774947.071846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774948.095876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774949.119958:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774949.183847:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774949.183855:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774949.183859:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774949.183867:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10920 00000100:00080000:0.0:1775774949.183883:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774949.183889:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774949.183924:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612591744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774949.183945:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774949.183948:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774949.183950:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774949.183952:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10920 00000100:00080000:0.0:1775774949.183955:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774949.183957:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774949.183965:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774949.183973:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612591872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774949.183981:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774949.183984:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774949.183987:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775774949.183988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612591744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774949.183993:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10920 00000100:00080000:0.0:1775774949.183997:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774949.183999:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774949.184002:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774949.184010:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612592000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774949.184016:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774949.184018:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774949.184020:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774949.184022:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10920 00000100:00080000:0.0:1775774949.184037:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774949.184039:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774949.184043:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775774949.184047:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774949.184054:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612592128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774949.184061:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774949.184064:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774949.184065:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774949.184067:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10920 00000100:00080000:0.0:1775774949.184070:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774949.184072:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774949.184076:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774949.184079:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774949/real 1775774949] req@ffff8de1c5683480 x1862023612591744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774949.184088:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612592256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775774949.184098:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612591744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774949.184108:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774949.184112:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774949.184115:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612591744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774949.184134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774949.184149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774949.184156:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774949/real 1775774949] req@ffff8de1c5680e00 x1862023612591872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774949.184164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612591872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774949.184169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774949.184171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774949.184173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612591872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774949.184178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775774949.184188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774949.184193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774949/real 1775774949] req@ffff8de1c5681880 x1862023612592000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774949.184200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612592000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774949.184205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774949.184207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774949.184209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774949.184212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774949.184221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774949.184227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774949/real 1775774949] req@ffff8de1c5681500 x1862023612592128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774949.184234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612592128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774949.184239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774949.184241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774949.184242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775774949.184251:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775774949.184262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774949.184267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774949/real 1775774949] req@ffff8de1c5683800 x1862023612592256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774949.184280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612592256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774949.184288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774949.184291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775774949.184294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774950.143872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774951.167868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774952.191870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774953.215965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774954.239941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774954.303879:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774954.303886:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774954.303891:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774954.303902:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10926 00000100:00080000:0.0:1775774954.303914:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774954.303922:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774954.303970:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612592384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774954.303996:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774954.304000:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774954.304002:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774954.304005:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10926 00000100:00080000:0.0:1775774954.304009:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774954.304017:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774954.304026:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774954.304027:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612592384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774954.304038:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612592512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774954.304047:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774954.304049:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774954.304051:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774954.304054:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10926 00000100:00080000:0.0:1775774954.304057:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774954.304060:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774954.304063:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774954.304070:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612592640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774954.304077:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774954.304080:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774954.304081:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774954.304083:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10926 00000100:00080000:0.0:1775774954.304086:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774954.304091:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774954.304093:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774954.304098:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774954.304107:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612592768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774954.304113:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774954.304115:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774954.304117:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774954.304121:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10926 00000100:00080000:0.0:1775774954.304123:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774954.304128:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774954.304128:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774954/real 1775774954] req@ffff8de1c5680000 x1862023612592384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775774954.304132:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774954.304143:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612592896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774954.304150:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612592384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774954.304171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774954.304175:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774954.304178:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612592384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774954.304196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774954.304227:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774954.304237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774954/real 1775774954] req@ffff8de1c5680380 x1862023612592512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774954.304245:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612592512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774954.304251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774954.304253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774954.304255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774954.304259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774954.304271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774954.304276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774954/real 1775774954] req@ffff8de1c5682a00 x1862023612592640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774954.304283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612592640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774954.304287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774954.304289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774954.304291:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774954.304294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774954.304304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774954.304309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774954/real 1775774954] req@ffff8de1c5681f80 x1862023612592768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774954.304317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612592768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774954.304322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774954.304323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774954.304325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774954.304328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774954.304337:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774954.304342:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774954/real 1775774954] req@ffff8de1c5681c00 x1862023612592896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774954.304349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612592896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774954.304354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774954.304356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774954.304357:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612592896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774955.263888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774956.287878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774957.311900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774958.335892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774959.359881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774959.423882:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774959.423893:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774959.423898:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774959.423908:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10931 00000100:00080000:1.0:1775774959.423921:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774959.423929:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774959.423966:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612593024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774959.423998:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774959.424002:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774959.424005:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774959.424009:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10931 00000100:00080000:1.0:1775774959.424014:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774959.424018:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774959.424028:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774959.424044:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612593152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774959.424055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612593024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774959.424074:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774959.424078:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774959.424080:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774959.424086:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10931 00000100:00080000:1.0:1775774959.424091:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774959.424095:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774959.424101:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774959.424114:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612593280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774959.424139:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774959.424165:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774959.424173:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1775774959.424175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774959/real 1775774959] req@ffff8de1c2e14e00 x1862023612593024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775774959.424177:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774959.424185:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10931 00000100:00080000:1.0:1775774959.424193:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774959.424199:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774959.424206:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774959.424207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612593024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774959.424223:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612593408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775774959.424233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775774959.424241:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774959.424243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:1.0:1775774959.424249:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1775774959.424251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612593024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775774959.424252:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774959.424262:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10931 00000100:00080000:1.0:1775774959.424267:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774959.424273:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774959.424278:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774959.424284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775774959.424292:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612593536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774959.424315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774959.424330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774959/real 1775774959] req@ffff8de1c2e14a80 x1862023612593152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774959.424344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612593152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774959.424353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774959.424357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774959.424360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774959.424366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774959.424384:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774959.424393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774959/real 1775774959] req@ffff8de1c2e17480 x1862023612593280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774959.424405:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612593280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774959.424414:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774959.424417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774959.424420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774959.424427:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774959.424449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774959.424461:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774959/real 1775774959] req@ffff8de1c2e14700 x1862023612593408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774959.424474:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612593408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774959.424484:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774959.424487:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774959.424490:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774959.424506:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774959.424527:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774959.424537:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774959/real 1775774959] req@ffff8de1c2e15500 x1862023612593536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774959.424551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612593536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774959.424559:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774959.424562:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774959.424566:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774960.383888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774961.407996:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774962.431906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774963.455911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774964.479907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774964.543865:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774964.543876:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774964.543881:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774964.543891:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10936 00000100:00080000:0.0:1775774964.543905:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774964.543912:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774964.543957:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612593664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774964.543984:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774964.543987:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774964.543989:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774964.543992:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10936 00000100:00080000:0.0:1775774964.543995:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774964.543998:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774964.544013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774964.544022:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612593792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774964.544029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612593664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774964.544032:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774964.544050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774964.544051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774964.544055:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10936 00000100:00080000:0.0:1775774964.544058:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774964.544060:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774964.544064:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774964.544071:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612593920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774964.544079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774964.544082:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774964.544083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774964.544085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10936 00000100:00080000:0.0:1775774964.544087:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774964.544090:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774964.544093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774964.544100:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612594048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774964.544106:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774964.544109:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774964.544110:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774964.544113:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10936 00000100:00080000:0.0:1775774964.544115:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774964.544117:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774964.544121:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774964.544128:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612594176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774964.544161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774964.544209:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774964/real 1775774964] req@ffff8de1c5683b80 x1862023612593664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774964.544233:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612593664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774964.544245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774964.544250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774964.544255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612593664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774964.544297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774964.544325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774964.544340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774964/real 1775774964] req@ffff8de1c5682300 x1862023612593792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774964.544355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612593792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774964.544365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774964.544369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774964.544373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774964.544380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774964.544402:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774964.544414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774964/real 1775774964] req@ffff8de1c5680700 x1862023612593920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774964.544428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612593920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774964.544445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774964.544449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774964.544453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612593920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774964.544459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774964.544480:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774964.544491:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774964/real 1775774964] req@ffff8de1c5682d80 x1862023612594048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774964.544501:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612594048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774964.544507:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774964.544509:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774964.544512:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774964.544515:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774964.544530:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774964.544536:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774964/real 1775774964] req@ffff8de1c5682680 x1862023612594176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774964.544543:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612594176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774964.544550:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774964.544554:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774964.544558:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774965.503909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774966.527897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774967.551955:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774968.575924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774969.599884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774969.663844:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774969.663855:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774969.663860:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774969.663871:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10941 00000100:00080000:0.0:1775774969.663883:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774969.663890:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774969.663930:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612594304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774969.663989:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774969.663994:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774969.663996:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774969.664001:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10941 00000100:00080000:0.0:1775774969.664006:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774969.664010:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774969.664021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774969.664038:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612594432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774969.664042:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612594304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774969.664059:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774969.664063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774969.664066:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774969.664072:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10941 00000100:00080000:0.0:1775774969.664077:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774969.664081:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774969.664088:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775774969.664104:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774969.664106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612594560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774969.664120:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774969.664124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774969.664126:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774969.664132:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10941 00000100:00080000:0.0:1775774969.664137:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775774969.664137:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774969/real 1775774969] req@ffff8de1c5682680 x1862023612594304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774969.664147:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774969.664155:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774969.664170:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612594688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774969.664171:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612594304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774969.664199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774969.664205:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775774969.664205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774969.664211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612594304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774969.664214:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774969.664217:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774969.664223:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10941 00000100:00080000:0.0:1775774969.664228:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774969.664233:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775774969.664234:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594432:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775774969.664245:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774969.664257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774969.664263:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612594816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774969.664269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774969/real 1775774969] req@ffff8de1c5682d80 x1862023612594432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774969.664290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612594432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774969.664297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774969.664300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774969.664303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774969.664307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774969.664319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774969.664331:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774969/real 1775774969] req@ffff8de1c5680700 x1862023612594560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774969.664344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612594560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774969.664353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774969.664356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774969.664359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774969.664366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774969.664386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774969.664397:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774969/real 1775774969] req@ffff8de1c5682300 x1862023612594688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774969.664406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612594688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774969.664412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774969.664414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774969.664416:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774969.664431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774969.664451:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774969.664461:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774969/real 1775774969] req@ffff8de1c5683b80 x1862023612594816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774969.664474:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612594816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774969.664483:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774969.664486:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774969.664489:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612594816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775774970.623874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774971.647889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774972.671942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774973.695934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775774974.720016:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774974.783850:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774974.783874:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774974.783880:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774974.783893:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10946 00000100:00080000:1.0:1775774974.783906:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774974.783913:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774974.783955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612594944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774974.783984:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774974.783988:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774974.783990:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774974.783993:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10946 00000100:00080000:1.0:1775774974.783997:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774974.784001:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774974.784012:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774974.784022:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612594944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774974.784027:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612595072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774974.784037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774974.784040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774974.784041:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774974.784044:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10946 00000100:00080000:1.0:1775774974.784049:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774974.784051:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774974.784055:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774974.784066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612595200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774974.784073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774974.784076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774974.784078:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774974.784081:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10946 00000100:00080000:1.0:1775774974.784093:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774974.784096:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774974.784100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775774974.784106:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775774974.784112:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612595328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774974.784120:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774974.784124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774974.784125:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774974.784128:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10946 00000100:00080000:1.0:1775774974.784130:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774974.784133:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774974.784138:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774974.784145:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774974/real 1775774974] req@ffff8de1c2e17800 x1862023612594944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775774974.784148:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612595456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775774974.784178:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612594944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774974.784188:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774974.784192:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774974.784196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612594944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774974.784218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774974.784234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774974.784243:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774974/real 1775774974] req@ffff8de1c2e16a00 x1862023612595072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774974.784253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612595072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774974.784260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774974.784263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774974.784265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774974.784270:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775774974.784280:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774974.784286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774974/real 1775774974] req@ffff8de1c2e16680 x1862023612595200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774974.784293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612595200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774974.784298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774974.784300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774974.784301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775774974.784305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774974.784315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774974.784320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774974/real 1775774974] req@ffff8de1c2e14380 x1862023612595328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774974.784326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612595328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774974.784331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774974.784334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774974.784335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775774974.784339:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775774974.784348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774974.784353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774974/real 1775774974] req@ffff8de1c2e17100 x1862023612595456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774974.784361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612595456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775774999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775774974.784367:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775774974.784368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775774974.784370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774975.743971:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774976.767926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774977.791901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774978.815906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774979.839896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774979.903805:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774979.903812:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774979.903816:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774979.903824:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10951 00000100:00080000:0.0:1775774979.903833:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774979.903839:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774979.903870:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612595584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774979.903896:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774979.903900:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774979.903903:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774979.903907:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10951 00000100:00080000:0.0:1775774979.903911:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774979.903916:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774979.903926:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774979.903940:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612595712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774979.903949:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612595584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774979.903967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774979.903970:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774979.903971:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774979.903975:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10951 00000100:00080000:0.0:1775774979.903978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774979.903981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774979.903984:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774979.903996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612595840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774979.904002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774979.904005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774979.904007:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774979.904009:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10951 00000100:00080000:0.0:1775774979.904012:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774979.904014:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774979.904017:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775774979.904025:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775774979.904026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612595968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774979.904035:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774979.904037:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774979.904039:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774979.904042:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10951 00000100:00080000:0.0:1775774979.904047:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774979.904050:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774979.904054:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774979.904060:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612596096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774979.904067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774979/real 1775774979] req@ffff8de1c5681c00 x1862023612595584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774979.904090:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612595584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774979.904102:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774979.904106:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774979.904111:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612595584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774979.904134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774979.904156:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774979.904167:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774979/real 1775774979] req@ffff8de1c5681f80 x1862023612595712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774979.904179:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612595712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774979.904187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774979.904190:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774979.904193:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774979.904199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774979.904215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774979.904224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774979/real 1775774979] req@ffff8de1c5682a00 x1862023612595840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774979.904236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612595840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774979.904244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774979.904247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774979.904250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774979.904256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774979.904272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774979.904282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774979/real 1775774979] req@ffff8de1c5680380 x1862023612595968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774979.904294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612595968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774979.904303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774979.904306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774979.904309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612595968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774979.904314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774979.904333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774979.904343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774979/real 1775774979] req@ffff8de1c5680000 x1862023612596096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774979.904355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612596096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774979.904362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774979.904366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774979.904369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774980.863848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774981.887849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774982.911863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774983.935853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774984.959853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774985.023825:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774985.023833:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774985.023837:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774985.023844:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10956 00000100:00080000:0.0:1775774985.023854:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774985.023859:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774985.023888:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612596224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774985.023910:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774985.023913:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774985.023914:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774985.023917:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10956 00000100:00080000:0.0:1775774985.023920:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774985.023922:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774985.023930:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774985.023939:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612596352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774985.023948:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775774985.023950:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612596224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775774985.023952:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774985.023955:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774985.023962:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10956 00000100:00080000:0.0:1775774985.023964:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774985.023967:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774985.023970:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774985.023979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612596480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774985.023985:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774985.023988:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774985.023989:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774985.023992:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10956 00000100:00080000:0.0:1775774985.023994:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774985.023996:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774985.023999:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774985.024008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612596608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774985.024013:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775774985.024021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774985.024024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774985.024026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774985.024029:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10956 00000100:00080000:0.0:1775774985.024032:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774985.024034:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774985.024039:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774985.024047:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774985/real 1775774985] req@ffff8de1c5683800 x1862023612596224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775774985.024049:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612596736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774985.024095:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612596224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774985.024108:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774985.024113:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774985.024119:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612596224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774985.024144:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774985.024166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774985.024176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774985/real 1775774985] req@ffff8de1c5681500 x1862023612596352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774985.024185:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612596352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774985.024190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774985.024193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774985.024195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774985.024199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774985.024210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774985.024215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774985/real 1775774985] req@ffff8de1c5681880 x1862023612596480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774985.024222:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612596480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774985.024227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774985.024229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774985.024231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774985.024234:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774985.024244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774985.024249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774985/real 1775774985] req@ffff8de1c5680e00 x1862023612596608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774985.024256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612596608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774985.024261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774985.024263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774985.024265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774985.024269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774985.024278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774985.024283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774985/real 1775774985] req@ffff8de1c5683480 x1862023612596736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774985.024289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612596736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774985.024294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774985.024296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774985.024298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774985.983832:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774987.007852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774988.031915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774989.055864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774990.079891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775774990.143852:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774990.143862:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775774990.143867:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774990.143877:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10961 00000100:00080000:1.0:1775774990.143887:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774990.143894:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775774990.143928:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612596864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774990.143955:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774990.143959:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775774990.143961:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774990.143965:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10961 00000100:00080000:1.0:1775774990.143969:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774990.143972:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774990.143981:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775774990.143996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612596992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774990.144007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774990.144010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775774990.144012:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774990.144017:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10961 00000100:00080000:1.0:1775774990.144022:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774990.144026:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774990.144032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775774990.144039:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612596864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775774990.144050:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612597120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774990.144062:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774990.144066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775774990.144068:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774990.144074:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10961 00000100:00080000:1.0:1775774990.144077:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775774990.144082:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774990.144090:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774990.144105:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612597248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775774990.144116:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775774990.144121:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775774990.144123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775774990.144126:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10961 00000100:00080000:1.0:1775774990.144130:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775774990.144136:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775774990.144141:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775774990.144148:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775774990.144164:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612597376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775774990.144192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774990/real 1775774990] req@ffff8de1c2e17b80 x1862023612596864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774990.144212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612596864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774990.144221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774990.144226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774990.144229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612596864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774990.144236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774990.144254:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774990.144263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774990/real 1775774990] req@ffff8de1c2e17100 x1862023612596992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774990.144271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612596992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774990.144276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774990.144278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774990.144280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612596992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774990.144305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774990.144317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774990.144326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774990/real 1775774990] req@ffff8de1c2e14380 x1862023612597120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774990.144339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612597120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774990.144348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774990.144352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774990.144355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774990.144362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774990.144385:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774990.144394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774990/real 1775774990] req@ffff8de1c2e16680 x1862023612597248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774990.144402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612597248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774990.144407:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774990.144410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774990.144412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774990.144417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774990.144430:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774990.144435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774990/real 1775774990] req@ffff8de1c2e16a00 x1862023612597376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774990.144442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612597376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774990.144447:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774990.144449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774990.144451:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775774991.103929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774992.128001:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774993.151874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774994.175879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774995.199840:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775774995.263861:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774995.263868:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775774995.263872:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774995.263880:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10967 00000100:00080000:0.0:1775774995.263890:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774995.263895:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775774995.263929:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612597504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774995.263953:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774995.263956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775774995.263957:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774995.263961:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10967 00000100:00080000:0.0:1775774995.263963:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774995.263965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774995.263972:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774995.263979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612597632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774995.263986:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774995.263988:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775774995.263989:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774995.263991:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10967 00000100:00080000:0.0:1775774995.263994:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774995.263996:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774995.263999:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775774995.264005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612597760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774995.264010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774995.264013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775774995.264014:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774995.264017:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10967 00000100:00080000:0.0:1775774995.264019:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774995.264021:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774995.264025:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775774995.264032:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612597504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775774995.264033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612597888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775774995.264046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775774995.264048:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775774995.264050:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775774995.264052:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10967 00000100:00080000:0.0:1775774995.264054:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775774995.264056:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775774995.264058:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775774995.264065:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612598016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775774995.264097:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774995.264128:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774995/real 1775774995] req@ffff8de1c5683480 x1862023612597504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774995.264152:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612597504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774995.264160:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774995.264163:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774995.264166:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612597504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775774995.264171:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774995.264185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774995.264193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774995/real 1775774995] req@ffff8de1c5680e00 x1862023612597632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774995.264201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612597632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774995.264206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774995.264209:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774995.264211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774995.264214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775774995.264223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774995.264228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774995/real 1775774995] req@ffff8de1c5681880 x1862023612597760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774995.264236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612597760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774995.264245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774995.264247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774995.264249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775774995.264267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774995.264277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774995.264282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774995/real 1775774995] req@ffff8de1c5681500 x1862023612597888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774995.264289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612597888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774995.264294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774995.264296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774995.264298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612597888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775774995.264301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775774995.264311:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775774995.264316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775774995/real 1775774995] req@ffff8de1c5683800 x1862023612598016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775774995.264323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612598016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775774995.264327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775774995.264329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775774995.264331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775774996.223868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774997.247880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775774998.271890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775774999.295885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775775000.319911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775000.383822:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775000.383829:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775000.383833:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775000.383842:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10972 00000100:00080000:0.0:1775775000.383852:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775000.383857:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775000.383890:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612598144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775000.383914:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775000.383917:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775000.383918:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775000.383921:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10972 00000100:00080000:0.0:1775775000.383923:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775000.383925:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775000.383932:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775000.383941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612598272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775000.383949:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775000.383951:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775000.383953:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775000.383955:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10972 00000100:00080000:0.0:1775775000.383957:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775000.383959:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775000.383979:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775000.383985:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612598144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775000.383989:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612598400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775000.383999:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775000.384001:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775000.384002:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775000.384006:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10972 00000100:00080000:0.0:1775775000.384009:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775000.384013:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775000.384019:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775000.384045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612598528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775000.384055:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775000.384059:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775000.384061:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775000.384065:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10972 00000100:00080000:0.0:1775775000.384069:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775000.384073:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775000.384079:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775000.384089:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775000.384110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612598656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775000.384142:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775000.384195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775000.384210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775001.343858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775002.367847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775003.391876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775003.456119:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775003.456202:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775003.456236:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775003.456303:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775003.456330:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775775003.456333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775000/real 1775775003] req@ffff8de1c5680000 x1862023612598144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000100:1.0:1775775003.456348:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775003.456395:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775775003.456403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612598144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775003.456419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775003.456425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775003.456431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612598144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775003.456440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775000/real 1775775003] req@ffff8de1c5680380 x1862023612598272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775003.456456:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612598272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775003.456471:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775003.456474:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775003.456478:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775003.456504:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775000/real 1775775003] req@ffff8de1c5682a00 x1862023612598400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775003.456518:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612598400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775003.456526:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775003.456530:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775003.456533:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775003.456540:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775000/real 1775775003] req@ffff8de1c5681f80 x1862023612598528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775003.456551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612598528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775003.456558:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775003.456561:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775003.456564:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775003.456571:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775000/real 1775775003] req@ffff8de1c5681c00 x1862023612598656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775003.456581:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612598656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775003.456602:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775003.456605:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775003.456608:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775004.415834:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775005.439821:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775005.503846:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775005.503854:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775005.503857:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775005.503865:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10977 00000100:00080000:2.0:1775775005.503874:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775005.503879:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775005.503921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612598784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775005.503952:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775005.503956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775005.503958:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775005.503963:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10977 00000100:00080000:2.0:1775775005.503967:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775005.503972:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775005.503982:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775005.504008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612598912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775005.504011:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612598784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775005.504028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775005.504032:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775005.504034:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775005.504039:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10977 00000100:00080000:2.0:1775775005.504044:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775005.504049:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775005.504055:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775005.504069:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612599040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775005.504080:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775005.504083:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775005.504084:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775005.504087:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10977 00000100:00080000:2.0:1775775005.504091:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775005.504098:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775775005.504100:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:2.0:1775775005.504105:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775005.504119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612599168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775005.504141:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775005/real 1775775005] req@ffff8de1d0f2d500 x1862023612598784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775005.504155:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775005.504160:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775005.504163:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775005.504165:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612598784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775005.504174:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10977 00000100:00080000:2.0:1775775005.504183:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775005.504187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775005.504188:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775775005.504195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:2.0:1775775005.504196:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775005.504203:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612598784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775005.504212:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612599296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775005.504233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775005.504263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775005.504278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775005/real 1775775005] req@ffff8de1d0f2df80 x1862023612598912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775005.504292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612598912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775005.504301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775005.504305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775005.504308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612598912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775005.504315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775005.504355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775005.504368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775005/real 1775775005] req@ffff8de1d0f2e680 x1862023612599040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775005.504389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612599040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775005.504399:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775005.504402:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775005.504405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775005.504411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775005.504445:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775005.504465:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775005/real 1775775005] req@ffff8de1d0f2c700 x1862023612599168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775005.504481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612599168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775005.504489:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775005.504493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775005.504495:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775005.504501:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775005.504520:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775005.504531:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775005/real 1775775005] req@ffff8de1d0f2ca80 x1862023612599296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775005.504542:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612599296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775005.504558:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775005.504562:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775005.504565:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775006.463920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775007.487943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775008.511878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775009.535878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775010.559905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775010.623832:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775010.623840:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775010.623844:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775010.623863:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10982 00000100:00080000:2.0:1775775010.623873:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775010.623879:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775010.623910:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612599424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775010.623935:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775010.623937:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775010.623939:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775010.623941:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10982 00000100:00080000:2.0:1775775010.623943:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775010.623945:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775010.623953:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775010.623962:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612599552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775010.623968:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775010.623970:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775010.623972:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775010.623975:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10982 00000100:00080000:2.0:1775775010.623978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775010.623981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775010.623984:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775010.623990:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612599680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775010.623995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775010.623998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775010.624000:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775010.624003:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10982 00000100:00080000:2.0:1775775010.624005:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775010.624007:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775010.624022:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775010.624030:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612599808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775010.624041:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775010.624044:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775010.624046:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775010.624051:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10982 00000100:00080000:2.0:1775775010.624059:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775010.624060:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612599424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775010.624066:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775010.624080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775010.624093:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612599936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775010.624164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775010.624214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775010/real 1775775010] req@ffff8de1d0f2e300 x1862023612599424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775010.624254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612599424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775010.624267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775010.624274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775010.624278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612599424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775010.624291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775010.624321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775010.624347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775010/real 1775775010] req@ffff8de1d0f2f100 x1862023612599552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775010.624360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612599552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775010.624375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775010.624379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775010.624383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775010.624390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775010.624414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775010.624445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775010/real 1775775010] req@ffff8de1d0f2ca80 x1862023612599680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775010.624473:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612599680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775010.624490:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775010.624499:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775010.624504:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775010.624546:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775010.624577:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775010.624590:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775010/real 1775775010] req@ffff8de1d0f2c700 x1862023612599808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775010.624605:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612599808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775010.624614:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775010.624618:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775010.624623:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775010.624630:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775010.624669:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775010.624693:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775010/real 1775775010] req@ffff8de1d0f2e680 x1862023612599936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775010.624715:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612599936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775010.624725:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775010.624826:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775010.624835:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612599936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775011.583886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775012.607868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775013.631922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775014.655893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775015.679881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775015.743802:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775015.743813:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775015.743819:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775015.743830:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10987 00000100:00080000:2.0:1775775015.743841:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775015.743849:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775015.743886:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612600064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775015.743910:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775015.743914:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775015.743916:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775015.743920:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10987 00000100:00080000:2.0:1775775015.743925:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775015.743928:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775015.743947:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775015.743959:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612600064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775015.743960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612600192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775015.743971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775015.743974:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775015.743977:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775015.743980:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10987 00000100:00080000:2.0:1775775015.743984:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775015.743987:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775015.743992:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775015.744001:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612600320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775015.744010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775015.744013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775015.744014:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775775015.744018:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775015.744018:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10987 00000100:00080000:2.0:1775775015.744021:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775015.744024:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775015.744028:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775015.744036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612600448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775015.744045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775015.744047:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775015.744060:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775015.744063:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775015/real 1775775015] req@ffff8de1d0f2df80 x1862023612600064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775015.744063:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10987 00000100:00080000:2.0:1775775015.744066:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775015.744070:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775015.744074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775015.744081:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612600064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775015.744083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612600576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775015.744093:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775015.744097:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775015.744101:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612600064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775015.744124:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775015.744172:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775015.744182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775015/real 1775775015] req@ffff8de1d0f2d500 x1862023612600192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775015.744190:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612600192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775015.744196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775015.744208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775015.744210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775015.744214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775015.744226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775015.744231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775015/real 1775775015] req@ffff8de1d0f2e680 x1862023612600320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775015.744245:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612600320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775015.744251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775015.744253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775015.744255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775015.744259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775015.744270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775015.744276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775015/real 1775775015] req@ffff8de1d0f2c700 x1862023612600448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775015.744288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612600448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775015.744293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775015.744295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775015.744296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775015.744300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775015.744309:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775015.744314:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775015/real 1775775015] req@ffff8de1d0f2ca80 x1862023612600576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775015.744321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612600576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775015.744326:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775015.744327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775015.744329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775016.703898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775017.727951:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775018.751847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775019.775907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775020.799894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775020.863840:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775020.863848:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775020.863852:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775020.863861:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10992 00000100:00080000:1.0:1775775020.863871:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775020.863876:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775020.863910:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612600704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775020.863934:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775020.863937:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775020.863938:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775020.863941:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10992 00000100:00080000:1.0:1775775020.863944:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775020.863946:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775020.863953:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775020.863962:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612600832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775020.863970:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775020.863973:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775020.863974:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775020.863977:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10992 00000100:00080000:1.0:1775775020.863979:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775020.863983:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775020.863984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612600704:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775775020.863986:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775020.863996:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612600960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775020.864002:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775020.864004:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775020.864006:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775020.864008:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10992 00000100:00080000:1.0:1775775020.864010:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775020.864012:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775020.864016:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775020.864023:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612601088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775020.864029:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775020.864031:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775020.864032:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775020.864034:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10992 00000100:00080000:1.0:1775775020.864038:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775020.864040:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775020.864044:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775020.864049:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775020.864069:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612601216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775020.864116:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775020/real 1775775020] req@ffff8de1c2e17800 x1862023612600704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775020.864137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612600704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775020.864147:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775020.864152:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775020.864155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612600704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775020.864164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775020.864189:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775020.864202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775020/real 1775775020] req@ffff8de1c2e15500 x1862023612600832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775020.864213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612600832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775020.864227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775020.864233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775020.864235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775020.864256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775020.864271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775020.864279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775020/real 1775775020] req@ffff8de1c2e14700 x1862023612600960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775020.864287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612600960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775020.864296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775020.864298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775020.864300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612600960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775020.864304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775020.864313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775020.864318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775020/real 1775775020] req@ffff8de1c2e17480 x1862023612601088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775020.864325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612601088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775020.864330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775020.864332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775020.864334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775020.864337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775020.864346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775020.864351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775020/real 1775775020] req@ffff8de1c2e14a80 x1862023612601216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775020.864357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612601216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775020.864362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775020.864363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775020.864366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775021.823886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775022.847849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775023.871900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775024.895883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775025.919878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775025.983850:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775025.983859:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775025.983863:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775025.983872:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 10997 00000100:00080000:2.0:1775775025.983884:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775025.983891:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775025.983924:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612601344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775025.983949:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775025.983953:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775025.983955:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775025.983959:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10997 00000100:00080000:2.0:1775775025.983992:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775025.983997:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775025.984007:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775025.984022:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612601344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775025.984023:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612601472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775025.984042:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775025.984046:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775025.984048:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775025.984052:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10997 00000100:00080000:2.0:1775775025.984057:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775025.984061:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775025.984067:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775025.984081:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612601600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775025.984091:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775025.984094:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775025.984096:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775025.984102:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10997 00000800:00000100:0.0:1775775025.984105:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775025.984108:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775025.984112:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775025.984118:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775025.984130:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612601728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775025.984140:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775025.984143:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775025.984145:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775025.984149:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775025/real 1775775025] req@ffff8de1d0f2f100 x1862023612601344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775025.984152:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 10997 00000100:00080000:2.0:1775775025.984156:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775025.984162:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775025.984170:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775025.984182:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612601856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775025.984186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612601344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775025.984212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775025.984218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775025.984222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612601344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775025.984248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775025.984273:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775025.984287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775025/real 1775775025] req@ffff8de1d0f2e300 x1862023612601472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775025.984302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612601472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775025.984310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775025.984314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775025.984317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775025.984324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775025.984344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775025.984367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775025/real 1775775025] req@ffff8de1d0f2ca80 x1862023612601600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775025.984382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612601600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775025.984391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775025.984394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775025.984398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775025.984404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775025.984425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775025.984436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775025/real 1775775025] req@ffff8de1d0f2c700 x1862023612601728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775025.984449:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612601728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775025.984457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775025.984461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775025.984464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775025.984470:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775025.984490:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775025.984501:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775025/real 1775775025] req@ffff8de1d0f2e680 x1862023612601856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775025.984521:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612601856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775025.984529:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775025.984533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775025.984536:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612601856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775026.943896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775027.967885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775028.991892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775030.015868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775031.039998:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775031.103836:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775031.103847:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775031.103852:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775031.103863:0:170199:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11002 00000100:00080000:2.0:1775775031.103906:0:170199:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775031.103914:0:170199:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775031.103959:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612601984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775031.103986:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775031.103990:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775031.103991:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775031.103994:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11002 00000100:00080000:2.0:1775775031.103997:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775031.104000:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775031.104011:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775031.104021:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612602112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775031.104028:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775031.104031:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775031.104034:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775031.104037:0:170199:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11002 00000100:00080000:2.0:1775775031.104039:0:170199:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775031.104043:0:170199:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775031.104048:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775031.104053:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612601984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775031.104060:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612602240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775031.104080:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775031.104083:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775031.104084:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775031.104088:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11002 00000100:00080000:2.0:1775775031.104091:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775031.104093:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775031.104097:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775031.104106:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612602368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775031.104113:0:170199:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775031.104117:0:170199:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775031.104119:0:170199:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775031.104123:0:170199:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11002 00000100:00080000:2.0:1775775031.104128:0:170199:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775031.104132:0:170199:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775031.104138:0:170199:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775031.104149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775031.104155:0:170199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612602496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775031.104199:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775031/real 1775775031] req@ffff8de1d0f2d500 x1862023612601984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775031.104220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612601984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775031.104228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775031.104232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775031.104235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612601984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775031.104241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775031.104266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775031.104280:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775031/real 1775775031] req@ffff8de1d0f2df80 x1862023612602112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775031.104301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612602112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775031.104311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775031.104315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775031.104318:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775031.104346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775031.104370:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775031.104382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775031/real 1775775031] req@ffff8de1d0f2e680 x1862023612602240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775031.104396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612602240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775031.104404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775031.104408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775031.104411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775031.104419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775031.104436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775031.104444:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775031/real 1775775031] req@ffff8de1d0f2c700 x1862023612602368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775031.104453:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612602368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775031.104464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775031.104467:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775031.104469:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775031.104473:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775031.104486:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775031.104492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775031/real 1775775031] req@ffff8de1d0f2ca80 x1862023612602496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775031.104499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612602496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775031.104504:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775031.104506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775031.104508:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775032.063887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775033.087927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775034.111985:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775035.135954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775036.159861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775036.223893:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775036.223904:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775036.223909:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775036.223919:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11007 00000100:00080000:1.0:1775775036.223934:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775036.223942:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775036.223987:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612602624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775036.224017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775036.224020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775036.224022:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775036.224025:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11007 00000100:00080000:1.0:1775775036.224027:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775036.224030:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775036.224040:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775036.224051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612602752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775036.224061:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775036.224065:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612602624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775036.224065:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775036.224068:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775036.224076:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11007 00000100:00080000:1.0:1775775036.224079:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775036.224081:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775036.224084:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775036.224092:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612602880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775036.224099:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775036.224102:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775036.224103:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775036.224106:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11007 00000100:00080000:1.0:1775775036.224108:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775036.224111:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775036.224115:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775036.224126:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612603008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775036.224132:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775036.224134:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775036.224136:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775036.224142:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11007 00000800:00000100:0.0:1775775036.224143:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775036.224147:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775036.224151:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775036.224155:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775036.224164:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612603136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775036.224186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775036/real 1775775036] req@ffff8de1c2e14e00 x1862023612602624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775036.224203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612602624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775036.224212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775036.224216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775036.224234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612602624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775036.224264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775036.224292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775036.224305:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775036/real 1775775036] req@ffff8de1c2e14a80 x1862023612602752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775036.224319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612602752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775036.224329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775036.224332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775036.224336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775036.224344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775036.224364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775036.224372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775036/real 1775775036] req@ffff8de1c2e17480 x1862023612602880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775036.224381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612602880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775036.224387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775036.224389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775036.224391:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612602880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775036.224395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775036.224407:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775036.224413:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775036/real 1775775036] req@ffff8de1c2e14700 x1862023612603008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775036.224420:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612603008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775036.224425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775036.224427:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775036.224429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775036.224432:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775036.224442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775036.224447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775036/real 1775775036] req@ffff8de1c2e15500 x1862023612603136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775036.224454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612603136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775036.224459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775036.224460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775036.224462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775037.183982:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775038.207926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775039.231913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775040.255866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775041.279855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775041.343829:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775041.343836:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775041.343840:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775041.343849:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11013 00000100:00080000:0.0:1775775041.343859:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775041.343864:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775041.343897:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612603264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775041.343922:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775041.343925:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775041.343926:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775041.343929:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11013 00000100:00080000:0.0:1775775041.343931:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775041.343933:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775041.343940:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775041.343948:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612603392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775041.343956:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775041.343959:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775041.343960:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775041.343963:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11013 00000100:00080000:0.0:1775775041.343964:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775041.343969:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775041.343971:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612603264:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775041.343973:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775041.343983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612603520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775041.343994:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775041.343996:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775041.343997:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775041.344000:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11013 00000100:00080000:0.0:1775775041.344002:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775041.344004:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775041.344008:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775041.344015:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612603648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775041.344021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775041.344023:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775041.344024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775041.344026:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11013 00000100:00080000:0.0:1775775041.344029:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775775041.344030:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775041.344035:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775041.344039:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775041.344046:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612603776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775041.344067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775041/real 1775775041] req@ffff8de1c5683b80 x1862023612603264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775041.344083:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612603264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775041.344091:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775041.344094:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775041.344097:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612603264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775041.344102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775041.344117:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775041.344124:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775041/real 1775775041] req@ffff8de1c5682300 x1862023612603392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775041.344132:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612603392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775041.344137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775041.344140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775041.344142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775041.344160:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775041.344170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775041.344185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775041/real 1775775041] req@ffff8de1c5680700 x1862023612603520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775041.344193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612603520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775041.344198:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775041.344200:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775041.344202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775041.344206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775041.344217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775041.344222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775041/real 1775775041] req@ffff8de1c5682d80 x1862023612603648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775041.344229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612603648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775041.344234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775041.344236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775041.344239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775041.344245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775041.344264:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775041.344275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775041/real 1775775041] req@ffff8de1c5682680 x1862023612603776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775041.344288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612603776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775041.344296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775041.344300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775041.344303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612603776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775042.303917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775043.327922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775044.351908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775045.375893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775046.399901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775046.463891:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775046.463912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775046.463918:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775046.463930:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11018 00000100:00080000:0.0:1775775046.463943:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775046.463951:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775046.463989:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612603904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775046.464022:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775046.464026:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775046.464029:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775046.464036:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11018 00000100:00080000:0.0:1775775046.464042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775046.464048:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775046.464054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612603904:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775046.464058:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775046.464078:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612604032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775046.464092:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775046.464096:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775046.464098:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775046.464104:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11018 00000100:00080000:0.0:1775775046.464110:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775046.464118:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775775046.464119:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775046.464127:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775046.464142:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612604160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775046.464157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775046/real 1775775046] req@ffff8de1c5682680 x1862023612603904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775046.464162:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775046.464173:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775046.464176:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775046.464184:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612603904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775046.464192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775046.464193:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11018 00000100:00080000:1.0:1775775046.464199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:0.0:1775775046.464202:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775046.464203:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612603904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775046.464212:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775046.464220:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775046.464229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775046.464237:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612604288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775046.464251:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775775046.464251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775046.464258:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775046.464261:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775046.464265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775046/real 1775775046] req@ffff8de1c5682d80 x1862023612604032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775046.464267:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11018 00000100:00080000:0.0:1775775046.464274:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775046.464282:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775046.464288:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775046.464290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612604032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775046.464303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775775046.464305:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612604416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775046.464311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775046.464320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775046.464332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775046.464359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775046.464372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775046/real 1775775046] req@ffff8de1c5680700 x1862023612604160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775046.464385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612604160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775046.464394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775046.464397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775046.464401:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775046.464418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775046.464444:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775046.464457:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775046/real 1775775046] req@ffff8de1c5682300 x1862023612604288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775046.464469:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612604288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775046.464475:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775046.464478:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775046.464481:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775046.464486:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775046.464503:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775046.464515:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775046/real 1775775046] req@ffff8de1c5683b80 x1862023612604416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775046.464531:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612604416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775046.464540:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775046.464544:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775046.464550:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775047.423878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775048.447881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775049.471842:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775050.495902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775051.519882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775051.583874:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775051.583884:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775051.583890:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775051.583901:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11023 00000100:00080000:0.0:1775775051.583913:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775051.583939:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775051.583977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612604544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775051.584002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775051.584006:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775051.584008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775051.584013:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11023 00000100:00080000:0.0:1775775051.584017:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775051.584022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775051.584031:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775051.584043:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612604672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775051.584056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612604544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775051.584057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775051.584066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775051.584069:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775051.584074:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11023 00000100:00080000:0.0:1775775051.584078:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775051.584082:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775051.584087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775051.584099:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612604800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775051.584115:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775051.584118:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775051.584120:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775051.584124:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11023 00000100:00080000:0.0:1775775051.584130:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775775051.584130:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775051.584138:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775051.584143:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775051.584155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612604928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775051.584163:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775051.584167:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775051.584169:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775051.584174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775051/real 1775775051] req@ffff8de1c5681c00 x1862023612604544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775051.584177:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11023 00000100:00080000:0.0:1775775051.584184:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775051.584191:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775051.584199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775051.584213:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612605056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775051.584213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612604544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775051.584246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775051.584253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775051.584260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612604544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775051.584287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775051.584313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775051.584326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775051/real 1775775051] req@ffff8de1c5681f80 x1862023612604672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775051.584339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612604672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775051.584355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775051.584358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775051.584362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775051.584369:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775051.584391:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775051.584403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775051/real 1775775051] req@ffff8de1c5682a00 x1862023612604800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775051.584416:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612604800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775051.584424:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775051.584428:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775051.584431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775051.584437:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775051.584458:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775051.584470:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775051/real 1775775051] req@ffff8de1c5680380 x1862023612604928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775051.584482:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612604928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775051.584490:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775051.584493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775051.584497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612604928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775051.584504:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775051.584541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775051.584554:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775051/real 1775775051] req@ffff8de1c5680000 x1862023612605056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775051.584566:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612605056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775051.584575:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775051.584579:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775051.584582:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775052.543862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775053.567898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775054.591888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775055.615886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775056.639876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775056.703842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775056.703853:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775056.703859:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775056.703870:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11028 00000100:00080000:0.0:1775775056.703884:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775056.703892:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775056.703931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612605184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775056.703959:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775056.703964:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775056.703966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775056.703971:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11028 00000100:00080000:0.0:1775775056.703975:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775056.703980:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775056.703991:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775056.704006:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612605312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775056.704017:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775056.704021:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775056.704023:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775056.704028:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11028 00000100:00080000:0.0:1775775056.704033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775056.704049:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775056.704051:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612605184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775056.704061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775056.704076:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612605440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775056.704096:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775056.704099:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775056.704101:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775056.704105:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11028 00000100:00080000:0.0:1775775056.704126:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775056.704130:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775056.704134:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775056.704138:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775056.704154:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612605568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775056.704164:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775056.704167:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775056.704168:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775056.704174:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11028 00000100:00080000:0.0:1775775056.704180:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775056.704185:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775056.704189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775056/real 1775775056] req@ffff8de1c5683800 x1862023612605184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775775056.704193:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775056.704213:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612605696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775056.704221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612605184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775056.704254:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775056.704260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775056.704265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612605184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775056.704272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775056.704291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775056.704301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775056/real 1775775056] req@ffff8de1c5681500 x1862023612605312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775056.704310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612605312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775056.704316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775056.704319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775056.704321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775056.704346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775056.704357:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775056.704363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775056/real 1775775056] req@ffff8de1c5681880 x1862023612605440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775056.704372:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612605440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775056.704377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775056.704380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775056.704382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775056.704386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775056.704402:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775056.704409:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775056/real 1775775056] req@ffff8de1c5680e00 x1862023612605568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775056.704417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612605568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775056.704423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775056.704450:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775056.704453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775056.704458:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775056.704481:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775056.704489:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775056/real 1775775056] req@ffff8de1c5683480 x1862023612605696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775056.704497:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612605696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775056.704502:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775056.704505:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775056.704507:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775057.663874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775058.687941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775059.711874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775060.735882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775061.759841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775061.823836:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775061.823853:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775061.823857:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775061.823865:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11033 00000100:00080000:3.0:1775775061.823876:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775061.823882:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775061.823913:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612605824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775061.823939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775061.823942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775061.823943:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775061.823947:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11033 00000100:00080000:3.0:1775775061.823950:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775061.823953:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775061.823962:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775061.823974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612605952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775061.823986:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775061.823990:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775061.823992:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775061.823996:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11033 00000100:00080000:3.0:1775775061.824000:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775061.824005:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775061.824013:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612605824:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775061.824018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775061.824034:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612606080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775061.824043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775061.824045:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775061.824047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775061.824050:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11033 00000100:00080000:3.0:1775775061.824054:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775061.824056:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775061.824060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775061.824070:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612606208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775061.824078:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775061.824086:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775061.824089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775061.824092:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775061.824097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11033 00000100:00080000:3.0:1775775061.824103:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775061.824107:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775061.824113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775061.824123:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775061/real 1775775061] req@ffff8de1c7af4a80 x1862023612605824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775061.824126:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612606336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775061.824157:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612605824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775061.824170:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775061.824175:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775061.824179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612605824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775061.824188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775061.824210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775061.824224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775061/real 1775775061] req@ffff8de1c7af5880 x1862023612605952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775061.824236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612605952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775061.824244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775061.824248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775061.824252:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612605952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775061.824278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775061.824304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775061.824313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775061/real 1775775061] req@ffff8de1c7af5500 x1862023612606080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775061.824323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612606080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775061.824330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775061.824332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775061.824364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775061.824371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775061.824387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775061.824395:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775061/real 1775775061] req@ffff8de1c7af4e00 x1862023612606208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775061.824405:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612606208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775061.824412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775061.824414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775061.824417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775061.824422:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775061.824437:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775061.824445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775061/real 1775775061] req@ffff8de1c7af6d80 x1862023612606336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775061.824457:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612606336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775061.824464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775061.824468:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775061.824471:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775062.783917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775063.807862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775064.831882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775065.855886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775066.879904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775066.943794:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775066.943803:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775066.943807:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775066.943815:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11038 00000100:00080000:3.0:1775775066.943825:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775066.943831:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775066.943862:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612606464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775066.943886:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775066.943889:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775066.943890:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775066.943893:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11038 00000100:00080000:3.0:1775775066.943895:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775066.943898:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775066.943905:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775066.943914:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612606592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775066.943921:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775066.943925:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775066.943926:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775066.943930:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11038 00000100:00080000:3.0:1775775066.943932:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775066.943934:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775066.943938:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775066.943940:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612606464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775066.943946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612606720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775066.943953:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775066.943955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775066.943956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775066.943960:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11038 00000100:00080000:3.0:1775775066.943962:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775066.943964:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775066.943967:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775066.943974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612606848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775066.943980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775066.943982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775066.943983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775066.943986:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11038 00000100:00080000:3.0:1775775066.943988:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775066.943991:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775066.943995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775066.944001:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612606976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775066.944030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775066.944058:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775066.944079:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775066.944100:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775067.903899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775068.927872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775069.951847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775775070.016065:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775775070.016112:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775775070.016130:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775070.016166:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775070.016176:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775070.016186:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775070.016206:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775775070.016235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775066/real 1775775070] req@ffff8de1c7af5c00 x1862023612606720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775070.016265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612606720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775070.016278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775070.016283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775070.016288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775070.016310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775066/real 1775775070] req@ffff8de1c7af7b80 x1862023612606848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775070.016327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612606848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775070.016335:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775070.016339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775070.016342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775070.016349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775066/real 1775775070] req@ffff8de1c7af7480 x1862023612606976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775070.016360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612606976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775070.016369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775070.016372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775070.016376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606976:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775070.016383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775066/real 1775775070] req@ffff8de1c7af4000 x1862023612606464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775070.016397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612606464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775070.016406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775070.016410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775070.016413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612606464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775070.016420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775066/real 1775775070] req@ffff8de1c7af6300 x1862023612606592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775070.016432:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612606592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775070.016439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775070.016442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775070.016446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612606592:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775775070.975851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775071.999868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775072.063886:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775072.063897:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775072.063902:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775072.063912:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11043 00000100:00080000:0.0:1775775072.063923:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775072.063931:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775072.063965:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612607104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775072.063997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775072.064002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775072.064004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775072.064008:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11043 00000100:00080000:0.0:1775775072.064012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775072.064017:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775072.064027:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775072.064042:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612607232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775072.064054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775072.064056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612607104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775072.064058:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775072.064064:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775072.064070:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11043 00000100:00080000:0.0:1775775072.064074:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775072.064079:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775072.064085:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775072.064098:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612607360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775072.064107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775072.064110:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775072.064112:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775072.064115:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11043 00000100:00080000:0.0:1775775072.064128:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775072.064137:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775775072.064137:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775072.064149:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775072.064178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612607488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775072.064189:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775072.064192:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775072.064194:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775072.064199:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775072/real 1775775072] req@ffff8de1c5683480 x1862023612607104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775072.064202:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11043 00000100:00080000:0.0:1775775072.064210:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775072.064216:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775072.064223:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775072.064228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612607104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775072.064236:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612607616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775072.064247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775072.064257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775072.064264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612607104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775072.064292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775072.064337:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775072.064352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775072/real 1775775072] req@ffff8de1c5680e00 x1862023612607232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775072.064367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612607232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775072.064377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775072.064382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775072.064386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775072.064395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775072.064418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775072.064430:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775072/real 1775775072] req@ffff8de1c5681880 x1862023612607360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775072.064442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612607360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775072.064450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775072.064453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775072.064456:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775072.064462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775072.064482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775072.064493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775072/real 1775775072] req@ffff8de1c5681500 x1862023612607488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775072.064505:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612607488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775072.064513:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775072.064517:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775072.064520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775072.064526:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775072.064546:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775072.064555:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775072/real 1775775072] req@ffff8de1c5683800 x1862023612607616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775072.064566:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612607616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775072.064572:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775072.064575:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775072.064578:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775073.023880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775074.047894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775075.071941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775076.095970:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775077.119886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775077.183808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775077.183816:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775077.183820:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775077.183828:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11048 00000100:00080000:0.0:1775775077.183838:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775077.183844:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775077.183876:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612607744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775077.183909:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775077.183914:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775077.183916:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775077.183920:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11048 00000100:00080000:0.0:1775775077.183924:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775077.183928:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775077.183937:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775077.183944:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612607744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775077.183949:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612607872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775077.183960:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775077.183962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775077.183965:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775077.183968:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11048 00000100:00080000:0.0:1775775077.183972:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775077.183975:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775077.183980:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775077.183988:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612608000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775077.183997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775077.183999:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775077.184001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775077.184005:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11048 00000800:00000100:1.0:1775775077.184005:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775077.184008:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775077.184011:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775077.184015:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775077.184024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612608128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775077.184032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775077.184035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775775077.184039:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775077/real 1775775077] req@ffff8de1c5680000 x1862023612607744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775077.184046:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775077.184050:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11048 00000100:00080000:0.0:1775775077.184053:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775077.184056:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775077.184060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775077.184064:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612607744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775077.184083:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612608256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775077.184086:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775077.184091:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775077.184094:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612607744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775077.184117:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775077.184139:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775077.184150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775077/real 1775775077] req@ffff8de1c5680380 x1862023612607872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775077.184158:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612607872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775077.184163:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775077.184166:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775077.184168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612607872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775077.184172:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775077.184183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775077.184189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775077/real 1775775077] req@ffff8de1c5682a00 x1862023612608000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775077.184196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612608000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775077.184205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775077.184207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775077.184209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775077.184212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775077.184222:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775077.184227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775077/real 1775775077] req@ffff8de1c5681f80 x1862023612608128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775077.184234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612608128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775077.184239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775077.184240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775077.184242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775077.184245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775077.184254:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775077.184259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775077/real 1775775077] req@ffff8de1c5681c00 x1862023612608256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775077.184265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612608256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775077.184272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775077.184275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775077.184278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775078.143890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775079.167873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775080.191863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775081.215924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775082.239908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775082.303882:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775082.303893:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775082.303897:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775082.303905:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11054 00000100:00080000:0.0:1775775082.303916:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775082.303921:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775082.303959:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612608384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775082.304002:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775082.304006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775082.304008:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775082.304013:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11054 00000100:00080000:0.0:1775775082.304018:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775082.304022:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775082.304031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775082.304043:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612608512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775082.304052:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612608384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775082.304054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775082.304062:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775082.304064:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775082.304075:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11054 00000100:00080000:0.0:1775775082.304078:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775082.304086:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775082.304092:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775082.304105:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612608640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775082.304116:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775775082.304121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775082.304123:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775082.304126:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775082.304133:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11054 00000100:00080000:0.0:1775775082.304138:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775082.304143:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775082.304149:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775082.304160:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775082/real 1775775082] req@ffff8de1c5683b80 x1862023612608384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775082.304163:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612608768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775082.304198:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775082.304202:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775082.304204:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775082.304210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612608384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775082.304212:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11054 00000100:00080000:0.0:1775775082.304219:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775082.304227:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775775082.304229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:0.0:1775775082.304236:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775775082.304237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775082.304245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612608384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775082.304254:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612608896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775082.304271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775082.304298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775082.304313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775082/real 1775775082] req@ffff8de1c5682300 x1862023612608512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775082.304326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612608512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775082.304334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775082.304339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775082.304344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775082.304350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775082.304377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775082.304393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775082/real 1775775082] req@ffff8de1c5680700 x1862023612608640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775082.304419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612608640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775082.304429:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775082.304433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775082.304437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775082.304445:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775082.304467:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775082.304479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775082/real 1775775082] req@ffff8de1c5682d80 x1862023612608768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775082.304494:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612608768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775082.304503:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775082.304507:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775082.304512:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775082.304519:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775082.304541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775082.304556:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775082/real 1775775082] req@ffff8de1c5682680 x1862023612608896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775082.304570:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612608896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775082.304581:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775082.304585:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775082.304589:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612608896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775083.263912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775084.287879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775085.311910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775086.335916:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775087.359909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775087.423836:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775087.423845:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775087.423850:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775087.423860:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11059 00000100:00080000:0.0:1775775087.423872:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775087.423879:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775087.423940:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612609024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775087.423960:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775087.423963:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775087.423964:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775087.423967:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11059 00000100:00080000:0.0:1775775087.423970:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775087.423973:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775087.423983:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775087.423992:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612609024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775087.423995:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612609152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775087.424011:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775087.424013:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775087.424014:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775087.424017:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11059 00000100:00080000:0.0:1775775087.424019:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775087.424021:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775087.424024:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775087.424030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612609280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775087.424035:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775087.424037:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775087.424039:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775087.424041:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11059 00000100:00080000:0.0:1775775087.424061:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775087.424063:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775087.424067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775087.424073:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775087.424075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612609408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775087.424083:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775087.424085:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775087.424086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775087.424089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11059 00000100:00080000:0.0:1775775087.424092:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775087.424095:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775087.424097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775087.424103:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612609536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775087.424118:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775087/real 1775775087] req@ffff8de1c5682680 x1862023612609024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775087.424141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612609024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775087.424149:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775087.424152:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775087.424155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612609024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775087.424177:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775087.424195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775087.424203:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775087/real 1775775087] req@ffff8de1c5682d80 x1862023612609152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775087.424210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612609152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775087.424215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775087.424218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775087.424220:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775087.424224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775087.424243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775087.424248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775087/real 1775775087] req@ffff8de1c5680700 x1862023612609280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775087.424256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612609280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775087.424264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775087.424266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775087.424268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775087.424271:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775087.424282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775087.424286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775087/real 1775775087] req@ffff8de1c5682300 x1862023612609408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775087.424293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612609408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775087.424297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775087.424299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775087.424300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775087.424303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775087.424312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775087.424317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775087/real 1775775087] req@ffff8de1c5683b80 x1862023612609536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775087.424324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612609536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775087.424328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775087.424330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775087.424331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775088.384004:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775089.407939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775090.431861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775091.455943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775092.479943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775092.543876:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775092.543887:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775092.543892:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775092.543902:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11064 00000100:00080000:0.0:1775775092.543914:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775092.543925:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775092.543968:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612609664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775092.543992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775092.543995:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775092.543996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775092.544000:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11064 00000100:00080000:0.0:1775775092.544002:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775092.544004:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775092.544012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775092.544022:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612609792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775092.544029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775092.544031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775092.544032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775092.544035:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11064 00000100:00080000:0.0:1775775092.544037:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775092.544039:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775092.544041:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775092.544047:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612609664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775092.544049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612609920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775092.544064:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775092.544067:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775092.544069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775092.544073:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11064 00000100:00080000:0.0:1775775092.544077:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775092.544081:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775092.544087:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775092.544100:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612610048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775092.544108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775092.544110:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775092.544112:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775092.544115:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11064 00000100:00080000:0.0:1775775092.544118:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775092.544121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775092.544124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775092.544133:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612610176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775092.544133:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775092.544186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775092/real 1775775092] req@ffff8de1c5681c00 x1862023612609664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775092.544206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612609664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775092.544217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775092.544222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775092.544227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612609664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775092.544235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775092.544257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775092.544265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775092/real 1775775092] req@ffff8de1c5681f80 x1862023612609792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775092.544273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612609792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775092.544282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775092.544285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775092.544287:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775092.544310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775092.544321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775092.544326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775092/real 1775775092] req@ffff8de1c5682a00 x1862023612609920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775092.544333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612609920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775092.544338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775092.544339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775092.544341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612609920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775092.544345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775092.544353:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775092.544358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775092/real 1775775092] req@ffff8de1c5680380 x1862023612610048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775092.544365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612610048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775092.544369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775092.544371:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775092.544373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775092.544376:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775092.544385:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775092.544389:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775092/real 1775775092] req@ffff8de1c5680000 x1862023612610176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775092.544395:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612610176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775092.544400:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775092.544401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775092.544402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775093.503969:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775094.527911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775095.551913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775096.575903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775097.599862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775097.663861:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775097.663871:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775097.663877:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775097.663887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11069 00000100:00080000:2.0:1775775097.663901:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775097.663909:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775097.663950:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612610304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775097.663981:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775097.663990:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775097.663993:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775097.663998:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11069 00000100:00080000:2.0:1775775097.664003:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775097.664007:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775097.664019:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775097.664027:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612610304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775097.664036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612610432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775097.664049:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775097.664053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775097.664055:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775097.664060:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11069 00000100:00080000:2.0:1775775097.664065:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775097.664070:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775097.664075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775775097.664086:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775097.664091:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612610560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775097.664103:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775097.664107:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775097.664109:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775097.664114:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11069 00000100:00080000:2.0:1775775097.664118:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775097.664119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775097/real 1775775097] req@ffff8de1d0f2e300 x1862023612610304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775097.664128:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775097.664135:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775097.664140:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612610304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775097.664148:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775775097.664152:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612610688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775097.664155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775097.664160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612610304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775097.664174:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775097.664178:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775097.664180:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775097.664186:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11069 00000100:00100000:1.0:1775775097.664188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610432:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775775097.664192:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775097.664198:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775097.664204:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775097.664208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775097.664219:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612610816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775097.664221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775097/real 1775775097] req@ffff8de1d0f2f100 x1862023612610432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775097.664257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612610432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775097.664267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775097.664271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775097.664275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775097.664282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775097.664315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775097.664327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775097/real 1775775097] req@ffff8de1d0f2ca80 x1862023612610560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775097.664341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612610560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775097.664350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775097.664353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775097.664357:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775097.664361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775097.664377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775097.664384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775097/real 1775775097] req@ffff8de1d0f2c700 x1862023612610688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775097.664392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612610688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775097.664397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775097.664399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775097.664402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775097.664413:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775097.664423:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775097.664428:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775097/real 1775775097] req@ffff8de1d0f2e680 x1862023612610816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775097.664436:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612610816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775097.664440:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775097.664442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775097.664444:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612610816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775098.623900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775099.647909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775100.671883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775101.695930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775102.719842:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775102.783847:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775102.783857:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775102.783862:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775102.783873:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11074 00000100:00080000:2.0:1775775102.783885:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775102.783891:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775102.783924:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612610944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775102.783949:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775102.783958:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775102.783960:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775102.783963:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11074 00000100:00080000:2.0:1775775102.783969:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775102.783972:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775102.783981:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775102.783990:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612611072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775102.783997:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775102.784000:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775102.784001:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775102.784004:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11074 00000100:00080000:2.0:1775775102.784006:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775102.784009:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775102.784013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775102.784028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612611200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775102.784031:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612610944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775102.784053:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775102.784055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775102.784056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775102.784060:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11074 00000100:00080000:2.0:1775775102.784062:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775102.784064:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775102.784068:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775102.784076:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612611328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775102.784082:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775102.784084:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775102.784086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775102.784088:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11074 00000100:00080000:2.0:1775775102.784091:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775102.784095:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775102.784098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775102.784104:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612611456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775102.784127:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775102.784175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775102/real 1775775102] req@ffff8de1d0f2df80 x1862023612610944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775102.784195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612610944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775102.784205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775102.784209:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775102.784212:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612610944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775102.784218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775102.784237:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775102.784246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775102/real 1775775102] req@ffff8de1d0f2d500 x1862023612611072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775102.784253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612611072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775102.784258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775102.784260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775102.784262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775102.784285:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775102.784295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775102.784301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775102/real 1775775102] req@ffff8de1d0f2e680 x1862023612611200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775102.784307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612611200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775102.784312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775102.784314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775102.784316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775102.784319:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775102.784328:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775102.784333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775102/real 1775775102] req@ffff8de1d0f2c700 x1862023612611328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775102.784340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612611328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775102.784344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775102.784346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775102.784347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775102.784351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775102.784360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775102.784365:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775102/real 1775775102] req@ffff8de1d0f2ca80 x1862023612611456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775102.784371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612611456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775102.784376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775102.784378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775102.784379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775103.743922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775104.767882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775105.791899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775106.815899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775107.839880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775107.903877:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775107.903888:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775107.903894:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775107.903904:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11079 00000100:00080000:3.0:1775775107.903917:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775107.903924:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775107.903962:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612611584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775107.903993:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775107.903997:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775107.903999:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775107.904003:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11079 00000100:00080000:3.0:1775775107.904007:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775107.904011:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775107.904020:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775107.904033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612611712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775107.904042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775107.904045:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775775107.904046:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612611584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775107.904046:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775107.904053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11079 00000100:00080000:3.0:1775775107.904057:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775107.904060:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775107.904063:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775107.904070:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612611840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775107.904076:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775107.904079:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775107.904080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775107.904083:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11079 00000100:00080000:3.0:1775775107.904085:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775107.904088:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775107.904091:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775107.904100:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612611968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775107.904109:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775107.904112:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775107.904114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775775107.904120:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775107.904123:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11079 00000100:00080000:3.0:1775775107.904138:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775107.904144:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775107.904150:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775107.904156:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775107/real 1775775107] req@ffff8de1c7af4700 x1862023612611584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775107.904165:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612612096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775107.904175:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612611584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775107.904209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775107.904213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775107.904217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612611584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775107.904237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775107.904254:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775107.904262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775107/real 1775775107] req@ffff8de1c7af6680 x1862023612611712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775107.904271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612611712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775107.904276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775107.904278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775107.904280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775107.904284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775107.904294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775107.904299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775107/real 1775775107] req@ffff8de1c7af6a00 x1862023612611840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775107.904306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612611840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775107.904311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775107.904313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775107.904315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775107.904319:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775107.904329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775107.904334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775107/real 1775775107] req@ffff8de1c7af6300 x1862023612611968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775107.904341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612611968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775107.904346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775107.904348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775107.904350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612611968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775107.904353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775107.904362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775107.904367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775107/real 1775775107] req@ffff8de1c7af4000 x1862023612612096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775107.904374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612612096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775107.904378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775107.904380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775107.904382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775108.863899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775109.887879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775110.911951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775111.935865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775112.959849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775113.023821:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775113.023834:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775113.023838:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775113.023849:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11084 00000100:00080000:0.0:1775775113.023861:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775113.023867:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775113.023896:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612612224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775113.023923:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775113.023926:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775113.023928:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775113.023933:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11084 00000100:00080000:0.0:1775775113.023936:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775113.023940:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775113.023949:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775113.023961:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612612352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775113.023972:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775113.023975:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775113.023977:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775113.023981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11084 00000100:00080000:0.0:1775775113.023986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775113.023989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775113.023994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775113.024004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612612224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775113.024007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612612480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775113.024025:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775113.024029:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775113.024030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775113.024034:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11084 00000100:00080000:0.0:1775775113.024038:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775113.024042:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775113.024047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775113.024059:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612612608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775113.024066:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775113.024075:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775113.024079:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775113.024081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775113.024085:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11084 00000100:00080000:0.0:1775775113.024089:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775113.024092:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775113.024097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775113.024101:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775113/real 1775775113] req@ffff8de1c5683800 x1862023612612224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775113.024110:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612612736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775113.024120:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612612224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775113.024129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775113.024134:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775113.024137:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612612224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775113.024142:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775113.024155:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775113.024162:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775113/real 1775775113] req@ffff8de1c5681500 x1862023612612352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775113.024170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612612352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775113.024175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775113.024177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775113.024179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775113.024197:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775113.024208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775113.024213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775113/real 1775775113] req@ffff8de1c5681880 x1862023612612480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775113.024220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612612480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775113.024229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775113.024231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775113.024233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775113.024237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775113.024246:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775113.024251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775113/real 1775775113] req@ffff8de1c5680e00 x1862023612612608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775113.024257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612612608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775113.024263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775113.024264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775113.024266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775113.024269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775113.024278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775113.024283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775113/real 1775775113] req@ffff8de1c5683480 x1862023612612736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775113.024289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612612736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775113.024294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775113.024296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775113.024298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775113.983899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775115.007935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775116.031861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775117.055939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775118.079891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775118.143828:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775118.143837:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775118.143841:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775118.143852:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11089 00000100:00080000:0.0:1775775118.143865:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775118.143872:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775118.143917:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612612864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775118.143950:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775118.143955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775118.143959:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775118.143966:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11089 00000100:00080000:0.0:1775775118.143970:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775118.143976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775118.143989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612612864:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775118.143990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775118.144018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612612992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775118.144037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775118.144042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775118.144045:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775118.144053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11089 00000100:00080000:0.0:1775775118.144068:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775118.144075:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775775118.144076:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775118.144084:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775118.144097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612613120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775118.144106:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775118.144109:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775118.144111:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775118.144115:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11089 00000100:00080000:0.0:1775775118.144118:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775118.144121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775118.144125:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775118.144128:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775118/real 1775775118] req@ffff8de1c5683480 x1862023612612864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775118.144136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612613248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775118.144147:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775118.144149:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775118.144151:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775775118.144152:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612612864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775118.144156:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11089 00000100:00080000:0.0:1775775118.144161:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775118.144166:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775118.144170:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775775118.144170:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775118.144178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775118.144181:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612613376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775118.144245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612612864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775118.144267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775118.144286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775118.144295:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775118/real 1775775118] req@ffff8de1c5680e00 x1862023612612992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775118.144304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612612992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775118.144310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775118.144312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775118.144314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612612992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775118.144318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775118.144330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775118.144337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775118/real 1775775118] req@ffff8de1c5681880 x1862023612613120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775118.144345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612613120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775118.144350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775118.144478:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775118.144484:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775118.144491:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775118.144563:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775118.144583:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775118/real 1775775118] req@ffff8de1c5681500 x1862023612613248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775118.144597:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612613248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775118.144606:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775118.144609:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775118.144613:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775118.144619:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775118.144640:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775118.144651:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775118/real 1775775118] req@ffff8de1c5683800 x1862023612613376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775118.144663:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612613376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775118.144671:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775118.144675:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775118.144678:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775119.103898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775120.127919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775121.151858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775122.175871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775123.199849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775123.263854:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775123.263861:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775123.263865:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775123.263874:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11095 00000100:00080000:2.0:1775775123.263884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775123.263890:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775123.263922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612613504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775123.263949:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775123.263952:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775123.263953:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775123.263956:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11095 00000100:00080000:2.0:1775775123.263958:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775123.263960:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775123.263968:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775123.263976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612613632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775123.263983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775123.263986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775123.263987:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775123.263990:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11095 00000100:00080000:2.0:1775775123.263992:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775123.263999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612613504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775123.264004:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775123.264008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775123.264017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612613760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775123.264025:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775123.264028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775123.264029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775123.264032:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11095 00000100:00080000:2.0:1775775123.264044:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775123.264047:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775123.264051:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775123.264058:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775123.264065:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612613888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775123.264073:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775123.264076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775123.264077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775123.264079:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11095 00000100:00080000:2.0:1775775123.264082:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775123.264085:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775123.264088:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775123.264092:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775123/real 1775775123] req@ffff8de1d0f2f100 x1862023612613504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775123.264098:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612614016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775123.264123:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612613504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775123.264141:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775123.264144:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775123.264147:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612613504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775123.264153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775123.264178:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775123.264190:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775123/real 1775775123] req@ffff8de1d0f2e300 x1862023612613632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775123.264203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612613632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775123.264211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775123.264214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775123.264218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775123.264242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775123.264261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775123.264287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775123/real 1775775123] req@ffff8de1d0f2ca80 x1862023612613760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775123.264299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612613760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775123.264307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775123.264311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775123.264314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775123.264320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775123.264339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775123.264350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775123/real 1775775123] req@ffff8de1d0f2c700 x1862023612613888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775123.264371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612613888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775123.264380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775123.264384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775123.264387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612613888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775123.264394:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775123.264411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775123.264419:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775123/real 1775775123] req@ffff8de1d0f2e680 x1862023612614016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775123.264426:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612614016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775123.264432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775123.264433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775123.264435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775124.223864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775125.247930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775126.271953:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775127.295930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775128.319965:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775128.383808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775128.383816:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775128.383821:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775128.383829:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11100 00000100:00080000:2.0:1775775128.383839:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775128.383844:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775128.383876:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612614144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775128.383900:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775128.383902:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775128.383904:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775128.383906:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11100 00000100:00080000:2.0:1775775128.383908:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775128.383911:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775128.383919:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775128.383928:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612614272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775128.383937:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775775128.383938:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612614144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775128.383942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775128.383946:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775128.383950:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11100 00000100:00080000:2.0:1775775128.383951:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775128.383953:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775128.383956:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775128.383964:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612614400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775128.383970:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775128.383972:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775128.383973:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775128.383976:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11100 00000100:00080000:2.0:1775775128.383979:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775128.383981:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775128.383985:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775128.383991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612614528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775128.383997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775128.384000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775128.384001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775128.384003:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11100 00000100:00080000:2.0:1775775128.384005:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775128.384007:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775128.384010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775128.384014:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775128.384020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612614656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775128.384054:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775128/real 1775775128] req@ffff8de1d0f2d500 x1862023612614144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775128.384076:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612614144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775128.384085:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775128.384088:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775128.384091:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612614144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775128.384109:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775128.384128:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775128.384136:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775128/real 1775775128] req@ffff8de1d0f2df80 x1862023612614272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775128.384144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612614272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775128.384154:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775128.384157:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775128.384159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775128.384163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775128.384172:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775128.384201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775128/real 1775775128] req@ffff8de1d0f2e680 x1862023612614400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775128.384210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612614400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775128.384215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775128.384217:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775128.384219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775128.384223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775128.384235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775128.384241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775128/real 1775775128] req@ffff8de1d0f2c700 x1862023612614528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775128.384248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612614528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775128.384252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775128.384254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775128.384257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775128.384260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775128.384270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775128.384275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775128/real 1775775128] req@ffff8de1d0f2ca80 x1862023612614656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775128.384282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612614656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775128.384287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775128.384289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775128.384290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775129.343909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775130.367888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775131.391897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775132.415958:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775133.439907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775133.503813:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775133.503829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775133.503834:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775133.503844:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11105 00000100:00080000:2.0:1775775133.503856:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775133.503863:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775133.503892:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612614784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775133.503915:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775133.503918:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775133.503920:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775133.503923:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11105 00000100:00080000:2.0:1775775133.503926:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775133.503928:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775133.503936:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775133.503944:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612614912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775133.503953:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775133.503955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775133.503957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775775133.503961:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612614784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775133.503962:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11105 00000100:00080000:2.0:1775775133.503968:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775133.503971:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775133.503975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775133.503983:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612615040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775133.503990:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775133.503993:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775133.503994:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775133.503997:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11105 00000100:00080000:2.0:1775775133.504008:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775133.504011:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775133.504016:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775133.504027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612615168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775133.504037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775133.504041:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775133.504043:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775133.504047:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11105 00000100:00080000:2.0:1775775133.504052:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775133.504056:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775133.504063:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775133.504065:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775133.504076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612615296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775133.504118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775133.504145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775133.504161:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775134.463875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775135.487840:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775136.511823:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775775136.575957:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775775136.575994:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775775136.576008:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775136.576049:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775136.576057:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775136.576069:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775136.576080:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775775136.576094:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775133/real 1775775136] req@ffff8de1d0f2f100 x1862023612614912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775136.576121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612614912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775136.576137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775136.576142:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775136.576146:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612614912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775136.576154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775133/real 1775775136] req@ffff8de1d0f2ca80 x1862023612615040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775136.576166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612615040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775136.576173:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775136.576177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775136.576180:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775136.576186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775133/real 1775775136] req@ffff8de1d0f2c700 x1862023612615168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775136.576198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612615168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775136.576206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775136.576217:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775136.576221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775136.576228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775133/real 1775775136] req@ffff8de1d0f2e300 x1862023612614784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775136.576243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612614784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775136.576251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775136.576254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775136.576258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612614784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775136.576286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775133/real 1775775136] req@ffff8de1d0f2e680 x1862023612615296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775136.576299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612615296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775136.576306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775136.576310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775136.576313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775137.536822:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775138.559842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775138.623897:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775138.623905:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775138.623908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775138.623916:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11110 00000100:00080000:0.0:1775775138.623927:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775138.623934:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775138.623971:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612615424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775138.624032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775138.624036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775138.624038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775138.624043:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11110 00000100:00080000:0.0:1775775138.624052:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775138.624057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775138.624069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775138.624089:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612615552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775138.624090:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612615424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775138.624108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775138.624111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775138.624114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775138.624124:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11110 00000100:00080000:0.0:1775775138.624129:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775138.624134:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775138.624140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775138.624153:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612615680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775138.624163:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775138.624166:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775138.624168:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775138.624173:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11110 00000800:00000100:3.0:1775775138.624178:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775138.624181:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775138.624187:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775138.624194:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775138.624205:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612615808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775138.624215:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775775138.624219:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775138/real 1775775138] req@ffff8de1c5680000 x1862023612615424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775138.624220:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775138.624223:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775138.624233:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11110 00000100:00080000:0.0:1775775138.624241:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775138.624246:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775138.624252:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775138.624252:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612615424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775138.624270:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612615936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775138.624275:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775138.624285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775138.624292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612615424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775138.624328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775138.624361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775138.624375:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775138/real 1775775138] req@ffff8de1c5680380 x1862023612615552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775138.624389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612615552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775138.624398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775138.624402:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775138.624405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775138.624412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775138.624438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775138.624450:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775138/real 1775775138] req@ffff8de1c5682a00 x1862023612615680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775138.624461:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612615680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775138.624470:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775138.624473:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775138.624476:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775138.624482:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775138.624502:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775138.624515:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775138/real 1775775138] req@ffff8de1c5681f80 x1862023612615808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775138.624535:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612615808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775138.624542:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775138.624545:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775138.624549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775138.624554:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775138.624579:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775138.624588:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775138/real 1775775138] req@ffff8de1c5681c00 x1862023612615936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775138.624599:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612615936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775138.624607:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775138.624610:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775138.624613:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612615936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775139.584846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775140.607834:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775141.631881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775142.655878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775143.679892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775143.743833:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775143.743843:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775143.743847:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775143.743855:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11115 00000100:00080000:3.0:1775775143.743865:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775143.743871:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775143.743902:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612616064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775143.743937:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775143.743939:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775143.743941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775143.743944:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11115 00000100:00080000:3.0:1775775143.743947:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775143.743950:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775143.743958:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775143.743968:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612616192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775143.743975:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775143.743978:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775143.743979:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775143.743984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612616064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775143.743985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11115 00000100:00080000:3.0:1775775143.743990:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775143.743993:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775143.743996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775143.744003:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612616320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775143.744009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775143.744011:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775143.744013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775143.744016:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11115 00000100:00080000:3.0:1775775143.744018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775143.744021:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775143.744024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775143.744030:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612616448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775143.744036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775143.744038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775143.744040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775143.744045:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11115 00000800:00000100:1.0:1775775143.744046:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775143.744049:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775143.744053:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775143.744056:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775143.744064:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612616576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775143.744085:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775143/real 1775775143] req@ffff8de1c7af7480 x1862023612616064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775143.744101:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612616064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775143.744109:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775143.744112:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775143.744114:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612616064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775143.744133:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775143.744149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775143.744156:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775143/real 1775775143] req@ffff8de1c7af7b80 x1862023612616192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775143.744165:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612616192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775143.744170:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775143.744172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775143.744175:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775143.744178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775143.744188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775143.744194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775143/real 1775775143] req@ffff8de1c7af5c00 x1862023612616320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775143.744201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612616320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775143.744206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775143.744208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775143.744210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775143.744213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775143.744223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775143.744228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775143/real 1775775143] req@ffff8de1c7af6d80 x1862023612616448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775143.744235:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612616448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775143.744240:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775143.744242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775143.744243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775143.744246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775143.744255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775143.744260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775143/real 1775775143] req@ffff8de1c7af4e00 x1862023612616576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775143.744266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612616576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775143.744272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775143.744274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775143.744276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775144.703873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775145.727909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775146.751850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775147.775888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775148.799921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775148.863850:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775148.863858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775148.863862:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775148.863870:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11120 00000100:00080000:0.0:1775775148.863880:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775148.863885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775148.863917:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612616704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775148.863943:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775148.863945:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775148.863947:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775148.863950:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11120 00000100:00080000:0.0:1775775148.863952:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775148.863955:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775148.863962:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775148.863970:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612616832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775148.863977:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775148.863980:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775148.863982:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775148.863987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11120 00000100:00080000:0.0:1775775148.863990:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775148.863995:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775148.864000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775148.864003:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612616704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775148.864014:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612616960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775148.864027:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775148.864031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775148.864033:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775148.864038:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11120 00000100:00080000:0.0:1775775148.864051:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775148.864059:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775775148.864059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775148.864067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775148.864079:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612617088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775148.864087:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775148.864090:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775148.864091:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775148.864096:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11120 00000100:00100000:1.0:1775775148.864097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775148/real 1775775148] req@ffff8de1c5683b80 x1862023612616704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775148.864101:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775148.864108:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775148.864113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775148.864120:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612616704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775148.864122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612617216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775148.864149:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775148.864155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775148.864158:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612616704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775148.864164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775148.864181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775148.864189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775148/real 1775775148] req@ffff8de1c5682300 x1862023612616832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775148.864197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612616832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775148.864202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775148.864205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775148.864207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775148.864229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775148.864249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775148.864260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775148/real 1775775148] req@ffff8de1c5680700 x1862023612616960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775148.864274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612616960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775148.864282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775148.864285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775148.864287:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612616960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775148.864292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775148.864306:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775148.864313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775148/real 1775775148] req@ffff8de1c5682d80 x1862023612617088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775148.864321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612617088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775148.864326:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775148.864328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775148.864330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775148.864333:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775148.864343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775148.864347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775148/real 1775775148] req@ffff8de1c5682680 x1862023612617216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775148.864355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612617216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775148.864359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775148.864361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775148.864363:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775149.823937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775150.847922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775151.871908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775152.895926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775153.919959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775153.983868:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775153.983880:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775153.983886:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775153.983902:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11125 00000100:00080000:0.0:1775775153.983918:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775153.983926:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775153.983974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612617344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775153.984014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775153.984019:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775153.984022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775153.984029:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11125 00000100:00080000:0.0:1775775153.984034:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775153.984040:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775153.984055:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775153.984063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612617344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775153.984076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612617472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775153.984087:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775153.984091:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775153.984093:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775153.984096:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11125 00000100:00080000:0.0:1775775153.984099:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775153.984102:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775153.984108:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775153.984118:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612617600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775153.984124:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775153.984127:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775153.984129:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775153.984133:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11125 00000100:00080000:0.0:1775775153.984135:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775153.984138:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775153.984142:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775153.984148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775153.984156:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612617728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775153.984165:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775153.984168:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775153.984169:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775153.984174:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11125 00000100:00080000:0.0:1775775153.984177:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775153.984181:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775153.984187:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775153.984208:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612617856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775153.984210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775153/real 1775775153] req@ffff8de1c5682680 x1862023612617344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775153.984253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612617344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775153.984266:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775153.984271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775153.984275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612617344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775153.984301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775153.984330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775153.984344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775153/real 1775775153] req@ffff8de1c5682d80 x1862023612617472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775153.984358:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612617472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775153.984366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775153.984370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775153.984373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775153.984381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775153.984403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775153.984415:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775153/real 1775775153] req@ffff8de1c5680700 x1862023612617600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775153.984426:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612617600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775153.984434:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775153.984438:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775153.984441:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775153.984446:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775153.984469:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775153.984478:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775153/real 1775775153] req@ffff8de1c5682300 x1862023612617728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775153.984499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612617728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775153.984508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775153.984512:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775153.984515:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775153.984522:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775153.984545:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775153.984561:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775153/real 1775775153] req@ffff8de1c5683b80 x1862023612617856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775153.984575:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612617856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775153.984585:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775153.984592:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775153.984598:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612617856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775154.943929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775155.967913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775156.991917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775158.015985:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775159.039867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775159.103837:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775159.103849:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775159.103855:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775159.103869:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11130 00000100:00080000:2.0:1775775159.103883:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775159.103898:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775159.103942:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612617984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775159.103969:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775159.103972:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775159.103973:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775159.103977:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11130 00000100:00080000:2.0:1775775159.103980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775159.103984:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775159.103994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775159.104006:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612617984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775159.104010:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612618112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775159.104025:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775159.104030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775159.104032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775159.104036:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11130 00000100:00080000:2.0:1775775159.104042:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775159.104047:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775159.104052:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775159.104065:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612618240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775159.104073:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775159.104076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775159.104078:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775159.104084:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11130 00000800:00000100:1.0:1775775159.104085:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775159.104091:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775159.104095:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775159.104099:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775159.104108:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612618368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775159.104114:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775159.104117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775159.104118:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775159.104121:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11130 00000100:00080000:2.0:1775775159.104124:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775159.104128:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775159/real 1775775159] req@ffff8de1d0f2df80 x1862023612617984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775159.104129:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775159.104135:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775159.104146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612618496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775159.104156:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612617984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775159.104166:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775159.104170:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775159.104174:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612617984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775159.104197:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775159.104213:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775159.104221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775159/real 1775775159] req@ffff8de1d0f2d500 x1862023612618112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775159.104229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612618112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775159.104249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775159.104252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775159.104254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775159.104258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775159.104277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775159.104288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775159/real 1775775159] req@ffff8de1d0f2e680 x1862023612618240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775159.104300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612618240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775159.104309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775159.104313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775159.104316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775159.104323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775159.104343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775159.104351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775159/real 1775775159] req@ffff8de1d0f2e300 x1862023612618368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775159.104359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612618368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775159.104365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775159.104375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775159.104378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775159.104382:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775159.104394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775159.104400:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775159/real 1775775159] req@ffff8de1d0f2c700 x1862023612618496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775159.104408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612618496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775159.104413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775159.104415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775159.104417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775160.063916:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775161.087896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775162.111887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775163.135904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775164.159863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775164.223839:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775164.223846:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775164.223850:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775164.223859:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11135 00000100:00080000:3.0:1775775164.223872:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775164.223879:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775164.223916:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612618624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775164.223945:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775164.223957:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775164.223960:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775164.223964:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11135 00000100:00080000:3.0:1775775164.223970:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775164.223974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775164.223985:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775164.223989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612618624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775164.224003:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612618752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775164.224015:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775164.224019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775164.224021:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775164.224026:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11135 00000100:00080000:3.0:1775775164.224030:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775164.224033:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775164.224039:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775164.224053:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612618880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775164.224054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775164.224066:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775164.224070:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775164.224072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775164.224077:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11135 00000100:00080000:3.0:1775775164.224081:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775164.224086:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775164.224096:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775164/real 1775775164] req@ffff8de1c7af5500 x1862023612618624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775775164.224100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775164.224116:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612619008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775164.224125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612618624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775164.224129:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775164.224137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775164.224142:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775164.224145:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775164.224152:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775164.224155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612618624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775164.224155:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11135 00000100:00080000:3.0:1775775164.224163:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775164.224169:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775164.224174:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775164.224181:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775164.224187:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612619136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775164.224204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775164.224214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775164/real 1775775164] req@ffff8de1c7af5880 x1862023612618752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775164.224226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612618752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775164.224232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775164.224234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775164.224237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775164.224241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775164.224258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775164.224267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775164/real 1775775164] req@ffff8de1c7af4a80 x1862023612618880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775164.224280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612618880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775164.224288:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775164.224291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775164.224295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612618880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775164.224301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775164.224321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775164.224333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775164/real 1775775164] req@ffff8de1c7af5f80 x1862023612619008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775164.224343:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612619008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775164.224349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775164.224351:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775164.224353:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775164.224370:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775164.224391:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775164.224402:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775164/real 1775775164] req@ffff8de1c7af4380 x1862023612619136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775164.224414:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612619136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775164.224423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775164.224426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775164.224429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775165.183883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775166.207871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775167.231911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775168.255868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775169.279900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775169.343853:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775169.343861:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775169.343865:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775169.343873:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11141 00000100:00080000:2.0:1775775169.343883:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775169.343889:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775169.343921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612619264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775169.343943:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775169.343946:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775169.343947:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775169.343950:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11141 00000100:00080000:2.0:1775775169.343953:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775169.343955:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775169.343963:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775169.343970:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612619392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775169.343977:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775169.343979:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775169.343980:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775169.343982:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11141 00000100:00080000:2.0:1775775169.343983:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775169.343985:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775169.343988:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775169.343995:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612619520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775169.343999:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775169.344001:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775169.344003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775169.344005:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11141 00000100:00080000:2.0:1775775169.344007:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775169.344010:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775169.344014:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775169.344020:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612619648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775169.344027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775169.344031:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612619264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775169.344031:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775169.344032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775169.344039:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11141 00000100:00080000:2.0:1775775169.344042:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775169.344044:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775169.344047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775169.344055:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612619776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775169.344098:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775169.344133:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775169/real 1775775169] req@ffff8de1d0f2ca80 x1862023612619264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775169.344153:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612619264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775169.344164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775169.344168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775169.344171:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612619264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775169.344177:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775169.344195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775169.344204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775169/real 1775775169] req@ffff8de1d0f2f100 x1862023612619392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775169.344213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612619392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775169.344219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775169.344221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775169.344223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775169.344227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775169.344247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775169.344253:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775169/real 1775775169] req@ffff8de1d0f2c700 x1862023612619520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775169.344261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612619520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775169.344266:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775169.344268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775169.344270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775169.344299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775169.344320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775169.344331:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775169/real 1775775169] req@ffff8de1d0f2e300 x1862023612619648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775169.344345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612619648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775169.344353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775169.344356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775169.344358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775169.344363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775169.344380:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775169.344391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775169/real 1775775169] req@ffff8de1d0f2e680 x1862023612619776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775169.344404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612619776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775169.344413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775169.344416:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775169.344420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612619776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775170.303893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775171.327922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775172.351864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775173.375889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775174.399871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775174.463884:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775174.463898:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775174.463905:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775174.463919:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11146 00000100:00080000:3.0:1775775174.463934:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775174.463944:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775174.463998:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612619904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775174.464032:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775174.464037:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775174.464040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775174.464044:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11146 00000100:00080000:3.0:1775775174.464049:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775174.464053:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775174.464066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775174.464083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612620032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775174.464094:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612619904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775174.464100:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775174.464115:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775174.464118:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775174.464124:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11146 00000100:00080000:3.0:1775775174.464129:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775174.464133:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775174.464140:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775174.464154:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612620160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775174.464165:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775174.464169:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775174.464171:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775174.464176:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11146 00000800:00000100:1.0:1775775174.464180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775174.464190:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775174.464197:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775174.464204:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775174.464218:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612620288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775174.464232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775174/real 1775775174] req@ffff8de1c7af5180 x1862023612619904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775174.464241:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775174.464251:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775174.464255:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775174.464261:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11146 00000100:00080000:3.0:1775775174.464265:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775174.464269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612619904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775174.464272:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775174.464281:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775775174.464298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775775174.464299:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612620416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775174.464308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775174.464319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612619904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775174.464351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775174.464421:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775174.464436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775174/real 1775775174] req@ffff8de1c7af7100 x1862023612620032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775174.464450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612620032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775174.464459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775174.464463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775174.464466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775174.464474:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775174.464496:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775174.464509:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775174/real 1775775174] req@ffff8de1c7af7800 x1862023612620160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775174.464522:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612620160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775174.464531:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775174.464535:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775174.464538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775174.464545:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775174.464568:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775174.464580:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775174/real 1775775174] req@ffff8de1c7af4380 x1862023612620288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775174.464593:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612620288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775174.464601:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775174.464604:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775174.464608:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775174.464614:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775174.464636:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775174.464647:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775174/real 1775775174] req@ffff8de1c7af5f80 x1862023612620416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775174.464659:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612620416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775174.464667:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775174.464670:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775174.464673:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775175.423921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775176.447877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775177.471915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775178.495847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775179.519875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775179.583822:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775179.583832:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775179.583838:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775179.583850:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11151 00000100:00080000:3.0:1775775179.583863:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775179.583871:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775179.583911:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612620544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775179.583945:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775179.583949:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775179.583951:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775179.583956:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11151 00000100:00080000:3.0:1775775179.583960:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775179.583964:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775179.583975:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775179.583992:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612620672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775179.584004:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775179.584008:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612620544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775179.584009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775179.584013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775179.584022:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11151 00000100:00080000:3.0:1775775179.584026:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775179.584047:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775179.584054:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775179.584069:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612620800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775179.584079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775775179.584081:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775179.584086:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775179.584088:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775179.584094:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11151 00000100:00080000:3.0:1775775179.584099:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775179.584103:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775179.584109:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775179.584125:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775179/real 1775775179] req@ffff8de1c7af4a80 x1862023612620544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775179.584125:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612620928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775179.584159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612620544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775179.584164:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775179.584175:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775179.584176:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775179.584178:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775179.584182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775775179.584187:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11151 00000100:00100000:1.0:1775775179.584188:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612620544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775179.584196:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775179.584202:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775179.584208:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775179.584216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775179.584224:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612621056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775179.584239:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775179.584250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775179/real 1775775179] req@ffff8de1c7af5880 x1862023612620672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775179.584260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612620672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775179.584266:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775179.584268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775179.584270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775179.584274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775179.584303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775179.584312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775179/real 1775775179] req@ffff8de1c7af5500 x1862023612620800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775179.584320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612620800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775179.584330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775179.584332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775179.584334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775179.584337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775179.584349:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775179.584355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775179/real 1775775179] req@ffff8de1c7af4e00 x1862023612620928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775179.584362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612620928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775179.584367:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775179.584368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775179.584370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612620928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775179.584389:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775179.584401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775179.584407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775179/real 1775775179] req@ffff8de1c7af6d80 x1862023612621056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775179.584414:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612621056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775179.584419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775179.584421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775179.584425:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775180.543869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775181.567908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775182.591857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775183.615904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775184.639962:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775184.703877:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775184.703886:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775184.703891:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775184.703902:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11156 00000100:00080000:0.0:1775775184.703915:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775184.703923:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775184.703969:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612621184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775184.703997:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775184.704001:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775184.704002:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775184.704005:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11156 00000100:00080000:0.0:1775775184.704008:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775184.704010:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775184.704020:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775184.704029:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612621312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775184.704037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775184.704040:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775184.704041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775184.704044:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11156 00000100:00080000:0.0:1775775184.704045:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775184.704050:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775184.704052:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612621184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775184.704054:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775184.704065:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612621440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775184.704071:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775184.704073:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775184.704075:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775184.704078:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11156 00000100:00080000:0.0:1775775184.704080:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775184.704083:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775184.704086:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775184.704095:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612621568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775184.704101:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775184.704103:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775184.704104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775184.704107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11156 00000100:00080000:0.0:1775775184.704117:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775184.704119:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775184.704123:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775184.704128:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775184.704132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612621696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775184.704170:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775184/real 1775775184] req@ffff8de1c5681c00 x1862023612621184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775184.704188:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612621184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775184.704220:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775184.704223:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775184.704226:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612621184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775184.704233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775184.704252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775184.704262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775184/real 1775775184] req@ffff8de1c5681f80 x1862023612621312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775184.704271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612621312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775184.704276:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775184.704279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775184.704281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775184.704305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775184.704316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775184.704323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775184/real 1775775184] req@ffff8de1c5682a00 x1862023612621440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775184.704332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612621440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775184.704337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775184.704339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775184.704341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775184.704344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775184.704355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775184.704360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775184/real 1775775184] req@ffff8de1c5680380 x1862023612621568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775184.704368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612621568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775184.704373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775184.704375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775184.704377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775184.704380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775184.704390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775184.704408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775184/real 1775775184] req@ffff8de1c5680000 x1862023612621696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775184.704417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612621696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775184.704423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775184.704425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775184.704427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775185.663887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775186.687984:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775187.711943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775188.735980:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775189.759938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775189.823852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775189.823863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775189.823869:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775189.823882:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11161 00000100:00080000:0.0:1775775189.823896:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775189.823903:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775189.823943:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612621824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775189.823984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775189.823988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775189.823990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775189.823994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11161 00000100:00080000:0.0:1775775189.823998:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775189.824001:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775189.824010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775189.824024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612621952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775189.824033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775189.824035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775189.824037:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775189.824045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11161 00000100:00100000:3.0:1775775189.824047:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612621824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775189.824049:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775189.824061:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775189.824068:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775189.824087:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612622080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775189.824098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775189.824131:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775189.824134:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775189.824140:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11161 00000100:00080000:0.0:1775775189.824145:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775189.824153:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775189.824160:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775189.824171:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775189.824177:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612622208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775189.824194:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775189.824199:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775189.824200:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775189.824204:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11161 00000100:00080000:0.0:1775775189.824209:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775189.824213:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775189.824217:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775189.824225:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612622336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775189.824290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775189/real 1775775189] req@ffff8de1c5683800 x1862023612621824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775189.824311:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612621824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775189.824321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775189.824326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775189.824331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612621824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775189.824357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775189.824377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775189.824493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775189/real 1775775189] req@ffff8de1c5681500 x1862023612621952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775189.824506:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612621952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775189.824565:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775189.824573:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775189.824576:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612621952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775189.824583:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775189.824609:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775189.824625:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775189/real 1775775189] req@ffff8de1c5681880 x1862023612622080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775189.824635:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612622080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775189.824641:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775189.824644:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775189.824646:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775189.824650:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775189.824661:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775189.824667:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775189/real 1775775189] req@ffff8de1c5680e00 x1862023612622208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775189.824675:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612622208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775189.824679:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775189.824681:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775189.824684:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775189.824688:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775189.824699:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775189.824704:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775189/real 1775775189] req@ffff8de1c5683480 x1862023612622336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775189.824711:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612622336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775189.824717:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775189.824718:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775189.824720:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775190.783957:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775191.807897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775192.831875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775193.855881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775194.879910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775194.943854:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775194.943863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775194.943869:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775194.943879:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11166 00000100:00080000:0.0:1775775194.943892:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775194.943900:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775194.943938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612622464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775194.943965:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775194.943969:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775194.943971:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775194.943976:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11166 00000100:00080000:0.0:1775775194.943980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775194.943985:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775194.943995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775194.944002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612622464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775194.944011:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612622592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775194.944042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775194.944046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775194.944048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775194.944053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11166 00000100:00080000:0.0:1775775194.944058:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775194.944062:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775194.944068:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775194.944081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612622720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775194.944089:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775194.944104:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775194.944108:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775194.944110:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775194.944115:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11166 00000100:00080000:0.0:1775775194.944120:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775194.944124:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775194/real 1775775194] req@ffff8de1c5683480 x1862023612622464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775194.944127:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775194.944138:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775194.944144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612622464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775194.944153:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612622848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775194.944153:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775194.944160:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775194.944166:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612622464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775194.944175:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775194.944179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775194.944181:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775194.944186:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11166 00000100:00100000:3.0:1775775194.944189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622592:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775775194.944191:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775194.944198:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775194.944204:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775194.944209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775194.944220:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612622976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775194.944221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775194/real 1775775194] req@ffff8de1c5680e00 x1862023612622592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775194.944257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612622592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775194.944264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775194.944266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775194.944269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775194.944274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775194.944286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775194.944292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775194/real 1775775194] req@ffff8de1c5681880 x1862023612622720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775194.944300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612622720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775194.944307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775194.944310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775194.944313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775194.944318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775194.944330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775194.944336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775194/real 1775775194] req@ffff8de1c5681500 x1862023612622848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775194.944343:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612622848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775194.944348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775194.944350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775194.944352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775194.944361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775194.944370:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775194.944386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775194/real 1775775194] req@ffff8de1c5683800 x1862023612622976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775194.944398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612622976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775194.944403:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775194.944405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775194.944407:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612622976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775195.903879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775196.927887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775197.951839:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775198.975874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775199.999907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775200.063851:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775200.063858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775200.063863:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775200.063871:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11171 00000100:00080000:2.0:1775775200.063881:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775200.063905:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775200.063952:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612623104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775200.063975:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775200.063978:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775200.063980:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775200.063982:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11171 00000100:00080000:2.0:1775775200.063986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775200.063989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775200.063997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775200.064006:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612623232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775200.064014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775200.064016:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775200.064018:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775200.064021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11171 00000100:00080000:2.0:1775775200.064023:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775200.064025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612623104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775200.064028:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775200.064035:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775200.064044:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612623360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775200.064051:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775200.064054:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775200.064055:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775200.064058:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11171 00000100:00080000:2.0:1775775200.064060:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775200.064062:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775200.064065:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775200.064071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612623488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775200.064083:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775200.064085:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775200.064088:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775200.064092:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11171 00000100:00080000:2.0:1775775200.064096:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775200.064100:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775200.064106:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775200.064110:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775200.064122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612623616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775200.064145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775200.064161:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775200.064174:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775201.023867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775202.047877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775203.071836:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775203.136005:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775203.136040:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775203.136057:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775203.136097:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775203.136108:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775203.136118:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775203.136129:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775775203.136154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775200/real 1775775203] req@ffff8de1d0f2e680 x1862023612623360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775203.136186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612623360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775203.136197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775203.136202:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775203.136206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775203.136214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775200/real 1775775203] req@ffff8de1d0f2e300 x1862023612623488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775203.136226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612623488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775203.136233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775203.136237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775203.136240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775203.136247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775200/real 1775775203] req@ffff8de1d0f2c700 x1862023612623616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775203.136258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612623616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775203.136265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775203.136269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775203.136272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623616:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775203.136280:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775200/real 1775775203] req@ffff8de1d0f2d500 x1862023612623104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775203.136292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612623104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775203.136299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775203.136303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775203.136306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612623104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775203.136313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775200/real 1775775203] req@ffff8de1d0f2df80 x1862023612623232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775203.136324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612623232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775203.136332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775203.136335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775203.136339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623232:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775775204.095836:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775205.119877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775205.183852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775205.183861:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775205.183864:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775205.183873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11176 00000100:00080000:0.0:1775775205.183882:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775205.183887:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775205.183916:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612623744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775205.183942:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775205.183946:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775205.183948:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775205.183953:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11176 00000100:00080000:0.0:1775775205.183956:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775205.183961:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775205.183971:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775205.183986:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612623872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775205.184006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775775205.184006:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612623744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775205.184014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775205.184018:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775205.184024:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11176 00000100:00080000:0.0:1775775205.184028:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775205.184033:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775205.184038:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775205.184053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612624000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775205.184063:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775205.184067:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775205.184069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775205.184073:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11176 00000100:00080000:0.0:1775775205.184077:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775205.184082:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775775205.184086:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775205.184094:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775205.184112:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612624128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775205.184121:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775205.184125:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775205.184126:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775775205.184131:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775205/real 1775775205] req@ffff8de1c5680000 x1862023612623744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775205.184134:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11176 00000100:00080000:0.0:1775775205.184141:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775205.184148:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775205.184154:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775205.184162:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612623744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775205.184168:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612624256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775205.184185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775205.184193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775205.184198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612623744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775205.184229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775205.184255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775205.184268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775205/real 1775775205] req@ffff8de1c5680380 x1862023612623872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775205.184282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612623872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775205.184289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775205.184292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775205.184296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612623872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775205.184301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775205.184322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775205.184332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775205/real 1775775205] req@ffff8de1c5682a00 x1862023612624000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775205.184360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612624000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775205.184369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775205.184372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775205.184375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775205.184382:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775205.184404:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775205.184415:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775205/real 1775775205] req@ffff8de1c5681f80 x1862023612624128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775205.184428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612624128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775205.184435:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775205.184438:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775205.184441:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775205.184447:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775205.184474:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775205.184488:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775205/real 1775775205] req@ffff8de1c5681c00 x1862023612624256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775205.184499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612624256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775205.184506:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775205.184525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775205.184530:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775206.143909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775207.167870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775208.191855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775209.215913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775210.239872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775210.303837:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775210.303845:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775210.303849:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775210.303858:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11182 00000100:00080000:0.0:1775775210.303868:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775210.303875:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775210.303908:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612624384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775210.303930:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775210.303932:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775210.303934:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775210.303936:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11182 00000100:00080000:0.0:1775775210.303939:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775210.303941:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775210.303949:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775210.303957:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612624512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775210.303964:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612624384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775210.303967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775210.303972:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775210.303974:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775210.303977:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11182 00000100:00080000:0.0:1775775210.303979:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775210.303981:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775210.303984:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775210.303992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612624640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775210.303998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775210.304000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775210.304001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775210.304004:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11182 00000100:00080000:0.0:1775775210.304006:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775210.304008:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775210.304011:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775210.304018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612624768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775210.304024:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:3.0:1775775210.304028:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775210.304029:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775210.304033:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775210.304037:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11182 00000100:00080000:0.0:1775775210.304041:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775210.304045:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775210.304051:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775210.304062:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775210/real 1775775210] req@ffff8de1c5683b80 x1862023612624384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775210.304066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612624896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775210.304092:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612624384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775210.304105:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775210.304109:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775210.304112:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612624384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775210.304130:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775210.304145:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775210.304153:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775210/real 1775775210] req@ffff8de1c5682300 x1862023612624512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775210.304161:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612624512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775210.304166:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775210.304168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775210.304170:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775210.304174:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775210.304183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775210.304188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775210/real 1775775210] req@ffff8de1c5680700 x1862023612624640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775210.304195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612624640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775210.304200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775210.304202:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775210.304204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775210.304208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775210.304218:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775210.304224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775210/real 1775775210] req@ffff8de1c5682d80 x1862023612624768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775210.304231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612624768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775210.304237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775210.304238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775210.304240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775210.304243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775210.304252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775210.304256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775210/real 1775775210] req@ffff8de1c5682680 x1862023612624896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775210.304263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612624896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775210.304268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775210.304270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775210.304272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612624896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775211.263883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775212.287896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775213.311856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775214.335887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775215.359868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775215.423815:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775215.423823:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775215.423827:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775215.423835:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11187 00000100:00080000:2.0:1775775215.423845:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775215.423851:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775215.423883:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612625024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775215.423905:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775215.423907:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775215.423909:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775215.423911:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11187 00000100:00080000:2.0:1775775215.423914:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775215.423916:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775215.423924:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775215.423931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612625152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775215.423938:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775215.423940:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775215.423942:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775215.423945:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11187 00000100:00080000:2.0:1775775215.423947:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775215.423950:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775215.423953:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775215.423960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612625280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775215.423967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775215.423969:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775215.423971:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775775215.423971:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612625024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775215.423975:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11187 00000100:00080000:2.0:1775775215.423980:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775215.423984:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775215.423987:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775215.423993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612625408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775215.424000:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775215.424002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775215.424004:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775215.424006:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11187 00000100:00080000:2.0:1775775215.424009:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775215.424011:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775215.424014:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775215.424020:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612625536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775215.424042:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775215.424077:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775215/real 1775775215] req@ffff8de1d0f2f100 x1862023612625024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775215.424098:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612625024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775215.424110:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775215.424115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775215.424119:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612625024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775215.424125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775215.424144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775215.424154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775215/real 1775775215] req@ffff8de1d0f2ca80 x1862023612625152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775215.424162:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612625152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775215.424167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775215.424169:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775215.424172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775215.424191:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775215.424202:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775215.424208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775215/real 1775775215] req@ffff8de1d0f2df80 x1862023612625280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775215.424215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612625280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775215.424225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775215.424227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775215.424229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775215.424232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775215.424242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775215.424247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775215/real 1775775215] req@ffff8de1d0f2d500 x1862023612625408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775215.424254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612625408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775215.424259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775215.424261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775215.424263:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775215.424266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775215.424276:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775215.424281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775215/real 1775775215] req@ffff8de1d0f2c700 x1862023612625536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775215.424288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612625536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775215.424293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775215.424294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775215.424297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775216.383865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775217.407846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775218.431902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775219.455876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775220.479882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775220.543850:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775220.543858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775220.543862:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775220.543870:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11192 00000100:00080000:0.0:1775775220.543881:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775220.543887:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775220.543920:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612625664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775220.543945:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775220.543948:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775220.543950:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775220.543952:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11192 00000100:00080000:0.0:1775775220.543955:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775220.543957:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775220.543967:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775220.543975:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612625792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775220.543982:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775220.543985:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775220.543986:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775220.543988:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11192 00000100:00080000:0.0:1775775220.543990:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775220.543992:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775220.543994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775220.543999:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612625920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775220.544009:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775220.544012:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775220.544014:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775220.544018:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11192 00000100:00080000:0.0:1775775220.544022:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775220.544026:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775220.544032:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775220.544036:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612625664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775220.544046:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612626048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775220.544058:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775220.544062:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775220.544064:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775220.544067:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11192 00000100:00080000:0.0:1775775220.544070:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775220.544073:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775220.544077:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775220.544086:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612626176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775220.544108:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775220.544151:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775220/real 1775775220] req@ffff8de1c5682680 x1862023612625664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775220.544170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612625664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775220.544180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775220.544185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775220.544188:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612625664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775220.544194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775220.544211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775220.544220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775220/real 1775775220] req@ffff8de1c5682d80 x1862023612625792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775220.544228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612625792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775220.544233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775220.544235:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775220.544237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775220.544241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775220.544250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775220.544256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775220/real 1775775220] req@ffff8de1c5680700 x1862023612625920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775220.544263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612625920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775220.544268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775220.544270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775220.544271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612625920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775220.544292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775220.544302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775220.544308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775220/real 1775775220] req@ffff8de1c5682300 x1862023612626048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775220.544315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612626048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775220.544319:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775220.544321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775220.544323:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775220.544326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775220.544335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775220.544340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775220/real 1775775220] req@ffff8de1c5683b80 x1862023612626176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775220.544346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612626176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775220.544351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775220.544354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775220.544356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775221.503901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775222.527855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775223.551913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775224.575876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775225.599893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775225.663804:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775225.663812:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775225.663816:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775225.663825:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11197 00000100:00080000:0.0:1775775225.663845:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775225.663855:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775225.663893:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612626304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775225.663928:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775225.663932:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775225.663933:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775225.663937:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11197 00000100:00080000:0.0:1775775225.663941:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775225.663945:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775225.663954:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775225.663969:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612626432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775225.663983:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612626304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775225.663984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775225.663993:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775225.663995:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775225.664001:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11197 00000100:00080000:0.0:1775775225.664006:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775225.664011:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775225.664018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775225.664033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612626560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775225.664045:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775225.664049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775225.664052:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775775225.664059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775225.664063:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11197 00000100:00080000:0.0:1775775225.664070:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775225.664076:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775225.664091:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775225.664097:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775225/real 1775775225] req@ffff8de1c5681c00 x1862023612626304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775225.664106:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612626688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775225.664116:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775225.664119:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775225.664122:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775775225.664122:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612626304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775225.664129:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11197 00000100:00080000:0.0:1775775225.664134:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775225.664141:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:2.0:1775775225.664143:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:0.0:1775775225.664145:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775225.664151:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775225.664158:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612626816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775225.664159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612626304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775225.664192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775225.664217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775225.664229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775225/real 1775775225] req@ffff8de1c5681f80 x1862023612626432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775225.664241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612626432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775225.664256:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775225.664259:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775225.664264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775225.664270:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775225.664290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775225.664303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775225/real 1775775225] req@ffff8de1c5682a00 x1862023612626560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775225.664317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612626560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775225.664328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775225.664332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775225.664337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775225.664347:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775225.664369:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775225.664384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775225/real 1775775225] req@ffff8de1c5680380 x1862023612626688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775225.664399:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612626688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775225.664407:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775225.664411:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775225.664414:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775225.664420:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775225.664438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775225.664448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775225/real 1775775225] req@ffff8de1c5680000 x1862023612626816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775225.664462:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612626816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775225.664470:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775225.664473:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775225.664490:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612626816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775226.623863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775227.647927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775228.671860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775229.695913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775230.719915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775230.783829:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775230.783839:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775230.783843:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775230.783854:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11202 00000100:00080000:0.0:1775775230.783867:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775230.783881:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775230.783928:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612626944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775230.783951:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775230.783955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775230.783956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775230.783960:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11202 00000100:00080000:0.0:1775775230.783963:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775230.783966:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775230.783976:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775230.783985:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612627072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775230.783993:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775230.783996:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775230.783997:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775230.784000:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11202 00000100:00080000:0.0:1775775230.784002:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775230.784005:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775230.784008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775230.784014:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612626944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775230.784016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612627200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775230.784026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775230.784030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775230.784031:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775230.784034:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11202 00000100:00080000:0.0:1775775230.784036:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775230.784038:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775230.784041:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775230.784056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612627328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775230.784067:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775230.784070:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775230.784072:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775230.784074:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11202 00000100:00080000:0.0:1775775230.784076:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775230.784079:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775230.784082:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775230.784090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612627456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775230.784103:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775230.784141:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775230/real 1775775230] req@ffff8de1c5683800 x1862023612626944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775230.784156:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612626944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775230.784165:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775230.784168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775230.784172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612626944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775230.784177:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775230.784191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775230.784200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775230/real 1775775230] req@ffff8de1c5681500 x1862023612627072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775230.784208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612627072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775230.784213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775230.784222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775230.784225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775230.784248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775230.784261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775230.784267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775230/real 1775775230] req@ffff8de1c5681880 x1862023612627200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775230.784275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612627200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775230.784281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775230.784283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775230.784285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775230.784288:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775230.784298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775230.784303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775230/real 1775775230] req@ffff8de1c5680e00 x1862023612627328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775230.784310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612627328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775230.784316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775230.784318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775230.784320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775230.784323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775230.784333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775230.784338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775230/real 1775775230] req@ffff8de1c5683480 x1862023612627456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775230.784344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612627456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775230.784348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775230.784350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775230.784351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775231.743910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775232.767916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775233.791928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775234.815924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775235.839942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775235.903872:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775235.903882:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775235.903887:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775235.903898:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11207 00000100:00080000:3.0:1775775235.903912:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775235.903921:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775235.903974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612627584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775235.904001:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775235.904004:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775235.904005:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775235.904009:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11207 00000100:00080000:3.0:1775775235.904013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775235.904015:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775235.904026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775235.904037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612627712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775235.904045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775235.904048:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775775235.904055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612627584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775235.904057:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775235.904065:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11207 00000100:00080000:3.0:1775775235.904068:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775235.904070:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775235.904074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775235.904083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612627840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775235.904090:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775235.904093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775235.904094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775235.904096:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11207 00000100:00080000:3.0:1775775235.904098:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775235.904100:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775235.904104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775235.904110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612627968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775235.904116:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775235.904119:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775235.904120:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775235.904122:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11207 00000100:00080000:3.0:1775775235.904126:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775235.904129:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775235.904131:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775235.904139:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612628096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775235.904147:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775235.904188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775235/real 1775775235] req@ffff8de1c7af5c00 x1862023612627584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775235.904206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612627584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775235.904215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775235.904218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775235.904221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612627584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775235.904244:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775235.904261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775235.904269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775235/real 1775775235] req@ffff8de1c7af7b80 x1862023612627712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775235.904277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612627712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775235.904282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775235.904284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775235.904287:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775235.904290:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775235.904324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775235.904333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775235/real 1775775235] req@ffff8de1c7af7480 x1862023612627840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775235.904341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612627840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775235.904346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775235.904349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775235.904351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775235.904354:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775235.904367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775235.904373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775235/real 1775775235] req@ffff8de1c7af4000 x1862023612627968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775235.904381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612627968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775235.904390:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775235.904393:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775235.904397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612627968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775235.904403:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775235.904423:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775235.904433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775235/real 1775775235] req@ffff8de1c7af6300 x1862023612628096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775235.904446:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612628096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775235.904454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775235.904458:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775235.904461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775236.863911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775237.887879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775238.911892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775239.935929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775240.959944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775241.023845:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775241.023857:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775241.023862:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775241.023871:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11212 00000100:00080000:0.0:1775775241.023882:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775241.023887:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775241.023921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612628224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775241.023946:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775241.023949:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775241.023951:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775241.023954:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11212 00000100:00080000:0.0:1775775241.023956:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775241.023958:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775241.023973:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775241.023987:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612628352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775241.023999:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775241.024005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775775241.024006:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612628224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775241.024008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775241.024017:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11212 00000100:00080000:0.0:1775775241.024021:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775241.024025:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775241.024031:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775241.024051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612628480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775241.024062:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775241.024066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775241.024068:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775241.024072:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11212 00000800:00000100:2.0:1775775241.024078:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775241.024079:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775241.024085:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775241.024092:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775241.024103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612628608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775241.024112:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775241.024116:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775241.024118:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775775241.024118:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775241/real 1775775241] req@ffff8de1c5683480 x1862023612628224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775241.024125:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11212 00000100:00080000:0.0:1775775241.024132:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775241.024139:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775241.024145:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775241.024149:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612628224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775241.024157:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612628736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775241.024190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775241.024196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775241.024201:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612628224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775241.024242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775241.024266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775241.024278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775241/real 1775775241] req@ffff8de1c5680e00 x1862023612628352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775241.024292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612628352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775241.024300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775241.024304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775241.024308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775241.024314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775241.024330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775241.024338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775241/real 1775775241] req@ffff8de1c5681880 x1862023612628480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775241.024350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612628480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775241.024358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775241.024362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775241.024365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775241.024371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775241.024386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775241.024394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775241/real 1775775241] req@ffff8de1c5681500 x1862023612628608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775241.024406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612628608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775241.024414:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775241.024417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775241.024420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775241.024426:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775241.024441:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775241.024449:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775241/real 1775775241] req@ffff8de1c5683800 x1862023612628736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775241.024460:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612628736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775241.024468:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775241.024471:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775241.024474:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775241.983876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775243.007955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775244.031854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775245.055908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775246.079913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775246.143838:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775246.143849:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775246.143862:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775246.143871:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11217 00000100:00080000:0.0:1775775246.143882:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775246.143889:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775246.143936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612628864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775246.143964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775246.143969:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775246.143970:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775246.143976:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11217 00000100:00080000:0.0:1775775246.143981:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775246.143985:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775246.143996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775246.144001:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612628864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775246.144011:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612628992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775246.144021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775246.144023:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775246.144025:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775246.144028:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11217 00000100:00080000:0.0:1775775246.144031:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775246.144033:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775246.144037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775246.144048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612629120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775246.144057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775246.144061:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775246.144063:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775246.144068:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11217 00000800:00000100:2.0:1775775246.144072:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775246.144075:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775246.144082:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775246.144089:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775246.144102:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612629248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775246.144111:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775246/real 1775775246] req@ffff8de1c5680000 x1862023612628864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775246.144115:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775246.144135:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775246.144137:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775246.144140:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11217 00000100:00080000:0.0:1775775246.144147:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775246.144151:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775246.144155:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775246.144166:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612629376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775246.144168:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612628864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775246.144190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775246.144195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775246.144199:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612628864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775246.144219:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775246.144239:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775246.144248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775246/real 1775775246] req@ffff8de1c5680380 x1862023612628992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775246.144257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612628992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775246.144266:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775246.144269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775246.144272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612628992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775246.144279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775246.144300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775246.144312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775246/real 1775775246] req@ffff8de1c5682a00 x1862023612629120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775246.144324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612629120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775246.144339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775246.144343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775246.144346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775246.144353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775246.144372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775246.144379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775246/real 1775775246] req@ffff8de1c5681f80 x1862023612629248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775246.144390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612629248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775246.144398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775246.144401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775246.144405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775246.144411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775246.144431:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775246.144442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775246/real 1775775246] req@ffff8de1c5681c00 x1862023612629376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775246.144454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612629376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775246.144462:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775246.144465:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775246.144470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775247.103912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775248.127891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775249.151861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775250.175843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775251.199871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775251.263866:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775251.263875:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775251.263880:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775251.263888:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11223 00000100:00080000:0.0:1775775251.263898:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775251.263905:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775251.263937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612629504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775251.263957:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775251.263960:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775251.263961:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775251.263964:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11223 00000100:00080000:0.0:1775775251.263967:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775251.263969:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775251.263978:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775251.263985:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612629504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775251.263988:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612629632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775251.263998:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775251.264000:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775251.264001:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775251.264003:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11223 00000100:00080000:0.0:1775775251.264005:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775251.264007:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775251.264010:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775251.264019:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612629760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775251.264025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775251.264028:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775251.264029:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775251.264048:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11223 00000100:00080000:0.0:1775775251.264052:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775251.264054:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775251.264058:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775251.264063:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775251.264071:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612629888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775251.264079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775251.264081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775251.264082:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775251.264085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11223 00000100:00080000:0.0:1775775251.264088:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775251.264091:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775251.264095:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775251.264099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775251/real 1775775251] req@ffff8de1c5683b80 x1862023612629504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775251.264104:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612630016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775251.264131:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612629504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775251.264140:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775251.264144:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775251.264147:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612629504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775251.264166:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775251.264182:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775251.264190:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775251/real 1775775251] req@ffff8de1c5682300 x1862023612629632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775251.264198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612629632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775251.264204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775251.264206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775251.264208:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775251.264212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775251.264222:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775251.264228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775251/real 1775775251] req@ffff8de1c5680700 x1862023612629760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775251.264235:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612629760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775251.264241:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775251.264242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775251.264244:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775251.264247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775251.264257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775251.264262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775251/real 1775775251] req@ffff8de1c5682d80 x1862023612629888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775251.264269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612629888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775251.264274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775251.264275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775251.264277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612629888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775251.264280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775251.264289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775251.264294:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775251/real 1775775251] req@ffff8de1c5682680 x1862023612630016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775251.264300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612630016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775251.264306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775251.264308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775251.264310:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775252.223892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775253.247904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775254.271890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775255.295954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775256.319864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775256.383828:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775256.383840:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775256.383845:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775256.383856:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11228 00000100:00080000:0.0:1775775256.383870:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775256.383878:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775256.383926:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612630144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775256.383989:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775256.383993:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775256.383995:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775256.384000:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11228 00000100:00080000:0.0:1775775256.384004:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775256.384008:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775256.384019:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775256.384033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612630272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775256.384041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612630144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775256.384046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775256.384050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775256.384051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775256.384055:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11228 00000100:00080000:0.0:1775775256.384058:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775256.384062:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775256.384066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775256.384075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612630400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775256.384091:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775256.384094:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775256.384096:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775256.384100:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11228 00000100:00080000:0.0:1775775256.384104:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775256.384107:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775256.384112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775256.384112:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775256.384123:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612630528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775256.384130:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775256.384132:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775256.384133:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775256.384135:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11228 00000100:00080000:0.0:1775775256.384137:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775256.384139:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775256.384142:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775256.384149:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612630656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775256.384155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775256/real 1775775256] req@ffff8de1c5682680 x1862023612630144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775256.384170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612630144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775256.384179:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775256.384182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775256.384185:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612630144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775256.384204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775256.384228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775256.384240:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775256/real 1775775256] req@ffff8de1c5682d80 x1862023612630272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775256.384251:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612630272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775256.384258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775256.384266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775256.384269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775256.384275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775256.384292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775256.384302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775256/real 1775775256] req@ffff8de1c5680700 x1862023612630400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775256.384311:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612630400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775256.384316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775256.384317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775256.384319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775256.384323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775256.384335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775256.384341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775256/real 1775775256] req@ffff8de1c5682300 x1862023612630528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775256.384347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612630528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775256.384351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775256.384353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775256.384354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775256.384357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775256.384366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775256.384371:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775256/real 1775775256] req@ffff8de1c5683b80 x1862023612630656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775256.384378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612630656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775256.384382:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775256.384383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775256.384385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775257.343951:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775258.367903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775259.391859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775260.415932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775261.439875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775261.503882:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775261.503893:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775261.503898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775261.503909:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11233 00000100:00080000:2.0:1775775261.503921:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775261.503926:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775261.503957:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612630784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775261.503981:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775261.503984:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775261.503986:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775261.503990:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11233 00000100:00080000:2.0:1775775261.503993:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775261.503996:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775261.504004:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775261.504015:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612630912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775261.504025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612630784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775261.504033:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775261.504036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775261.504037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775261.504039:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11233 00000100:00080000:2.0:1775775261.504041:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775261.504043:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775261.504047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775261.504068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612631040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775261.504075:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775261.504078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775261.504080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775261.504083:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11233 00000100:00080000:2.0:1775775261.504087:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775261.504090:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775775261.504095:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:2.0:1775775261.504096:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775261.504107:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612631168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775261.504115:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775261.504118:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775261.504119:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775261.504122:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11233 00000100:00080000:2.0:1775775261.504126:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775261.504130:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775261.504134:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775261.504140:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775261/real 1775775261] req@ffff8de1d0f2e300 x1862023612630784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775261.504146:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612631296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775261.504177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612630784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775261.504190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775261.504196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775261.504202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612630784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775261.504225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775261.504247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775261.504259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775261/real 1775775261] req@ffff8de1d0f2e680 x1862023612630912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775261.504275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612630912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775261.504284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775261.504288:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775261.504291:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612630912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775261.504297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775261.504313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775261.504322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775261/real 1775775261] req@ffff8de1d0f2c700 x1862023612631040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775261.504342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612631040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775261.504350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775261.504353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775261.504356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775261.504362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775261.504377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775261.504386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775261/real 1775775261] req@ffff8de1d0f2d500 x1862023612631168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775261.504398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612631168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775261.504407:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775261.504410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775261.504413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775261.504419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775261.504434:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775261.504443:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775261/real 1775775261] req@ffff8de1d0f2df80 x1862023612631296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775261.504454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612631296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775261.504469:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775261.504472:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775261.504476:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775262.463960:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775263.487871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775264.511901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775265.535853:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775266.559912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775266.623814:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775266.623823:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775266.623828:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775266.623838:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11238 00000100:00080000:2.0:1775775266.623849:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775266.623857:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775266.623891:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612631424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775266.623921:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775266.623924:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775266.623926:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775266.623930:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11238 00000100:00080000:2.0:1775775266.623934:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775266.623937:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775266.623946:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775266.623958:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612631552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775266.623970:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775266.623974:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612631424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775266.623974:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775266.623979:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775266.623988:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11238 00000100:00080000:2.0:1775775266.623991:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775266.623995:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775266.624000:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775266.624012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612631680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775266.624022:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775266.624025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775266.624027:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775266.624030:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11238 00000100:00080000:2.0:1775775266.624035:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775266.624038:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775266.624042:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775266.624051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612631808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775266.624059:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775266.624062:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775266.624064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775266.624068:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11238 00000100:00080000:2.0:1775775266.624071:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775266.624075:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775266.624082:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631552:192.168.201.137@tcp:38:kworker.0 00000008:00100000:2.0:1775775266.624082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775266.624096:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612631936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775266.624127:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775266.624153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775266.624194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775267.583925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775268.607975:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775269.631832:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775269.695935:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775269.695973:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775269.695989:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775269.696022:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775269.696031:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775269.696038:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775269.696046:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775775269.696080:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775266/real 1775775269] req@ffff8de1d0f2c700 x1862023612631936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775269.696105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612631936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775269.696117:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775269.696124:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775269.696128:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631936:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775269.696135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775266/real 1775775269] req@ffff8de1d0f2f100 x1862023612631552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775269.696408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612631552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775269.696416:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775269.696419:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775269.696422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775269.696428:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775266/real 1775775269] req@ffff8de1d0f2df80 x1862023612631680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775269.696440:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612631680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775269.696446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775269.696450:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775269.696453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775269.696460:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775266/real 1775775269] req@ffff8de1d0f2d500 x1862023612631808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775269.696471:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612631808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775269.696478:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775269.696482:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775269.696484:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612631808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775269.696490:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775266/real 1775775269] req@ffff8de1d0f2ca80 x1862023612631424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775269.696503:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612631424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775269.696511:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775269.696515:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775269.696517:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612631424:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775775270.655833:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775271.679845:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775271.743812:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775271.743822:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775271.743826:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775271.743836:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11243 00000100:00080000:2.0:1775775271.743847:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775271.743854:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775271.743889:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612632064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775271.743911:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775271.743914:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775271.743915:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775271.743919:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11243 00000100:00080000:2.0:1775775271.743923:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775271.743927:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775271.743935:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775271.743948:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612632192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775271.743959:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775271.743963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775775271.743966:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612632064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775271.743966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775271.743972:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11243 00000100:00080000:2.0:1775775271.743978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775271.743982:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775271.743987:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775271.743999:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612632320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775271.744008:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775271.744011:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775271.744013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775271.744017:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11243 00000100:00080000:2.0:1775775271.744022:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775271.744026:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775775271.744032:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:2.0:1775775271.744032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775271.744045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612632448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775271.744053:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775271.744055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775271.744058:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775271.744061:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11243 00000100:00080000:2.0:1775775271.744065:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775271.744067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775271/real 1775775271] req@ffff8de1d0f2e680 x1862023612632064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775271.744071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775271.744080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775271.744093:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612632064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775271.744094:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612632576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775271.744107:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775271.744116:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775271.744125:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612632064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775271.744151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775271.744174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775271.744185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775271/real 1775775271] req@ffff8de1d0f2e300 x1862023612632192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775271.744202:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612632192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775271.744209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775271.744212:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775271.744215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775271.744220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775271.744238:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775271.744247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775271/real 1775775271] req@ffff8de1d0f2ca80 x1862023612632320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775271.744257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612632320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775271.744263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775271.744266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775271.744269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775271.744275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775271.744293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775271.744301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775271/real 1775775271] req@ffff8de1d0f2d500 x1862023612632448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775271.744312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612632448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775271.744319:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775271.744322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775271.744326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775271.744331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775271.744346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775271.744354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775271/real 1775775271] req@ffff8de1d0f2df80 x1862023612632576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775271.744365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612632576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775271.744372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775271.744374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775271.744377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775272.703837:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775273.727826:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775274.751915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775275.775860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775276.799908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775276.863849:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775276.863858:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775276.863863:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775276.863873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11248 00000100:00080000:3.0:1775775276.863884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775276.863891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775276.863924:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612632704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775276.863954:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775276.863958:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775276.863960:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775276.863964:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11248 00000100:00080000:3.0:1775775276.863967:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775276.863970:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775276.863977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775276.863989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612632832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775276.863996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775276.863999:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775276.864001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775276.864004:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11248 00000100:00080000:3.0:1775775276.864006:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775276.864009:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775276.864012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775276.864017:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612632704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775276.864022:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612632960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775276.864031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775276.864033:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775276.864034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775276.864037:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11248 00000100:00080000:3.0:1775775276.864039:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775276.864042:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775276.864044:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775276.864051:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612633088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775276.864057:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775276.864060:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775276.864062:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775276.864066:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11248 00000100:00080000:3.0:1775775276.864071:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775276.864075:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775276.864080:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775276.864085:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775276.864093:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612633216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775276.864129:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775276/real 1775775276] req@ffff8de1c7af6a00 x1862023612632704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775276.864143:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612632704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775276.864152:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775276.864155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775276.864158:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612632704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775276.864164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775276.864184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775276.864196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775276/real 1775775276] req@ffff8de1c7af6680 x1862023612632832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775276.864210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612632832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775276.864218:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775276.864221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775276.864223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775276.864243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775276.864259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775276.864269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775276/real 1775775276] req@ffff8de1c7af4700 x1862023612632960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775276.864281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612632960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775276.864289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775276.864293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775276.864296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612632960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775276.864303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775276.864324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775276.864343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775276/real 1775775276] req@ffff8de1c7af6300 x1862023612633088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775276.864357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612633088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775276.864366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775276.864369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775276.864373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775276.864378:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775276.864393:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775276.864401:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775276/real 1775775276] req@ffff8de1c7af4000 x1862023612633216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775276.864408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612633216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775276.864414:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775276.864416:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775276.864418:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775277.823869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775278.847866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775279.871903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775280.895874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775281.919957:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775281.983791:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775281.983799:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775281.983803:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775281.983811:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11253 00000100:00080000:3.0:1775775281.983822:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775281.983828:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775281.983863:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612633344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775281.983894:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775281.983898:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775281.983900:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775281.983905:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11253 00000100:00080000:3.0:1775775281.983910:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775281.983914:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775281.983924:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775281.983937:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612633472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775281.983945:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612633344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775281.983948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775281.983955:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775281.983956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775281.983960:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11253 00000100:00080000:3.0:1775775281.983962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775281.983965:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775281.983968:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775281.983976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612633600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775281.983984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775281.983986:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775281.983988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775281.983990:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11253 00000100:00080000:3.0:1775775281.983992:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775281.983994:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775281.983997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775281.984003:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612633728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775281.984009:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775281.984014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:0.0:1775775281.984016:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775281.984016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775281.984023:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11253 00000100:00080000:3.0:1775775281.984025:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775281.984028:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775281.984031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775281.984039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612633856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775281.984060:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775281/real 1775775281] req@ffff8de1c7af7480 x1862023612633344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775281.984078:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612633344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775281.984088:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775281.984092:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775281.984097:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612633344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775281.984118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775281.984139:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775281.984150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775281/real 1775775281] req@ffff8de1c7af7b80 x1862023612633472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775281.984162:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612633472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775281.984170:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775281.984173:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775281.984177:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775281.984183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775281.984199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775281.984208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775281/real 1775775281] req@ffff8de1c7af5c00 x1862023612633600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775281.984220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612633600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775281.984228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775281.984231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775281.984234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775281.984239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775281.984255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775281.984264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775281/real 1775775281] req@ffff8de1c7af6d80 x1862023612633728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775281.984276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612633728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775281.984284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775281.984287:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775281.984290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775281.984296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775281.984313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775281.984322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775281/real 1775775281] req@ffff8de1c7af4e00 x1862023612633856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775281.984333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612633856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775281.984348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775281.984351:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775281.984355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612633856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775282.943885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775283.967974:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775284.991882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775286.015885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775287.039844:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775287.103808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775287.103817:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775287.103821:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775287.103829:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11258 00000100:00080000:3.0:1775775287.103839:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775287.103845:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775287.103878:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612633984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775287.103901:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775287.103904:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775287.103905:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775287.103908:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11258 00000100:00080000:3.0:1775775287.103910:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775287.103913:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775287.103921:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775287.103930:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612634112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775287.103937:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775287.103940:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775287.103941:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775287.103943:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11258 00000100:00080000:3.0:1775775287.103945:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775287.103947:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775287.103950:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775287.103956:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612634240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775287.103964:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612633984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775287.103965:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775287.103972:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775287.103975:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775287.103978:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11258 00000100:00080000:3.0:1775775287.103980:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775287.103982:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775287.103985:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775287.103992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612634368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775287.103998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775287.104000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775287.104002:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775287.104004:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11258 00000100:00080000:3.0:1775775287.104007:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775287.104009:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775287.104012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775287.104017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612634496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775287.104038:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775287.104075:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775287/real 1775775287] req@ffff8de1c7af5500 x1862023612633984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775287.104095:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612633984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775287.104106:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775287.104111:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775287.104115:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612633984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775287.104123:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775287.104149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775287.104163:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775287/real 1775775287] req@ffff8de1c7af5880 x1862023612634112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775287.104177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612634112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775287.104186:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775287.104190:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775287.104193:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775287.104219:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775287.104243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775287.104255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775287/real 1775775287] req@ffff8de1c7af4a80 x1862023612634240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775287.104268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612634240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775287.104277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775287.104281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775287.104284:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775287.104291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775287.104327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775287.104339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775287/real 1775775287] req@ffff8de1c7af5f80 x1862023612634368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775287.104352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612634368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775287.104360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775287.104364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775287.104368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775287.104374:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775287.104394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775287.104404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775287/real 1775775287] req@ffff8de1c7af4380 x1862023612634496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775287.104431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612634496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775287.104440:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775287.104443:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775287.104446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775288.063858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775289.087853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775290.111888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775291.135900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775292.159843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775292.223889:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775292.223897:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775292.223902:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775292.223911:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11263 00000100:00080000:2.0:1775775292.223922:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775292.223927:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775292.223960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612634624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775292.223981:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775292.223984:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775292.223985:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775292.223987:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11263 00000100:00080000:2.0:1775775292.223990:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775292.223992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775292.223999:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775292.224007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612634752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775292.224014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775292.224017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775292.224018:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775292.224020:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11263 00000100:00080000:2.0:1775775292.224022:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775292.224028:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775292.224030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612634624:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775292.224032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775292.224044:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612634880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775292.224051:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775292.224053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775292.224055:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775292.224057:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11263 00000100:00080000:2.0:1775775292.224060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775292.224065:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775292.224070:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775292.224081:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612635008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775292.224092:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775292.224096:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775292.224100:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775292.224102:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775292.224108:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11263 00000100:00080000:2.0:1775775292.224113:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775292.224118:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775292.224124:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775292.224125:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775292/real 1775775292] req@ffff8de1d0f2f100 x1862023612634624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775292.224140:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612635136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775292.224144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612634624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775292.224168:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775292.224173:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775292.224186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612634624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775292.224192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775292.224208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775292.224217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775292/real 1775775292] req@ffff8de1d0f2c700 x1862023612634752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775292.224225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612634752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775292.224237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775292.224239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775292.224241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775292.224261:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775292.224273:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775292.224279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775292/real 1775775292] req@ffff8de1d0f2df80 x1862023612634880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775292.224286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612634880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775292.224292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775292.224294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775292.224296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612634880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775292.224299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775292.224308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775292.224314:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775292/real 1775775292] req@ffff8de1d0f2d500 x1862023612635008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775292.224350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612635008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775292.224355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775292.224357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775292.224359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775292.224363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775292.224377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775292.224383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775292/real 1775775292] req@ffff8de1d0f2ca80 x1862023612635136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775292.224390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612635136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775292.224395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775292.224397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775292.224398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775293.183906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775294.207956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775295.231892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775296.255917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775297.279879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775297.343789:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775297.343799:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775297.343805:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775297.343820:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11269 00000100:00080000:2.0:1775775297.343835:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775297.343844:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775297.343890:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612635264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775297.343924:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775297.343929:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775297.343932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775297.343937:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11269 00000100:00080000:2.0:1775775297.343942:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775297.343947:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775297.343961:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775297.343979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612635392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775297.343992:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775297.343997:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775297.344000:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775297.344002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612635264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775297.344007:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11269 00000100:00080000:2.0:1775775297.344014:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775297.344019:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775297.344024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775297.344037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612635520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775297.344049:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775297.344052:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775297.344054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775297.344057:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11269 00000100:00080000:2.0:1775775297.344061:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775297.344064:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775297.344068:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775297.344077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612635648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775297.344084:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775297.344087:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775297.344088:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775297.344092:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11269 00000800:00000100:0.0:1775775297.344096:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775297.344097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775297.344102:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775297.344105:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775297.344114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612635776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775297.344144:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775297/real 1775775297] req@ffff8de1d0f2e300 x1862023612635264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775297.344166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612635264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775297.344180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775297.344185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775297.344190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612635264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775297.344221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775297.344271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775297.344284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775297/real 1775775297] req@ffff8de1d0f2e680 x1862023612635392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775297.344297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612635392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775297.344312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775297.344317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775297.344320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775297.344329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775297.344343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775297.344352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775297/real 1775775297] req@ffff8de1d0f2ca80 x1862023612635520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775297.344365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612635520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775297.344379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775297.344383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775297.344386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775297.344394:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775297.344417:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775297.344429:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775297/real 1775775297] req@ffff8de1d0f2d500 x1862023612635648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775297.344442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612635648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775297.344451:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775297.344455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775297.344460:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775297.344467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775297.344491:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775297.344505:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775297/real 1775775297] req@ffff8de1d0f2df80 x1862023612635776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775297.344519:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612635776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775297.344528:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775297.344533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775297.344538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612635776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775298.303902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775299.327909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775300.351923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775301.375928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775302.399873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775302.463852:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775302.463863:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775302.463867:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775302.463878:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11274 00000100:00080000:2.0:1775775302.463893:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775302.463901:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775302.463955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612635904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775302.463985:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775302.463992:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775302.463994:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775302.463997:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11274 00000100:00080000:2.0:1775775302.464000:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775302.464004:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775302.464016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775302.464031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612636032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775302.464046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775302.464049:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612635904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775302.464052:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775302.464054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775302.464066:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11274 00000100:00080000:2.0:1775775302.464071:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775302.464074:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775302.464079:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775302.464092:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612636160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775302.464101:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775302.464104:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775302.464107:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775302.464110:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11274 00000100:00080000:2.0:1775775302.464113:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775302.464115:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775302.464119:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775302.464126:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612636288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775302.464135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775302.464156:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775302.464159:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775302.464161:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775302.464166:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11274 00000100:00080000:2.0:1775775302.464170:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775302.464174:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775302.464179:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775302.464193:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612636416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775302.464194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775302/real 1775775302] req@ffff8de1d0f2c700 x1862023612635904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775302.464269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612635904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775302.464284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775302.464290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775302.464295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612635904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775302.464317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775302.464337:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775302.464347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775302/real 1775775302] req@ffff8de1d0f2f100 x1862023612636032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775302.464355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612636032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775302.464361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775302.464363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775302.464366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775302.464371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775302.464382:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775302.464387:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775302/real 1775775302] req@ffff8de1d0f2df80 x1862023612636160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775302.464395:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612636160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775302.464400:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775302.464401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775302.464403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775302.464407:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775302.464417:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775302.464422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775302/real 1775775302] req@ffff8de1d0f2d500 x1862023612636288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775302.464428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612636288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775302.464433:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775302.464435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775302.464437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775302.464441:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775302.464450:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775302.464456:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775302/real 1775775302] req@ffff8de1d0f2ca80 x1862023612636416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775302.464463:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612636416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775302.464468:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775302.464469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775302.464471:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775303.423945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775304.447925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775305.471925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775306.495913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775307.519888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775307.583843:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775307.583851:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775307.583854:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775307.583863:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11279 00000100:00080000:3.0:1775775307.583873:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775307.583883:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775307.583915:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612636544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775307.583943:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775307.583947:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775307.583949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775307.583953:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11279 00000100:00080000:3.0:1775775307.583958:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775307.583962:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775307.583974:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775307.583991:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612636544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775307.583992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612636672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775307.584006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775307.584008:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775307.584009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775307.584013:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11279 00000100:00080000:3.0:1775775307.584016:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775307.584019:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775307.584023:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775307.584032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612636800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775307.584038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775307.584041:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775307.584042:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775307.584044:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11279 00000100:00080000:3.0:1775775307.584047:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775307.584064:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775307.584066:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775307.584072:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775307.584086:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612636928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775307.584096:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775307.584098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775307/real 1775775307] req@ffff8de1c7af7800 x1862023612636544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775307.584112:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775775307.584113:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612636544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775307.584117:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775307.584128:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11279 00000100:00080000:0.0:1775775307.584129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775307.584134:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775307.584135:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775775307.584142:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775307.584143:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612636544:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775307.584151:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775307.584162:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612637056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775307.584169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775307.584196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775307.584205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775307/real 1775775307] req@ffff8de1c7af7100 x1862023612636672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775307.584220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612636672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775307.584228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775307.584232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775307.584235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775307.584241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775307.584262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775307.584274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775307/real 1775775307] req@ffff8de1c7af5180 x1862023612636800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775307.584287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612636800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775307.584295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775307.584298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775307.584301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775307.584308:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775307.584328:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775307.584339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775307/real 1775775307] req@ffff8de1c7af4380 x1862023612636928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775307.584349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612636928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775307.584358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775307.584361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775307.584364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612636928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775307.584383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775307.584405:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775307.584415:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775307/real 1775775307] req@ffff8de1c7af5f80 x1862023612637056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775307.584428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612637056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775307.584436:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775307.584439:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775307.584442:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775308.543880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775309.567886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775310.591866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775311.615913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775312.639933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775312.703826:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775312.703835:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775312.703840:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775312.703852:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11284 00000100:00080000:2.0:1775775312.703864:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775312.703879:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775312.703921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612637184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775312.703946:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775312.703949:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775312.703950:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775312.703953:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11284 00000100:00080000:2.0:1775775312.703956:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775312.703958:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775312.703983:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775312.703994:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612637312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775312.704003:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775312.704007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775775312.704009:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612637184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775312.704009:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775312.704014:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11284 00000100:00080000:2.0:1775775312.704020:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775312.704023:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775312.704026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775312.704036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612637440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775312.704043:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775312.704045:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775312.704046:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775312.704049:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11284 00000100:00080000:2.0:1775775312.704053:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775312.704056:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775312.704059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775312.704066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612637568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775312.704073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775312.704076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775312.704077:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775312.704079:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11284 00000100:00080000:2.0:1775775312.704082:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775312.704083:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775312.704086:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775312.704091:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775312.704095:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612637696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775312.704130:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775312/real 1775775312] req@ffff8de1d0f2e680 x1862023612637184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775312.704146:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612637184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775312.704156:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775312.704167:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775312.704171:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612637184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775312.704195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775312.704213:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775312.704221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775312/real 1775775312] req@ffff8de1d0f2e300 x1862023612637312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775312.704230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612637312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775312.704239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775312.704242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775312.704246:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775312.704253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775312.704272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775312.704279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775312/real 1775775312] req@ffff8de1d0f2ca80 x1862023612637440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775312.704287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612637440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775312.704292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775312.704295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775312.704297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775312.704301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775312.704313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775312.704318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775312/real 1775775312] req@ffff8de1d0f2d500 x1862023612637568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775312.704326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612637568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775312.704331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775312.704332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775312.704334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775312.704337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775312.704347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775312.704351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775312/real 1775775312] req@ffff8de1d0f2df80 x1862023612637696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775312.704359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612637696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775312.704363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775312.704365:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775312.704367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775313.663898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775314.687900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775315.711863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775316.735943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775317.759960:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775317.823901:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775317.823910:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775317.823915:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775317.823925:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11289 00000100:00080000:1.0:1775775317.823937:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775317.823945:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775317.823986:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612637824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775317.824012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775317.824015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775317.824017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775317.824020:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11289 00000100:00080000:1.0:1775775317.824022:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775317.824024:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775317.824034:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775317.824042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612637952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775317.824050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775317.824053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775317.824054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775317.824057:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11289 00000100:00080000:1.0:1775775317.824059:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775317.824061:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775317.824063:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775317.824069:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612638080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775317.824076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775317.824079:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775317.824080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775317.824081:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612637824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775317.824085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11289 00000100:00080000:1.0:1775775317.824089:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775317.824093:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775317.824096:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775317.824103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612638208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775317.824110:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775317.824112:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775317.824113:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775317.824115:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11289 00000100:00080000:1.0:1775775317.824117:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775317.824119:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775317.824121:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775317.824127:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612638336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775317.824179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775317.824223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775317/real 1775775317] req@ffff8de1c2e17800 x1862023612637824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775317.824247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612637824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775317.824259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775317.824265:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775317.824270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612637824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775317.824278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775317.824303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775317.824316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775317/real 1775775317] req@ffff8de1c2e16a00 x1862023612637952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775317.824330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612637952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775317.824339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775317.824343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775317.824346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612637952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775317.824375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775317.824397:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775317.824408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775317/real 1775775317] req@ffff8de1c2e16680 x1862023612638080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775317.824422:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612638080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775317.824431:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775317.824434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775317.824437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775317.824443:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775317.824462:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775317.824471:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775317/real 1775775317] req@ffff8de1c2e14380 x1862023612638208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775317.824485:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612638208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775317.824493:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775317.824497:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775317.824500:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775317.824505:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775317.824520:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775317.824528:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775317/real 1775775317] req@ffff8de1c2e17100 x1862023612638336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775317.824539:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612638336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775317.824556:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775317.824559:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775317.824563:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775318.783993:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775319.807936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775320.831890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775321.855905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775322.879900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775322.943842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775322.943850:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775322.943855:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775322.943862:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11294 00000100:00080000:2.0:1775775322.943871:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775322.943877:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775322.943905:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612638464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775322.943928:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775322.943931:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775322.943932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775322.943934:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11294 00000100:00080000:2.0:1775775322.943936:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775322.943938:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775322.943945:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775322.943952:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612638592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775322.943959:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775322.943961:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775322.943962:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775322.943964:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11294 00000100:00080000:2.0:1775775322.943966:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775322.943968:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775322.943970:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775322.943977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612638720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775322.943983:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612638464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775322.943984:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775322.943986:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775322.943987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775322.943990:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11294 00000100:00080000:2.0:1775775322.943995:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775322.943998:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775322.944001:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775322.944007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612638848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775322.944012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775322.944014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775322.944015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775322.944017:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11294 00000100:00080000:2.0:1775775322.944018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775322.944020:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775322.944023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775322.944031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612638976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775322.944052:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775322.944083:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775322/real 1775775322] req@ffff8de1d0f2f100 x1862023612638464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775322.944100:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612638464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775322.944110:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775322.944114:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775322.944118:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612638464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775322.944125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775322.944144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775322.944155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775322/real 1775775322] req@ffff8de1d0f2c700 x1862023612638592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775322.944167:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612638592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775322.944175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775322.944178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775322.944180:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775322.944204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775322.944222:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775322.944236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775322/real 1775775322] req@ffff8de1d0f2df80 x1862023612638720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775322.944248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612638720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775322.944255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775322.944258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775322.944261:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775322.944267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775322.944284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775322.944294:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775322/real 1775775322] req@ffff8de1d0f2d500 x1862023612638848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775322.944305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612638848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775322.944312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775322.944315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775322.944319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775322.944324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775322.944342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775322.944352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775322/real 1775775322] req@ffff8de1d0f2ca80 x1862023612638976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775322.944363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612638976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775322.944371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775322.944374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775322.944377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612638976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775323.903863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775324.927876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775325.951889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775326.975919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775327.999876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775328.063813:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775328.063820:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775328.063824:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775328.063832:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11299 00000100:00080000:3.0:1775775328.063841:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775328.063847:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775328.063876:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612639104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775328.063902:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775328.063905:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775328.063907:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775328.063909:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11299 00000100:00080000:3.0:1775775328.063912:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775328.063916:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775328.063924:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775328.063938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612639232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775328.063948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775328.063952:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612639104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775328.063952:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775328.063956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775328.063963:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11299 00000100:00080000:3.0:1775775328.063967:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775328.063970:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775328.063975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775328.063986:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612639360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775328.063995:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775328.063998:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775328.064000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775328.064003:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11299 00000100:00080000:3.0:1775775328.064007:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775328.064011:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775328.064012:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775328.064019:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775328.064029:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612639488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775328.064035:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775328.064037:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775775328.064039:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775328/real 1775775328] req@ffff8de1c7af4a80 x1862023612639104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775328.064040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775328.064046:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11299 00000100:00080000:3.0:1775775328.064051:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775328.064055:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775328.064058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775328.064062:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612639104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775328.064066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612639616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775328.064078:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775328.064083:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775328.064087:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612639104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775328.064105:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775328.064119:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775328.064126:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775328/real 1775775328] req@ffff8de1c7af5880 x1862023612639232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775328.064133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612639232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775328.064137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775328.064139:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775328.064141:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775328.064144:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775328.064153:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775328.064157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775328/real 1775775328] req@ffff8de1c7af5500 x1862023612639360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775328.064164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612639360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775328.064171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775328.064174:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775328.064177:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775328.064183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775328.064200:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775328.064210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775328/real 1775775328] req@ffff8de1c7af4e00 x1862023612639488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775328.064221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612639488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775328.064229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775328.064231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775328.064233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775328.064237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775328.064250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775328.064255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775328/real 1775775328] req@ffff8de1c7af6d80 x1862023612639616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775328.064263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612639616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775328.064270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775328.064273:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775328.064276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775329.023847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775330.047876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775331.071888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775332.095883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775333.119884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775333.183835:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775333.183844:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775333.183849:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775333.183857:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11304 00000100:00080000:1.0:1775775333.183868:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775333.183875:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775333.183907:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612639744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775333.183932:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775333.183936:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775333.183937:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775333.183941:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11304 00000100:00080000:1.0:1775775333.183944:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775333.183948:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775333.183956:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775333.183971:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612639872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775333.183972:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612639744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775333.183984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775333.183987:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775333.183989:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775333.183992:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11304 00000100:00080000:1.0:1775775333.183995:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775333.183998:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775333.184002:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775333.184012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612640000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775333.184021:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775333.184024:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775333.184026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775333.184029:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11304 00000100:00080000:1.0:1775775333.184033:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775333.184036:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775333.184042:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775333.184050:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612640128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775333.184056:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775333.184058:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775333.184059:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775333.184063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639872:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775775333.184063:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11304 00000100:00080000:1.0:1775775333.184066:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775333.184071:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775333.184074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775333.184082:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612640256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775333.184096:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775333.184113:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775333.184127:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775334.143854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775335.167841:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775336.191865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775775336.256059:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775775336.256109:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775775336.256129:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775336.256182:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775336.256191:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775336.256200:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775336.256208:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775775336.256445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775333/real 1775775336] req@ffff8de1c2e16a00 x1862023612640256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775336.256475:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612640256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775336.256488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775336.256494:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775336.256499:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640256:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775336.256509:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775333/real 1775775336] req@ffff8de1c2e17100 x1862023612639872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775336.256522:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612639872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775336.256528:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775336.256532:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775336.256535:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612639872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775336.256542:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775333/real 1775775336] req@ffff8de1c2e14380 x1862023612640000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775336.256571:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612640000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775336.256578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775336.256581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775336.256584:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775336.256590:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775333/real 1775775336] req@ffff8de1c2e16680 x1862023612640128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775336.256601:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612640128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775336.256609:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775336.256612:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775336.256615:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775336.256622:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775333/real 1775775336] req@ffff8de1c2e17b80 x1862023612639744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775336.256635:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612639744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775336.256643:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775336.256652:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775336.256655:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612639744:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775775337.215850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775338.239840:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775338.303839:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775338.303845:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775338.303849:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775338.303856:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11310 00000100:00080000:3.0:1775775338.303865:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775338.303870:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775338.303902:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612640384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775338.303931:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775338.303935:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775338.303936:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775338.303941:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11310 00000100:00080000:3.0:1775775338.303945:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775338.303949:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775338.303958:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775338.303970:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612640512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775338.303977:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612640384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775338.303979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775338.303982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775338.303983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775338.303986:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11310 00000100:00080000:3.0:1775775338.303989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775338.303992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775338.303996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775338.304004:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612640640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775338.304011:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775338.304014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775338.304015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775338.304018:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11310 00000100:00080000:3.0:1775775338.304021:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775338.304024:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775338.304027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775338.304034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612640768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775338.304040:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775338.304047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775338.304049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775338.304050:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775338.304053:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11310 00000100:00080000:3.0:1775775338.304056:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775338.304058:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775338.304062:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775338.304068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612640896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775338.304069:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775338/real 1775775338] req@ffff8de1c7af5c00 x1862023612640384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775338.304084:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612640384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775338.304093:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775338.304110:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775338.304114:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612640384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775338.304137:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775338.304168:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775338.304179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775338/real 1775775338] req@ffff8de1c7af7b80 x1862023612640512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775338.304189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612640512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775338.304196:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775338.304199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775338.304202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775338.304207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775338.304224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775338.304233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775338/real 1775775338] req@ffff8de1c7af7480 x1862023612640640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775338.304250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612640640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775338.304257:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775338.304260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775338.304262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775338.304267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775338.304283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775338.304292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775338/real 1775775338] req@ffff8de1c7af4000 x1862023612640768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775338.304301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612640768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775338.304307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775338.304309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775338.304312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775338.304331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775338.304348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775338.304356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775338/real 1775775338] req@ffff8de1c7af6300 x1862023612640896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775338.304365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612640896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775338.304376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775338.304378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775338.304381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612640896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775339.263863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775340.287875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775341.311909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775342.335886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775343.359914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775343.423883:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775343.423892:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775343.423896:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775343.423905:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11315 00000100:00080000:0.0:1775775343.423915:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775343.423921:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775343.423955:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612641024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775343.423984:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775343.423988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775343.423989:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775343.423992:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11315 00000100:00080000:0.0:1775775343.423994:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775343.423997:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775343.424005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775343.424012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612641152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775343.424019:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775343.424021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775343.424022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775343.424025:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11315 00000100:00080000:0.0:1775775343.424026:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775343.424028:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775343.424031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775343.424036:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612641280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775343.424041:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775343.424044:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775343.424046:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775343.424048:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11315 00000100:00080000:0.0:1775775343.424050:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775343.424052:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775343.424055:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775343.424061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612641408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775343.424067:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775343.424069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775343.424071:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775775343.424071:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612641024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775343.424075:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11315 00000100:00080000:0.0:1775775343.424080:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775343.424083:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775343.424086:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775343.424093:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612641536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775343.424140:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775343.424192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775343/real 1775775343] req@ffff8de1c5681c00 x1862023612641024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775343.424221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612641024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775343.424232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775343.424237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775343.424241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612641024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775343.424247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775343.424265:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775343.424274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775343/real 1775775343] req@ffff8de1c5681f80 x1862023612641152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775343.424282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612641152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775343.424287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775343.424289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775343.424291:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775343.424294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775343.424306:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775343.424312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775343/real 1775775343] req@ffff8de1c5682a00 x1862023612641280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775343.424319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612641280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775343.424327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775343.424330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775343.424331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775343.424351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775343.424361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775343.424366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775343/real 1775775343] req@ffff8de1c5680380 x1862023612641408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775343.424373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612641408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775343.424378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775343.424380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775343.424381:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775343.424385:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775343.424394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775343.424399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775343/real 1775775343] req@ffff8de1c5680000 x1862023612641536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775343.424406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612641536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775343.424411:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775343.424412:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775343.424415:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775344.383903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775345.407865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775346.431895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775347.455854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775348.479926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775348.543863:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775348.543871:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775348.543876:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775348.543883:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11320 00000100:00080000:1.0:1775775348.543895:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775348.543901:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775348.543940:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612641664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775348.543972:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775348.543975:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775348.543976:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775348.543980:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11320 00000100:00080000:1.0:1775775348.543984:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775348.543987:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775348.543994:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775348.544004:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612641792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775348.544011:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775348.544014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775348.544015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775348.544017:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11320 00000100:00080000:1.0:1775775348.544019:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775348.544021:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775348.544024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775348.544030:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612641920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775348.544037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775348.544039:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775348.544041:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775348.544043:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11320 00000100:00080000:1.0:1775775348.544045:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775348.544047:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775348.544051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775348.544053:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612641664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775348.544060:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612642048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775348.544071:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775348.544074:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775348.544075:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775348.544077:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11320 00000100:00080000:1.0:1775775348.544079:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775348.544081:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775348.544084:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775348.544091:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612642176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775348.544115:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775348.544146:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775348/real 1775775348] req@ffff8de1c2e17800 x1862023612641664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775348.544160:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612641664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775348.544168:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775348.544171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775348.544174:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612641664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775348.544178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775348.544192:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775348.544199:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775348/real 1775775348] req@ffff8de1c2e15500 x1862023612641792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775348.544206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612641792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775348.544211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775348.544213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775348.544215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775348.544218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775348.544228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775348.544234:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775348/real 1775775348] req@ffff8de1c2e14700 x1862023612641920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775348.544241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612641920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775348.544246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775348.544247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775348.544249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612641920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775348.544267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775348.544277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775348.544283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775348/real 1775775348] req@ffff8de1c2e17480 x1862023612642048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775348.544290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612642048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775348.544295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775348.544296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775348.544298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775348.544301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775348.544311:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775348.544316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775348/real 1775775348] req@ffff8de1c2e14a80 x1862023612642176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775348.544322:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612642176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775348.544328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775348.544330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775348.544332:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775349.503889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775350.527879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775351.551854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775352.575864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775353.599849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775353.663802:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775353.663810:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775353.663814:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775353.663823:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11325 00000100:00080000:1.0:1775775353.663834:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775353.663842:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775353.663880:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612642304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775353.663908:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775353.663911:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775353.663914:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775353.663918:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11325 00000100:00080000:1.0:1775775353.663922:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775353.663927:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775353.663937:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775353.663945:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612642304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775353.663951:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612642432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775353.663961:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775353.663964:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775353.663966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775353.663969:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11325 00000100:00080000:1.0:1775775353.663972:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775353.663976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775353.663980:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775353.663988:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612642560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775353.663995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775775353.664008:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775353.664009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775353.664011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775353.664014:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11325 00000100:00080000:1.0:1775775353.664018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775353.664021:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775353.664026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775353.664037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612642688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775353.664043:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775353/real 1775775353] req@ffff8de1c2e14e00 x1862023612642304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775353.664046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775353.664049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775353.664052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775353.664055:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11325 00000100:00080000:1.0:1775775353.664058:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775353.664060:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612642304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775353.664061:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775353.664066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775353.664071:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1775775353.664074:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612642816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775353.664085:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775353.664088:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612642304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775353.664111:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775353.664135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775353.664146:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775353/real 1775775353] req@ffff8de1c2e14a80 x1862023612642432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775353.664154:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612642432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775353.664161:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775353.664165:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775353.664168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775353.664175:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775353.664195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775353.664206:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775353/real 1775775353] req@ffff8de1c2e17480 x1862023612642560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775353.664219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612642560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775353.664228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775353.664232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775353.664235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775353.664269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775353.664287:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775353.664294:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775353/real 1775775353] req@ffff8de1c2e14700 x1862023612642688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775353.664302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612642688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775353.664307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775353.664310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775353.664311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775353.664315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775353.664324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775353.664329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775353/real 1775775353] req@ffff8de1c2e15500 x1862023612642816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775353.664337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612642816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775353.664341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775353.664343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775353.664345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612642816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775354.623933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775355.647860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775356.671908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775357.695839:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775358.719900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775358.783845:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775358.783853:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775358.783857:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775358.783866:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11330 00000100:00080000:3.0:1775775358.783876:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775358.783881:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775358.783915:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612642944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775358.783938:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775358.783940:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775358.783942:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775358.783945:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11330 00000100:00080000:3.0:1775775358.783947:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775358.783949:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775358.783958:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775358.783968:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612643072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775358.783975:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775358.783978:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775358.783980:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775358.783982:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11330 00000100:00080000:3.0:1775775358.783984:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775358.783986:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775358.783989:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775358.783997:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612642944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775358.783998:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612643200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775358.784012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775358.784014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775358.784015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775358.784017:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11330 00000100:00080000:3.0:1775775358.784018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775358.784020:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775358.784024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775358.784031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612643328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775358.784037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775358.784040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775358.784042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775358.784044:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11330 00000100:00080000:3.0:1775775358.784054:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775358.784059:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775358.784065:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775358.784070:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775358.784078:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612643456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775358.784109:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775358/real 1775775358] req@ffff8de1c7af4700 x1862023612642944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775358.784137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612642944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775358.784149:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775358.784154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775358.784172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612642944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775358.784179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775358.784198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775358.784208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775358/real 1775775358] req@ffff8de1c7af6680 x1862023612643072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775358.784216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612643072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775358.784222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775358.784225:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775358.784227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775358.784245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775358.784256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775358.784262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775358/real 1775775358] req@ffff8de1c7af6a00 x1862023612643200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775358.784269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612643200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775358.784274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775358.784276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775358.784278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775358.784281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775358.784291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775358.784296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775358/real 1775775358] req@ffff8de1c7af6300 x1862023612643328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775358.784303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612643328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775358.784308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775358.784310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775358.784312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775358.784316:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775358.784325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775358.784330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775358/real 1775775358] req@ffff8de1c7af4000 x1862023612643456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775358.784336:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612643456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775358.784341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775358.784344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775358.784346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775359.743901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775360.767858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775361.791924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775362.815868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775363.839906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775363.903836:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775363.903844:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775363.903849:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775363.903857:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11335 00000100:00080000:0.0:1775775363.903867:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775363.903873:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775363.903904:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612643584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775363.903930:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775363.903933:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775363.903934:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775363.903937:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11335 00000100:00080000:0.0:1775775363.903939:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775363.903942:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775363.903951:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775363.903959:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612643712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775363.903967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775363.903970:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775775363.903970:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612643584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775363.903973:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775363.903981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11335 00000100:00080000:0.0:1775775363.903983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775363.903986:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775363.903989:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775363.903999:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612643840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775363.904005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775363.904007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775363.904009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775363.904012:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11335 00000100:00080000:0.0:1775775363.904015:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775363.904018:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775363.904022:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775363.904030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612643968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775363.904037:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775363.904043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775363.904045:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775363.904047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775363.904052:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11335 00000100:00080000:0.0:1775775363.904056:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775363.904058:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775363.904062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775363.904093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775363/real 1775775363] req@ffff8de1c5683800 x1862023612643584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775363.904095:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612644096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775363.904134:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612643584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775363.904143:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775363.904146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775363.904149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612643584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775363.904169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775363.904187:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775363.904195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775363/real 1775775363] req@ffff8de1c5681500 x1862023612643712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775363.904204:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612643712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775363.904209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775363.904211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775363.904214:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775363.904218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775363.904228:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775363.904233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775363/real 1775775363] req@ffff8de1c5681880 x1862023612643840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775363.904240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612643840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775363.904245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775363.904246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775363.904248:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775363.904251:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775363.904260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775363.904266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775363/real 1775775363] req@ffff8de1c5680e00 x1862023612643968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775363.904273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612643968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775363.904278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775363.904280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775363.904281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612643968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775363.904285:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775363.904294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775363.904299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775363/real 1775775363] req@ffff8de1c5683480 x1862023612644096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775363.904306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612644096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775363.904311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775363.904312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775363.904314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775364.863886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775365.887903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775366.911890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775367.935929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775368.959929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775369.023877:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775369.023887:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775369.023898:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775369.023909:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11340 00000100:00080000:0.0:1775775369.023921:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775369.023929:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775369.023974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612644224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775369.024013:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775369.024016:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775369.024018:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775369.024021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11340 00000100:00080000:0.0:1775775369.024025:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775369.024029:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775369.024039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775369.024053:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612644352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775369.024055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612644224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775369.024069:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775369.024072:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775369.024073:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775369.024078:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11340 00000100:00080000:0.0:1775775369.024080:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775369.024083:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775369.024086:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775369.024103:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612644480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775369.024114:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775369.024117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775369.024119:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775369.024122:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11340 00000100:00080000:0.0:1775775369.024126:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775369.024129:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775369.024134:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775369.024139:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775369.024146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612644608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775369.024154:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775369.024157:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775369.024159:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775369.024164:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11340 00000100:00080000:0.0:1775775369.024175:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775369.024176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775369/real 1775775369] req@ffff8de1c5683480 x1862023612644224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775369.024181:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775369.024189:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775369.024209:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612644736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775369.024216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612644224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775369.024292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775369.024299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775369.024304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612644224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775369.024425:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775369.024499:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775369.024514:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775369/real 1775775369] req@ffff8de1c5680e00 x1862023612644352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775369.024526:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612644352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775369.024537:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775369.024539:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775369.024542:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775369.024546:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775369.024559:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775369.024565:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775369/real 1775775369] req@ffff8de1c5681880 x1862023612644480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775369.024581:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612644480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775369.024587:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775369.024589:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775369.024591:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775369.024595:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775369.024607:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775369.024613:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775369/real 1775775369] req@ffff8de1c5681500 x1862023612644608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775369.024621:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612644608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775369.024625:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775369.024627:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775369.024630:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775369.024634:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775369.024644:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775369.024649:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775369/real 1775775369] req@ffff8de1c5683800 x1862023612644736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775369.024655:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612644736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775369.024661:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775369.024662:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775369.024664:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775369.983997:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775371.007816:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775372.031890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775373.055958:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775374.079923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775374.143848:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775374.143859:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775374.143864:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775374.143875:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11345 00000100:00080000:0.0:1775775374.143886:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775374.143927:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775374.143967:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612644864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775374.144003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775374.144007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775374.144009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775374.144014:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11345 00000100:00080000:0.0:1775775374.144018:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775374.144022:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775374.144033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775374.144047:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612644992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775374.144058:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775775374.144063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612644864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775374.144064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775374.144066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775374.144073:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11345 00000100:00080000:0.0:1775775374.144076:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775374.144079:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775374.144083:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775374.144093:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612645120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775374.144100:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775374.144103:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775374.144104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775374.144106:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11345 00000100:00080000:0.0:1775775374.144109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775374.144112:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775374.144115:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775374.144122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612645248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775374.144128:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:3.0:1775775374.144132:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775374.144133:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775374.144135:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775374.144139:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11345 00000100:00080000:0.0:1775775374.144142:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775374.144144:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775374.144148:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775374.144154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612645376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775374.144174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775374/real 1775775374] req@ffff8de1c5680000 x1862023612644864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775374.144191:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612644864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775374.144202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775374.144206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775374.144210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612644864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775374.144234:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775374.144260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775374.144273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775374/real 1775775374] req@ffff8de1c5680380 x1862023612644992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775374.144287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612644992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775374.144294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775374.144296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775374.144299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612644992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775374.144303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775374.144319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775374.144326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775374/real 1775775374] req@ffff8de1c5682a00 x1862023612645120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775374.144334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612645120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775374.144339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775374.144341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775374.144343:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775374.144346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775374.144356:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775374.144362:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775374/real 1775775374] req@ffff8de1c5681f80 x1862023612645248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775374.144369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612645248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775374.144374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775374.144376:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775374.144378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775374.144381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775374.144390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775374.144395:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775374/real 1775775374] req@ffff8de1c5681c00 x1862023612645376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775374.144402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612645376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775374.144408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775374.144410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775374.144413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775375.103910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775376.127944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775377.151912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775378.175909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775379.199887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775379.263827:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775379.263834:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775379.263839:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775379.263846:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11351 00000100:00080000:0.0:1775775379.263856:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775379.263862:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775379.263894:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612645504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775379.263920:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775379.263922:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775379.263924:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775379.263927:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11351 00000100:00080000:0.0:1775775379.263929:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775379.263931:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775379.263939:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775379.263947:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612645632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775379.263954:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775379.263957:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775379.263958:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775379.263961:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11351 00000100:00080000:0.0:1775775379.263963:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775379.263965:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775379.263968:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775379.263972:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612645504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775379.263977:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612645760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775379.263985:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775379.263988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775379.263988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775379.263991:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11351 00000100:00080000:0.0:1775775379.263994:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775379.263997:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775379.264000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775379.264009:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612645888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775379.264014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775379.264016:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775379.264017:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775379.264020:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11351 00000100:00080000:0.0:1775775379.264024:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775379.264027:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775379.264029:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775379.264034:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775379.264038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612646016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775379.264066:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775379/real 1775775379] req@ffff8de1c5683b80 x1862023612645504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775379.264080:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612645504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775379.264088:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775379.264090:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775379.264093:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612645504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775379.264099:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775379.264113:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775379.264121:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775379/real 1775775379] req@ffff8de1c5682300 x1862023612645632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775379.264129:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612645632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775379.264134:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775379.264136:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775379.264138:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775379.264158:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775379.264177:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775379.264187:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775379/real 1775775379] req@ffff8de1c5680700 x1862023612645760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775379.264200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612645760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775379.264208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775379.264211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775379.264214:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775379.264221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775379.264241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775379.264250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775379/real 1775775379] req@ffff8de1c5682d80 x1862023612645888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775379.264259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612645888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775379.264264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775379.264266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775379.264268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612645888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775379.264272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775379.264284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775379.264289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775379/real 1775775379] req@ffff8de1c5682680 x1862023612646016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775379.264296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612646016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775379.264301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775379.264302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775379.264304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775380.223891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775381.247939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775382.271875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775383.295953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775384.319859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775384.383879:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775384.383892:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775384.383898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775384.383921:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11356 00000100:00080000:1.0:1775775384.383936:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775384.383945:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775384.384000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612646144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775384.384033:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775384.384037:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775384.384039:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775384.384049:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11356 00000100:00080000:1.0:1775775384.384054:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775384.384058:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775384.384070:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775384.384086:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612646272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775384.384103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612646144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775384.384107:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775384.384114:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775384.384116:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775384.384122:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11356 00000100:00080000:1.0:1775775384.384126:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775384.384131:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775384.384137:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775384.384151:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612646400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775384.384162:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775384.384166:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775384.384168:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775384.384172:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11356 00000100:00080000:1.0:1775775384.384187:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775384.384192:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775775384.384199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775775384.384201:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775384.384215:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612646528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775384.384227:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775384.384231:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775384.384233:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775384.384237:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11356 00000100:00080000:1.0:1775775384.384242:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775384.384247:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775384.384253:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775384.384262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775384/real 1775775384] req@ffff8de1c2e17800 x1862023612646144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775384.384267:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612646656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775384.384303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612646144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775384.384323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775384.384329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775384.384335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612646144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775384.384367:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775384.384394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775384.384407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775384/real 1775775384] req@ffff8de1c2e17b80 x1862023612646272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775384.384421:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612646272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775384.384429:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775384.384434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775384.384437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775384.384444:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775384.384466:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775384.384476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775384/real 1775775384] req@ffff8de1c2e16680 x1862023612646400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775384.384489:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612646400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775384.384498:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775384.384501:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775384.384505:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775384.384512:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775384.384533:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775384.384543:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775384/real 1775775384] req@ffff8de1c2e14380 x1862023612646528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775384.384556:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612646528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775384.384565:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775384.384569:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775384.384572:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775384.384578:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775384.384598:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775384.384608:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775384/real 1775775384] req@ffff8de1c2e17100 x1862023612646656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775384.384620:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612646656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775384.384638:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775384.384642:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775384.384645:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775385.343930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775386.367892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775387.391950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775388.415912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775389.439937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775389.503893:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775389.503907:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775389.503913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775389.503925:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11361 00000100:00080000:2.0:1775775389.503941:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775389.503950:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775389.504000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612646784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775389.504039:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775389.504043:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775389.504045:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775389.504050:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11361 00000100:00080000:2.0:1775775389.504054:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775389.504058:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775389.504071:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775389.504085:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612646912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775389.504099:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775389.504103:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775389.504105:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775389.504110:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11361 00000100:00080000:2.0:1775775389.504115:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775389.504125:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775389.504125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612646784:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775389.504138:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775389.504162:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612647040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775389.504176:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775389.504181:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775389.504183:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775389.504187:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11361 00000100:00080000:2.0:1775775389.504193:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775775389.504201:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775389.504202:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775389.504210:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775389.504228:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612647168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775389.504241:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775389.504246:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:3.0:1775775389.504248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775389/real 1775775389] req@ffff8de1d0f2e300 x1862023612646784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775389.504250:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775389.504270:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11361 00000100:00080000:2.0:1775775389.504280:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775389.504288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612646784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775389.504289:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775389.504306:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775775389.504307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775389.504316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775389.504320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612646784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775389.504327:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775389.504332:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612647296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775389.504350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775389.504362:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775389/real 1775775389] req@ffff8de1d0f2e680 x1862023612646912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775389.504372:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612646912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775389.504379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775389.504381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775389.504387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612646912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775389.504407:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775389.504418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775389.504432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775389/real 1775775389] req@ffff8de1d0f2ca80 x1862023612647040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775389.504440:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612647040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775389.504450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775389.504452:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775389.504454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775389.504458:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775389.504470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775389.504476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775389/real 1775775389] req@ffff8de1d0f2d500 x1862023612647168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775389.504483:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612647168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775389.504488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775389.504490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775389.504492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775389.504495:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775389.504505:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775389.504511:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775389/real 1775775389] req@ffff8de1d0f2df80 x1862023612647296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775389.504518:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612647296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775389.504522:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775389.504524:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775389.504527:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775390.463880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775391.487945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775392.511835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775393.535907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775394.559897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775394.623801:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775394.623809:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775394.623813:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775394.623821:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11366 00000100:00080000:2.0:1775775394.623831:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775394.623837:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775394.623868:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612647424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775394.623892:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775394.623895:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775394.623896:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775394.623899:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11366 00000100:00080000:2.0:1775775394.623901:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775394.623904:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775394.623912:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775394.623920:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612647552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775394.623928:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775394.623931:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775394.623932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775394.623935:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11366 00000100:00080000:2.0:1775775394.623937:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775394.623939:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775394.623944:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612647424:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775394.623945:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775394.623956:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612647680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775394.623963:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775394.623965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775394.623967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775394.623969:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11366 00000100:00080000:2.0:1775775394.623971:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775394.623974:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775394.623977:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775394.623985:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612647808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775394.623991:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775394.623995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775394.623997:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775394.624001:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11366 00000100:00080000:2.0:1775775394.624005:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775775394.624006:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775394.624012:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775394.624018:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775394.624032:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612647936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775394.624052:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775394/real 1775775394] req@ffff8de1d0f2c700 x1862023612647424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775394.624074:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612647424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775394.624085:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775394.624089:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775394.624094:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612647424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775394.624102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775394.624127:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775394.624140:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775394/real 1775775394] req@ffff8de1d0f2f100 x1862023612647552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775394.624152:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612647552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775394.624161:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775394.624164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775394.624168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775394.624193:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775394.624215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775394.624228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775394/real 1775775394] req@ffff8de1d0f2df80 x1862023612647680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775394.624241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612647680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775394.624250:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775394.624254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775394.624258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775394.624264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775394.624285:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775394.624296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775394/real 1775775394] req@ffff8de1d0f2d500 x1862023612647808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775394.624310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612647808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775394.624318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775394.624321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775394.624324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775394.624328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775394.624344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775394.624355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775394/real 1775775394] req@ffff8de1d0f2ca80 x1862023612647936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775394.624367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612647936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775394.624376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775394.624379:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775394.624383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612647936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775395.583865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775396.607929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775397.631857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775398.656359:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775399.679852:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775399.743818:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775399.743826:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775399.743831:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775399.743839:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11371 00000100:00080000:2.0:1775775399.743850:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775399.743855:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775399.743886:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612648064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775399.743906:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775399.743909:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775399.743910:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775399.743913:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11371 00000100:00080000:2.0:1775775399.743915:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775399.743917:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775399.743925:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775399.743932:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612648192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775399.743938:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775399.743940:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775399.743941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775399.743944:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11371 00000100:00080000:2.0:1775775399.743945:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775399.743947:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775399.743949:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775399.743956:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612648320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775399.743966:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775399.743969:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775399.743970:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775399.743972:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11371 00000100:00080000:2.0:1775775399.743973:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775399.743975:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775399.743978:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775399.743983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612648448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775399.743987:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775399.743989:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775399.743990:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775399.743992:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11371 00000100:00080000:2.0:1775775399.743993:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775399.743995:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775399.743997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775399.744002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612648576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775399.744063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612648064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775399.744383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775399.744420:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775399.744461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775399.744486:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775400.703904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775401.727837:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775402.751882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775775402.815976:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775775402.816017:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775775402.816035:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775402.816076:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775402.816084:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775402.816092:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775402.816100:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775775402.816138:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775399/real 1775775402] req@ffff8de1d0f2e680 x1862023612648064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775402.816166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612648064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775402.816178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775402.816183:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775402.816187:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612648064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775402.816195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775399/real 1775775402] req@ffff8de1d0f2e300 x1862023612648192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775402.816210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612648192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775402.816224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775402.816229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775402.816233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775402.816240:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775399/real 1775775402] req@ffff8de1d0f2ca80 x1862023612648320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775402.816251:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612648320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775402.816258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775402.816262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775402.816266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775402.816273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775399/real 1775775402] req@ffff8de1d0f2d500 x1862023612648448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775402.816285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612648448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775402.816294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775402.816297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775402.816301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775402.816308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775399/real 1775775402] req@ffff8de1d0f2df80 x1862023612648576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775402.816320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612648576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775402.816329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775402.816332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775402.816336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775403.775883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775404.799879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775404.863823:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775404.863831:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775404.863835:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775404.863843:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11376 00000100:00080000:3.0:1775775404.863852:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775404.863859:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775404.863889:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612648704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775404.863913:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775404.863916:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775404.863917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775404.863922:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11376 00000100:00080000:3.0:1775775404.863925:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775404.863929:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775404.863937:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775404.863948:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612648832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775404.863959:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775404.863961:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612648704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775404.863964:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775404.863970:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775404.863976:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11376 00000100:00080000:3.0:1775775404.863981:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775404.863985:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775404.863991:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775404.864004:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612648960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775404.864013:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775404.864017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775404.864019:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775404.864022:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11376 00000100:00080000:3.0:1775775404.864029:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775404.864034:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775775404.864040:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775775404.864046:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775404.864060:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612649088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775404.864070:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775404.864073:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775404.864075:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775404.864079:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11376 00000100:00080000:3.0:1775775404.864083:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775404.864085:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775404/real 1775775404] req@ffff8de1c7af7480 x1862023612648704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775404.864090:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775404.864100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775404.864117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612649216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775404.864127:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612648704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775404.864141:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775404.864147:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775404.864158:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612648704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775404.864186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775404.864212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775404.864226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775404/real 1775775404] req@ffff8de1c7af7b80 x1862023612648832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775404.864239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612648832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775404.864248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775404.864251:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775404.864256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775404.864263:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775404.864285:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775404.864296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775404/real 1775775404] req@ffff8de1c7af5c00 x1862023612648960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775404.864308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612648960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775404.864322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775404.864325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775404.864329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612648960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775404.864335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775404.864371:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775404.864384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775404/real 1775775404] req@ffff8de1c7af6d80 x1862023612649088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775404.864396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612649088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775404.864404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775404.864407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775404.864410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775404.864423:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775404.864454:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775404.864466:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775404/real 1775775404] req@ffff8de1c7af4e00 x1862023612649216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775404.864477:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612649216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775404.864485:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775404.864488:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775404.864492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775405.823851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775406.847854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775407.871892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775408.895901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775409.919929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775409.983850:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775409.983860:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775409.983865:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775409.983875:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11381 00000100:00080000:2.0:1775775409.983888:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775409.983895:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775409.983941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612649344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775409.983968:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775409.983971:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775409.983972:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775409.983976:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11381 00000100:00080000:2.0:1775775409.983978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775409.983980:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775409.983989:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775409.983998:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612649472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775409.984007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775409.984010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775409.984011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775409.984013:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11381 00000100:00080000:2.0:1775775409.984015:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775409.984021:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775409.984021:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612649344:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775409.984026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775409.984038:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612649600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775409.984044:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775409.984046:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775409.984047:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775409.984050:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11381 00000100:00080000:2.0:1775775409.984052:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775409.984054:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775409.984057:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775409.984064:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612649728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775409.984069:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775409.984071:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775409.984072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775409.984075:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11381 00000100:00080000:2.0:1775775409.984077:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775409.984079:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775409.984082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775409.984088:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612649856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775409.984125:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775409.984186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775409/real 1775775409] req@ffff8de1d0f2f100 x1862023612649344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775409.984211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612649344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775409.984223:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775409.984229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775409.984234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612649344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775409.984278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775409.984307:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775409.984322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775409/real 1775775409] req@ffff8de1d0f2c700 x1862023612649472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775409.984337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612649472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775409.984346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775409.984349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775409.984353:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775409.984360:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775409.984387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775409.984399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775409/real 1775775409] req@ffff8de1d0f2df80 x1862023612649600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775409.984413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612649600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775409.984422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775409.984425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775409.984428:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775409.984435:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775409.984457:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775409.984469:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775409/real 1775775409] req@ffff8de1d0f2d500 x1862023612649728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775409.984482:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612649728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775409.984492:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775409.984496:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775409.984500:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775409.984506:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775409.984527:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775409.984538:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775409/real 1775775409] req@ffff8de1d0f2ca80 x1862023612649856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775409.984559:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612649856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775409.984567:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775409.984571:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775409.984574:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612649856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775410.943928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775411.967917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775412.991926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775414.015841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775415.039861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775415.103839:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775415.103847:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775415.103852:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775415.103860:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11386 00000100:00080000:0.0:1775775415.103870:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775415.103875:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775415.103910:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612649984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775415.103934:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775415.103937:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775415.103938:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775415.103941:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11386 00000100:00080000:0.0:1775775415.103944:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775415.103947:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775415.103955:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775415.103963:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612650112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775415.103970:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775415.103973:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775415.103974:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775415.103977:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11386 00000100:00080000:0.0:1775775415.103979:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775415.103983:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775415.103984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612649984:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775415.103986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775415.103997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612650240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775415.104003:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775415.104005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775415.104007:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775415.104009:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11386 00000100:00080000:0.0:1775775415.104012:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775415.104014:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775415.104018:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775415.104025:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612650368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775415.104030:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775415.104033:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775415.104035:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775415.104037:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11386 00000100:00080000:0.0:1775775415.104039:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775415.104041:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775415.104044:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775415.104047:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775415.104054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612650496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775415.104082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775415/real 1775775415] req@ffff8de1c5682680 x1862023612649984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775415.104097:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612649984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775415.104104:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775415.104107:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775415.104110:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612649984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775415.104115:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775415.104130:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775415.104137:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775415/real 1775775415] req@ffff8de1c5682d80 x1862023612650112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775415.104145:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612650112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775415.104167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775415.104171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775415.104202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775415.104226:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775415.104242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775415.104250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775415/real 1775775415] req@ffff8de1c5680700 x1862023612650240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775415.104258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612650240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775415.104263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775415.104266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775415.104268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775415.104272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775415.104282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775415.104287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775415/real 1775775415] req@ffff8de1c5682300 x1862023612650368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775415.104295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612650368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775415.104299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775415.104301:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775415.104304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775415.104307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775415.104317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775415.104322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775415/real 1775775415] req@ffff8de1c5683b80 x1862023612650496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775415.104330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612650496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775415.104339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775415.104343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775415.104346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775416.063936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775417.087903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775418.111884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775419.135874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775420.159856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775420.223837:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775420.223845:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775420.223849:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775420.223857:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11391 00000100:00080000:0.0:1775775420.223870:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775420.223878:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775420.223917:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612650624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775420.223951:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775420.223956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775420.223958:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775420.223962:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11391 00000100:00080000:0.0:1775775420.223967:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775420.223971:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775420.223981:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775420.223995:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612650752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775420.224007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775420.224012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775775420.224013:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612650624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775420.224015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775420.224024:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11391 00000100:00080000:0.0:1775775420.224028:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775420.224032:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775420.224038:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775420.224053:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612650880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775420.224063:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775420.224067:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775420.224070:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775420.224074:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11391 00000100:00080000:0.0:1775775420.224077:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775420.224082:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775775420.224084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775420.224103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775420.224114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612651008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775420.224122:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775420.224124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775420.224126:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775420.224129:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11391 00000100:00080000:0.0:1775775420.224132:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775420.224135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775420/real 1775775420] req@ffff8de1c5681c00 x1862023612650624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775420.224137:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775420.224142:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775420.224155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612651136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775420.224164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612650624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775420.224185:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775420.224190:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775420.224195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612650624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775420.224220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775420.224246:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775420.224260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775420/real 1775775420] req@ffff8de1c5681f80 x1862023612650752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775420.224274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612650752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775420.224282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775420.224286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775420.224289:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775420.224295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775420.224313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775420.224322:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775420/real 1775775420] req@ffff8de1c5682a00 x1862023612650880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775420.224334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612650880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775420.224341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775420.224344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775420.224348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612650880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775420.224353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775420.224367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775420.224375:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775420/real 1775775420] req@ffff8de1c5680380 x1862023612651008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775420.224386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612651008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775420.224395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775420.224399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775420.224402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775420.224407:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775420.224420:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775420.224428:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775420/real 1775775420] req@ffff8de1c5680000 x1862023612651136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775420.224439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612651136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775420.224447:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775420.224449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775420.224452:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775421.183852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775422.207904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775423.231869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775424.255907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775425.279871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775425.343831:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775425.343840:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775425.343844:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775425.343852:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11397 00000100:00080000:2.0:1775775425.343862:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775425.343867:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775425.343897:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612651264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775425.343918:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775425.343920:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775425.343921:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775425.343924:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11397 00000100:00080000:2.0:1775775425.343926:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775425.343928:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775425.343936:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775425.343943:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612651392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775425.343950:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775425.343953:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775425.343954:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775425.343957:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11397 00000100:00080000:2.0:1775775425.343959:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775425.343961:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775425.343964:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775425.343970:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612651264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775425.343974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612651520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775425.343983:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775425.343985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775425.343987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775425.343989:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11397 00000100:00080000:2.0:1775775425.343991:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775425.343993:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775425.344009:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775425.344021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612651648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775425.344028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775425.344030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775425.344031:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775425.344034:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11397 00000100:00080000:2.0:1775775425.344038:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775425.344040:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775425.344043:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775425.344052:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612651776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775425.344052:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775425.344092:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775425/real 1775775425] req@ffff8de1d0f2e300 x1862023612651264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775425.344111:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612651264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775425.344121:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775425.344126:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775425.344130:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612651264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775425.344138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775425.344159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775425.344170:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775425/real 1775775425] req@ffff8de1d0f2e680 x1862023612651392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775425.344183:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612651392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775425.344192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775425.344195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775425.344198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775425.344220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775425.344237:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775425.344245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775425/real 1775775425] req@ffff8de1d0f2ca80 x1862023612651520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775425.344258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612651520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775425.344265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775425.344269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775425.344272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775425.344278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775425.344293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775425.344302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775425/real 1775775425] req@ffff8de1d0f2d500 x1862023612651648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775425.344314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612651648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775425.344322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775425.344325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775425.344328:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775425.344333:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775425.344350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775425.344358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775425/real 1775775425] req@ffff8de1d0f2df80 x1862023612651776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775425.344369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612651776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775425.344378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775425.344381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775425.344384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612651776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775426.303893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775427.327959:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775428.351903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775429.375910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775430.399954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775430.463862:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775430.463872:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775430.463877:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775430.463887:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11402 00000100:00080000:2.0:1775775430.463901:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775430.463937:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775430.463981:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612651904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775430.464008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775430.464011:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775430.464012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775430.464015:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11402 00000100:00080000:2.0:1775775430.464018:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775430.464020:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775430.464030:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775430.464038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612652032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775430.464046:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775430.464049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775430.464050:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775430.464054:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11402 00000100:00080000:2.0:1775775430.464056:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775430.464058:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775430.464061:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775430.464070:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612652160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775430.464077:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775775430.464079:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612651904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775430.464081:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775430.464084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775430.464090:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11402 00000100:00080000:2.0:1775775430.464092:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775430.464095:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775430.464098:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775430.464105:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612652288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775430.464110:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775430.464112:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775430.464114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775430.464116:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11402 00000100:00080000:2.0:1775775430.464119:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775430.464121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775430.464124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775430.464131:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612652416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775430.464170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775430.464217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775430/real 1775775430] req@ffff8de1d0f2c700 x1862023612651904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775430.464240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612651904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775430.464259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775430.464264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775430.464270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612651904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775430.464278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775430.464313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775430.464328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775430/real 1775775430] req@ffff8de1d0f2f100 x1862023612652032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775430.464351:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612652032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775430.464364:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775430.464368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775430.464372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775430.464403:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775430.464426:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775430.464438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775430/real 1775775430] req@ffff8de1d0f2df80 x1862023612652160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775430.464450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612652160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775430.464458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775430.464462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775430.464465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775430.464473:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775430.464493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775430.464504:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775430/real 1775775430] req@ffff8de1d0f2d500 x1862023612652288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775430.464516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612652288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775430.464525:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775430.464528:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775430.464532:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775430.464538:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775430.464559:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775430.464569:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775430/real 1775775430] req@ffff8de1d0f2ca80 x1862023612652416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775430.464581:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612652416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775430.464590:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775430.464594:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775430.464597:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775431.423914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775432.447955:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775433.471902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775434.495893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775435.519935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775435.583852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775435.583863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775435.583868:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775435.583879:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11407 00000100:00080000:3.0:1775775435.583890:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775435.583897:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775435.583936:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612652544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775435.583967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775435.583971:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775435.583973:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775435.583978:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11407 00000100:00080000:3.0:1775775435.583983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775435.583987:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775435.583997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775435.584004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612652544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775435.584014:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612652672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775435.584028:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775435.584032:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775435.584034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775435.584039:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11407 00000100:00080000:3.0:1775775435.584054:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775435.584059:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775435.584065:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775775435.584070:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775435.584080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612652800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775435.584100:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775435.584103:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775435/real 1775775435] req@ffff8de1c7af5500 x1862023612652544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775435.584105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775435.584109:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775435.584118:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11407 00000100:00080000:3.0:1775775435.584124:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775435.584128:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612652544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775435.584129:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775435.584139:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775435.584149:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775435.584154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775435.584158:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612652928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775435.584160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612652544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775435.584175:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775435.584179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775435.584182:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775775435.584185:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652672:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775775435.584190:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11407 00000100:00080000:3.0:1775775435.584197:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775435.584202:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775775435.584208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775775435.584209:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775435.584218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775435/real 1775775435] req@ffff8de1c7af5880 x1862023612652672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775435.584226:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612653056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775435.584232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612652672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775435.584252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775435.584257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775435.584261:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775435.584269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775435.584290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775435.584298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775435/real 1775775435] req@ffff8de1c7af4a80 x1862023612652800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775435.584307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612652800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775435.584312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775435.584315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775435.584318:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775435.584324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775435.584343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775435.584353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775435/real 1775775435] req@ffff8de1c7af5f80 x1862023612652928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775435.584366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612652928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775435.584375:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775435.584378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775435.584382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612652928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775435.584408:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775435.584428:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775435.584439:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775435/real 1775775435] req@ffff8de1c7af4380 x1862023612653056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775435.584452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612653056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775435.584460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775435.584462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775435.584464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775436.543887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775437.567944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775438.591887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775439.615901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775440.639857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775440.703942:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775440.703951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775440.703957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775440.703967:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11412 00000100:00080000:3.0:1775775440.703981:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775440.703988:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775440.704023:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612653184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775440.704054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775440.704058:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775440.704061:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775440.704067:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11412 00000100:00080000:3.0:1775775440.704073:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775440.704077:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775440.704087:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612653184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775440.704088:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775440.704108:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612653312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775440.704120:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775440.704124:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775440.704125:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775440.704129:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11412 00000100:00080000:3.0:1775775440.704133:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775440.704138:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775440.704143:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775775440.704145:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775440.704161:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612653440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775440.704172:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775440.704176:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775440.704178:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775440.704183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775440/real 1775775440] req@ffff8de1c7af5180 x1862023612653184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775440.704198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612653184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775440.704205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775440.704208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775440.704211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612653184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775440.704229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653312:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775775440.704240:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11412 00000100:00080000:3.0:1775775440.704245:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775775440.704249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775440.704253:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775440.704259:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775440.704262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775440/real 1775775440] req@ffff8de1c7af7100 x1862023612653312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775440.704273:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612653568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775440.704276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612653312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775440.704298:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775440.704299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775440.704305:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775440.704307:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775775440.704308:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775440.704313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653312:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775775440.704315:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11412 00000100:00080000:3.0:1775775440.704321:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775440.704325:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653440:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775775440.704326:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775440.704333:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775440.704348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775440.704354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775440/real 1775775440] req@ffff8de1c7af7800 x1862023612653440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775440.704361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612653440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775440.704367:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775440.704369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775440.704371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775440.704380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775440.704391:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775440.704397:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775440/real 1775775440] req@ffff8de1c7af5180 x1862023612653568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775440.704413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612653568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775440.704419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775440.704421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775440.704423:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775440.704450:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612653696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775440.704501:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775440.704520:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775440.704534:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775440/real 1775775440] req@ffff8de1c7af4380 x1862023612653696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775440.704548:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612653696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775440.704557:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775440.704561:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775440.704564:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775441.663885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775442.687913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775443.711903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775444.735932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775445.759911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775445.823801:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775445.823809:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775445.823813:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775445.823821:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11417 00000100:00080000:3.0:1775775445.823831:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775445.823837:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775445.823867:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612653824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775445.823889:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775445.823892:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775445.823894:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775445.823897:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11417 00000100:00080000:3.0:1775775445.823899:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775445.823903:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775445.823911:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775445.823922:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612653824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775445.823923:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612653952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775445.823936:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775445.823938:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775445.823939:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775445.823942:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11417 00000100:00080000:3.0:1775775445.823944:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775445.823946:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775445.823949:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775445.823958:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612654080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775445.823964:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775445.823966:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775445.823967:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775445.823969:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11417 00000100:00080000:3.0:1775775445.823972:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775445.823975:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775445.823978:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775445.823988:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612654208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775445.823989:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775445.823998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775445.824002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775445.824004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775445.824009:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11417 00000100:00080000:3.0:1775775445.824013:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775445.824016:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775445.824021:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775445/real 1775775445] req@ffff8de1c7af5f80 x1862023612653824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775775445.824024:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775445.824043:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612654336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775445.824048:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612653824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775445.824070:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775445.824076:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775445.824081:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612653824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775445.824106:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775445.824124:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775445.824133:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775445/real 1775775445] req@ffff8de1c7af4a80 x1862023612653952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775445.824141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612653952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775445.824151:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775445.824154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775445.824156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612653952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775445.824159:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775445.824169:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775445.824175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775445/real 1775775445] req@ffff8de1c7af5880 x1862023612654080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775445.824182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612654080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775445.824187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775445.824188:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775445.824190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775445.824194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775445.824203:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775445.824208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775445/real 1775775445] req@ffff8de1c7af5500 x1862023612654208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775445.824215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612654208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775445.824220:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775445.824222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775445.824224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775445.824228:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775445.824242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775445.824251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775445/real 1775775445] req@ffff8de1c7af4e00 x1862023612654336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775445.824273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612654336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775445.824281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775445.824285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775445.824287:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775446.783896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775447.807946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775448.831906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775449.855938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775450.879869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775450.943813:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775450.943823:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775450.943828:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775450.943838:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11422 00000100:00080000:3.0:1775775450.943849:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775450.943856:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775450.943891:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612654464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775450.943927:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775450.943932:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775450.943934:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775450.943938:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11422 00000100:00080000:3.0:1775775450.943942:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775450.943946:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775450.943957:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775450.943971:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612654592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775450.943979:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612654464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775450.943994:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775450.943998:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775450.944000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775450.944005:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11422 00000100:00080000:3.0:1775775450.944009:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775450.944013:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775450.944019:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775450.944031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612654720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775450.944041:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775450.944045:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775450.944050:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775450.944052:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775450.944057:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11422 00000100:00080000:3.0:1775775450.944061:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775450.944065:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775450.944071:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775450.944086:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775450/real 1775775450] req@ffff8de1c7af6d80 x1862023612654464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775450.944086:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612654848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775450.944098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775450.944105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775450.944109:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775450.944116:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11422 00000100:00080000:3.0:1775775450.944120:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775450.944124:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775450.944129:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775450.944130:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612654464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775450.944141:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775775450.944142:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612654976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775450.944147:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775450.944155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612654464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775450.944186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775450.944220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775450.944232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775450/real 1775775450] req@ffff8de1c7af5c00 x1862023612654592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775450.944241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612654592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775450.944248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775450.944250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775450.944252:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775450.944257:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775450.944271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775450.944277:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775450/real 1775775450] req@ffff8de1c7af7b80 x1862023612654720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775450.944284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612654720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775450.944289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775450.944291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775450.944293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775450.944297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775450.944311:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775450.944317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775450/real 1775775450] req@ffff8de1c7af7480 x1862023612654848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775450.944324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612654848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775450.944329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775450.944332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775450.944334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775450.944337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775450.944347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775450.944352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775450/real 1775775450] req@ffff8de1c7af4000 x1862023612654976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775450.944359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612654976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775450.944363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775450.944365:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775450.944367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612654976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775451.903881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775452.927874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775453.951890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775454.975888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775455.999894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775456.063796:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775456.063806:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775456.063811:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775456.063821:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11427 00000100:00080000:0.0:1775775456.063833:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775456.063840:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775456.063880:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612655104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775456.063905:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775456.063908:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775456.063909:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775456.063912:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11427 00000100:00080000:0.0:1775775456.063915:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775456.063917:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775456.063927:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775456.063937:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612655232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775456.063946:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775456.063950:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775456.063951:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775456.063954:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11427 00000100:00080000:0.0:1775775456.063956:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775456.063958:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775456.063963:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775456.063969:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612655360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775456.063978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775456.063980:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612655104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775456.063982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775456.063983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775456.063999:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11427 00000100:00080000:0.0:1775775456.064002:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775456.064014:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775456.064020:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775456.064030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612655488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775456.064038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775456.064041:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775456.064042:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775456.064044:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11427 00000100:00080000:0.0:1775775456.064050:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775456.064052:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775456.064057:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775456.064065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775456.064076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612655616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775456.064109:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775456/real 1775775456] req@ffff8de1c5683800 x1862023612655104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775456.064125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612655104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775456.064132:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775456.064136:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775456.064139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612655104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775456.064145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775456.064161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775456.064168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775456/real 1775775456] req@ffff8de1c5681500 x1862023612655232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775456.064176:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612655232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775456.064181:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775456.064184:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775456.064186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775456.064205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775456.064215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775456.064232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775456/real 1775775456] req@ffff8de1c5681880 x1862023612655360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775456.064240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612655360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775456.064245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775456.064247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775456.064248:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775456.064252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775456.064262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775456.064267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775456/real 1775775456] req@ffff8de1c5680e00 x1862023612655488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775456.064275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612655488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775456.064280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775456.064282:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775456.064283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775456.064296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775456.064305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775456.064311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775456/real 1775775456] req@ffff8de1c5683480 x1862023612655616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775456.064317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612655616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775456.064322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775456.064324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775456.064326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775457.023905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775458.047857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775459.071919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775460.095909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775461.119892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775461.183852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775461.183860:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775461.183864:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775461.183873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11432 00000100:00080000:3.0:1775775461.183883:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775461.183889:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775461.183921:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612655744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775461.183945:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775461.183948:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775461.183950:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775461.183958:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11432 00000100:00080000:3.0:1775775461.183962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775461.183966:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775461.183977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775461.183994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612655872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775461.184000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612655744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775461.184015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775461.184018:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775461.184020:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775461.184023:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11432 00000100:00080000:3.0:1775775461.184027:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775461.184030:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775461.184035:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775461.184045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612656000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775461.184052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775461.184055:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775461.184056:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775461.184058:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11432 00000100:00080000:3.0:1775775461.184061:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775461.184063:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775461.184066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775461.184075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612656128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775461.184077:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775461.184090:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775461.184092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775461.184094:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775461.184104:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11432 00000100:00080000:3.0:1775775461.184107:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775461.184110:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775461.184114:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775461.184122:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775461/real 1775775461] req@ffff8de1c7af6300 x1862023612655744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775461.184124:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612656256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775461.184186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612655744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775461.184203:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775461.184206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775461.184209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612655744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775461.184229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775461.184248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775461.184257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775461/real 1775775461] req@ffff8de1c7af6a00 x1862023612655872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775461.184266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612655872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775461.184271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775461.184273:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775461.184275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612655872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775461.184279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775461.184289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775461.184294:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775461/real 1775775461] req@ffff8de1c7af6680 x1862023612656000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775461.184302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612656000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775461.184307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775461.184308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775461.184310:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775461.184314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775461.184324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775461.184329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775461/real 1775775461] req@ffff8de1c7af4700 x1862023612656128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775461.184336:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612656128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775461.184341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775461.184343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775461.184345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775461.184348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775461.184357:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775461.184361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775461/real 1775775461] req@ffff8de1c7af4000 x1862023612656256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775461.184368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612656256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775461.184395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775461.184398:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775461.184400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775462.143854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775463.167853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775464.191857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775465.215887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775466.239861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775466.303896:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775466.303906:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775466.303911:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775466.303923:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11438 00000100:00080000:0.0:1775775466.303938:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775466.303947:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775466.304000:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612656384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775466.304028:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775466.304031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775466.304032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775466.304036:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11438 00000100:00080000:0.0:1775775466.304040:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775466.304042:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775466.304053:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775466.304064:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612656512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775466.304072:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775466.304076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775466.304077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775466.304082:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11438 00000100:00080000:0.0:1775775466.304084:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775466.304086:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775466.304089:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775466.304096:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612656640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775466.304105:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775466.304111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775466.304113:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775466.304113:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612656384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775466.304121:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11438 00000100:00080000:0.0:1775775466.304131:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775466.304135:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775466.304139:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775466.304154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612656768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775466.304160:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775466.304163:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775466.304165:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775466.304170:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11438 00000100:00080000:0.0:1775775466.304188:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775466.304190:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775466.304196:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775466.304204:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612656896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775466.304233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775466.304265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775466.304305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775466.304326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775467.263922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775468.287887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775469.311818:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775775469.376017:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775775469.376072:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775775469.376092:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775469.376130:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775469.376145:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775469.376160:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775469.376176:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775775469.376183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775466/real 1775775469] req@ffff8de1c5681880 x1862023612656640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775469.376214:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612656640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775469.376237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775469.376244:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775469.376249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775469.376260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775466/real 1775775469] req@ffff8de1c5681500 x1862023612656768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775469.376285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612656768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775469.376293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775469.376297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775469.376300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775469.376307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775466/real 1775775469] req@ffff8de1c5683800 x1862023612656896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775469.376320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612656896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775469.376330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775469.376333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775469.376337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656896:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775469.376345:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775466/real 1775775469] req@ffff8de1c5683480 x1862023612656384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775469.376355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612656384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775469.376360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775469.376363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775469.376366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612656384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775469.376373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775466/real 1775775469] req@ffff8de1c5680e00 x1862023612656512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775469.376385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612656512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775469.376393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775469.376397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775469.376400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612656512:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775775470.335829:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775471.359836:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775471.423898:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775471.423909:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775471.423915:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775471.423925:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11443 00000100:00080000:3.0:1775775471.423937:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775471.423954:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775471.423990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612657024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775471.424023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775471.424027:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775471.424029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775471.424034:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11443 00000100:00080000:3.0:1775775471.424038:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775471.424042:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775471.424052:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775471.424067:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612657152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775471.424077:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775471.424081:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775471.424083:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775471.424087:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11443 00000100:00080000:3.0:1775775471.424091:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775471.424095:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775471.424100:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775471.424123:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612657280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775471.424133:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775471.424137:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775471.424138:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775471.424142:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11443 00000100:00080000:3.0:1775775471.424145:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775471.424149:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775471.424155:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775471.424165:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612657408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775471.424175:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775471.424178:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775471.424181:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775471.424184:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11443 00000100:00080000:3.0:1775775471.424230:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775471.424234:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775471.424240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612657024:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775471.424240:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775471.424251:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612657536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775471.424306:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775471.424342:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775471/real 1775775471] req@ffff8de1c7af7480 x1862023612657024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775471.424361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612657024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775471.424371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775471.424375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775471.424379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612657024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775471.424387:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775471.424411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775471.424425:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775471/real 1775775471] req@ffff8de1c7af7b80 x1862023612657152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775471.424437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612657152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775471.424446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775471.424449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775471.424453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775471.424459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775471.424480:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775471.424491:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775471/real 1775775471] req@ffff8de1c7af5c00 x1862023612657280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775471.424504:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612657280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775471.424516:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775471.424520:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775471.424522:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775471.424528:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775471.424548:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775471.424559:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775471/real 1775775471] req@ffff8de1c7af6d80 x1862023612657408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775471.424571:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612657408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775471.424578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775471.424581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775471.424584:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775471.424613:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775471.424633:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775471.424643:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775471/real 1775775471] req@ffff8de1c7af4e00 x1862023612657536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775471.424653:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612657536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775471.424660:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775471.424663:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775471.424666:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775472.383832:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775473.407866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775474.431918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775475.455872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775476.479907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775476.543861:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775476.543872:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775476.543877:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775476.543887:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11448 00000100:00080000:3.0:1775775476.543899:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775476.543905:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775476.543938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612657664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775476.543967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775476.543971:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775476.543975:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775476.543978:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11448 00000100:00080000:3.0:1775775476.543980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775476.543983:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775476.543991:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775476.544002:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612657792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775476.544020:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775476.544025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612657664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775476.544026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775476.544030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775476.544038:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11448 00000100:00080000:3.0:1775775476.544043:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775476.544047:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775476.544053:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775476.544067:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612657920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775476.544074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775476.544076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775476.544077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775476.544080:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11448 00000100:00080000:3.0:1775775476.544083:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775476.544086:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775476.544090:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775476.544098:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612658048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775476.544099:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775476.544129:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775476.544132:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775476.544133:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775476.544137:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11448 00000100:00080000:3.0:1775775476.544141:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775476.544144:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775476.544148:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775476.544160:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612658176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775476.544161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775476/real 1775775476] req@ffff8de1c7af5500 x1862023612657664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775476.544195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612657664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775476.544207:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775476.544213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775476.544217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612657664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775476.544243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775476.544272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775476.544286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775476/real 1775775476] req@ffff8de1c7af5880 x1862023612657792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775476.544301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612657792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775476.544310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775476.544313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775476.544317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775476.544326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775476.544353:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775476.544370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775476/real 1775775476] req@ffff8de1c7af4a80 x1862023612657920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775476.544383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612657920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775476.544392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775476.544396:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775476.544400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612657920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775476.544408:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775476.544433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775476.544447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775476/real 1775775476] req@ffff8de1c7af5f80 x1862023612658048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775476.544468:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612658048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775476.544479:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775476.544484:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775476.544489:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775476.544496:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775476.544521:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775476.544536:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775476/real 1775775476] req@ffff8de1c7af4380 x1862023612658176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775476.544552:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612658176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775476.544561:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775476.544565:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775476.544568:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775477.503913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775478.527906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775479.551863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775480.575933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775481.599839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775481.663815:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775481.663824:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775481.663828:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775481.663836:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11453 00000100:00080000:3.0:1775775481.663846:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775481.663851:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775481.663883:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612658304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775481.663906:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775481.663909:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775481.663910:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775481.663913:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11453 00000100:00080000:3.0:1775775481.663916:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775481.663918:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775481.663926:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775481.663936:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612658432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775481.663940:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612658304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775481.663952:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775481.663954:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775481.663955:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775481.663958:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11453 00000100:00080000:3.0:1775775481.663961:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775481.663963:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775481.663967:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775481.663975:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612658560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775481.663981:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775481.663983:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775481.663984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775481.663986:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11453 00000100:00080000:3.0:1775775481.663988:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775481.663991:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775481.663994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775481.664003:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775481.664003:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612658688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775481.664012:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775481.664040:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775481.664043:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775481.664048:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11453 00000100:00080000:3.0:1775775481.664053:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775481.664059:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775481/real 1775775481] req@ffff8de1c7af5180 x1862023612658304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775481.664059:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775481.664069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775481.664088:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612658816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775481.664092:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612658304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775481.664118:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775481.664124:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775481.664129:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612658304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775481.664154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775481.664180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775481.664193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775481/real 1775775481] req@ffff8de1c7af7800 x1862023612658432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775481.664206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612658432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775481.664211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775481.664214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775481.664216:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775481.664221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775481.664236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775481.664242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775481/real 1775775481] req@ffff8de1c7af7100 x1862023612658560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775481.664250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612658560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775481.664255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775481.664257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775481.664259:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775481.664262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775481.664272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775481.664277:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775481/real 1775775481] req@ffff8de1c7af4380 x1862023612658688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775481.664284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612658688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775481.664289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775481.664291:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775481.664293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775481.664296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775481.664305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775481.664310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775481/real 1775775481] req@ffff8de1c7af5f80 x1862023612658816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775481.664318:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612658816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775481.664323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775481.664324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775481.664326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612658816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775482.623902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775483.647855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775484.671870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775485.695884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775486.719881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775486.783829:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775486.783838:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775486.783843:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775486.783850:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11458 00000100:00080000:3.0:1775775486.783861:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775486.783867:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775486.783900:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612658944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775486.783937:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775486.783940:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775486.783942:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775486.783946:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11458 00000100:00080000:3.0:1775775486.783948:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775486.783952:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775486.783961:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775486.783972:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612659072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775486.783979:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612658944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775486.783983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775486.783987:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775486.783988:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775486.783991:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11458 00000100:00080000:3.0:1775775486.783994:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775486.783996:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775486.784000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775486.784008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612659200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775486.784014:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775486.784016:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775486.784018:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775486.784020:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11458 00000100:00080000:3.0:1775775486.784023:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775486.784025:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775486.784028:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775486.784035:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612659328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775486.784042:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775486.784044:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775486.784046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775486.784048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775486.784051:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11458 00000100:00080000:3.0:1775775486.784054:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775486.784057:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775486.784060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775486.784066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612659456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775486.784082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775486/real 1775775486] req@ffff8de1c7af4a80 x1862023612658944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775486.784106:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612658944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775486.784118:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775486.784123:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775486.784127:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612658944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775486.784154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775486.784179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775486.784193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775486/real 1775775486] req@ffff8de1c7af5880 x1862023612659072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775486.784206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612659072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775486.784222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775486.784226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775486.784230:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775486.784237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775486.784258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775486.784268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775486/real 1775775486] req@ffff8de1c7af5500 x1862023612659200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775486.784280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612659200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775486.784289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775486.784293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775486.784296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775486.784302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775486.784322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775486.784333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775486/real 1775775486] req@ffff8de1c7af4e00 x1862023612659328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775486.784345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612659328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775486.784354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775486.784357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775486.784361:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775486.784366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775486.784385:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775486.784396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775486/real 1775775486] req@ffff8de1c7af6d80 x1862023612659456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775486.784408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612659456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775486.784417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775486.784421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775486.784424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775487.743930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775488.767886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775489.791892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775490.815872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775491.839874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775491.903816:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775491.903824:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775491.903828:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775491.903857:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11463 00000100:00080000:1.0:1775775491.903869:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775491.903877:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775491.903915:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612659584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775491.903950:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775491.903954:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775491.903956:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775491.903961:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11463 00000100:00080000:1.0:1775775491.903966:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775491.903970:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775491.903980:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775491.903993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612659712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775491.904001:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612659584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775491.904005:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775491.904009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775491.904010:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775491.904013:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11463 00000100:00080000:1.0:1775775491.904016:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775491.904019:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775491.904023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775491.904032:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612659840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775491.904039:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775491.904047:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775491.904049:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775491.904052:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11463 00000100:00080000:1.0:1775775491.904055:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775491.904057:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775491.904061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775491.904062:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775491.904071:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612659968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775491.904079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775491.904081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775491.904083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775491.904085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11463 00000100:00080000:1.0:1775775491.904088:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775491.904091:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775491.904095:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775491.904099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775491/real 1775775491] req@ffff8de1c2e16a00 x1862023612659584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775491.904103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612660096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775491.904155:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612659584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775491.904167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775491.904171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775491.904175:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612659584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775491.904197:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775491.904221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775491.904234:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775491/real 1775775491] req@ffff8de1c2e17100 x1862023612659712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775491.904247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612659712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775491.904255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775491.904259:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775491.904263:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775491.904269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775491.904289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775491.904300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775491/real 1775775491] req@ffff8de1c2e14380 x1862023612659840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775491.904313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612659840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775491.904320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775491.904324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775491.904327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775491.904334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775491.904354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775491.904364:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775491/real 1775775491] req@ffff8de1c2e16680 x1862023612659968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775491.904376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612659968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775491.904384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775491.904387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775491.904390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612659968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775491.904396:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775491.904416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775491.904427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775491/real 1775775491] req@ffff8de1c2e17b80 x1862023612660096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775491.904445:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612660096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775491.904453:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775491.904456:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775491.904459:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775492.863994:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775493.887923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775494.911947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775495.935965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775496.959916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775497.023880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775497.023891:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775497.023896:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775497.023908:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11468 00000100:00080000:1.0:1775775497.023923:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775497.023930:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775497.023963:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612660224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775497.023988:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775497.023991:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775497.023992:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775497.023996:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11468 00000100:00080000:1.0:1775775497.023999:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775497.024003:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775497.024012:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775497.024021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612660352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775497.024030:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775497.024035:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775775497.024035:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612660224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775497.024042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775497.024053:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11468 00000100:00080000:1.0:1775775497.024056:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775497.024058:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775497.024061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775497.024075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612660480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775497.024081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775497.024085:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775497.024086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775497.024088:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11468 00000100:00080000:1.0:1775775497.024091:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775497.024094:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775497.024100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775497.024106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612660608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775497.024113:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775497.024115:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775497.024116:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775497.024119:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11468 00000100:00080000:1.0:1775775497.024122:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775497.024125:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775775497.024133:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775775497.024136:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775497.024146:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612660736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775497.024177:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775497/real 1775775497] req@ffff8de1c2e17800 x1862023612660224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775497.024196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612660224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775497.024207:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775497.024211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775497.024215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612660224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775497.024239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775497.024257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775497.024266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775497/real 1775775497] req@ffff8de1c2e15500 x1862023612660352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775497.024274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612660352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775497.024284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775497.024287:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775497.024289:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775497.024293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775497.024304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775497.024309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775497/real 1775775497] req@ffff8de1c2e14700 x1862023612660480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775497.024316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612660480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775497.024322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775497.024324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775497.024325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775497.024329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775497.024340:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775497.024346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775497/real 1775775497] req@ffff8de1c2e17480 x1862023612660608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775497.024353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612660608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775497.024358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775497.024360:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775497.024362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775497.024366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775497.024377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775497.024382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775497/real 1775775497] req@ffff8de1c2e14a80 x1862023612660736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775497.024390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612660736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775497.024395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775497.024397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775497.024399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775497.983939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775499.007857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775500.031897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775501.055836:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775502.079865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775502.143818:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775502.143826:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775502.143831:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775502.143839:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11473 00000100:00080000:0.0:1775775502.143848:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775502.143854:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775502.143883:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612660864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775502.143906:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775502.143909:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775502.143910:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775502.143914:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11473 00000100:00080000:0.0:1775775502.143916:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775502.143918:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775502.143927:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775502.143934:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612660992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775502.143941:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775502.143944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775502.143946:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775502.143948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11473 00000100:00080000:0.0:1775775502.143951:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775502.143953:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775502.143956:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775502.143962:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612661120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775502.143972:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612660864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775502.143976:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775502.143982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775502.143983:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775502.143986:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11473 00000100:00080000:0.0:1775775502.143988:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775502.143990:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775502.143993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775502.144002:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612661248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775502.144008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775502.144011:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775502.144012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775502.144014:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11473 00000100:00080000:0.0:1775775502.144016:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775502.144018:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775502.144021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775502.144027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612661376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775502.144046:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775502.144082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775502/real 1775775502] req@ffff8de1c5680000 x1862023612660864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775502.144100:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612660864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775502.144111:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775502.144115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775502.144119:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612660864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775502.144126:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775502.144146:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775502.144157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775502/real 1775775502] req@ffff8de1c5680380 x1862023612660992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775502.144170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612660992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775502.144177:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775502.144181:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775502.144184:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612660992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775502.144204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775502.144221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775502.144230:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775502/real 1775775502] req@ffff8de1c5682a00 x1862023612661120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775502.144241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612661120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775502.144249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775502.144253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775502.144256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775502.144262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775502.144277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775502.144285:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775502/real 1775775502] req@ffff8de1c5681f80 x1862023612661248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775502.144296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612661248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775502.144305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775502.144308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775502.144311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775502.144317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775502.144332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775502.144340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775502/real 1775775502] req@ffff8de1c5681c00 x1862023612661376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775502.144353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612661376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775502.144361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775502.144364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775502.144368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775503.103881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775504.127899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775505.151891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775506.175954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775507.199858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775507.263819:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775507.263826:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775507.263830:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775507.263838:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11479 00000100:00080000:1.0:1775775507.263849:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775507.263855:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775507.263886:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612661504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775507.263912:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775507.263915:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775507.263917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775507.263919:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11479 00000100:00080000:1.0:1775775507.263922:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775507.263924:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775507.263932:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775507.263941:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612661632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775507.263947:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775507.263950:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775507.263951:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775507.263954:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11479 00000100:00080000:1.0:1775775507.263956:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775507.263958:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775507.263961:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775507.263966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612661760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775507.263972:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775507.263974:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775507.263976:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775507.263978:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11479 00000100:00080000:1.0:1775775507.263980:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775507.263983:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775507.263987:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775507.263993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612661888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775507.264002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612661504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775507.264006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775507.264009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775507.264010:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775507.264013:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11479 00000100:00080000:1.0:1775775507.264015:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775507.264017:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775507.264021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775507.264029:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612662016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775507.264069:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775507.264098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775507/real 1775775507] req@ffff8de1c2e14e00 x1862023612661504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775507.264112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612661504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775507.264119:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775507.264121:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775507.264124:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612661504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775507.264130:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775507.264144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775507.264152:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775507/real 1775775507] req@ffff8de1c2e14a80 x1862023612661632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775507.264159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612661632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775507.264164:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775507.264166:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775507.264168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775507.264172:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775507.264181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775507.264186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775507/real 1775775507] req@ffff8de1c2e17480 x1862023612661760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775507.264192:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612661760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775507.264197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775507.264199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775507.264200:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775507.264221:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775507.264231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775507.264236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775507/real 1775775507] req@ffff8de1c2e14700 x1862023612661888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775507.264244:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612661888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775507.264249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775507.264250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775507.264252:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612661888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775507.264256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775507.264266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775507.264270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775507/real 1775775507] req@ffff8de1c2e15500 x1862023612662016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775507.264277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612662016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775507.264282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775507.264284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775507.264285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775508.223890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775509.247879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775510.271890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775511.295844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775512.319846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775512.383803:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775512.383811:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775512.383816:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775512.383823:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11484 00000100:00080000:1.0:1775775512.383833:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775512.383838:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775512.383866:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612662144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775512.383890:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775512.383893:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775512.383895:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775512.383899:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11484 00000100:00080000:1.0:1775775512.383902:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775512.383905:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775512.383913:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775512.383923:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612662272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775512.383932:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612662144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775512.383933:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775512.383938:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775512.383941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775512.383945:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11484 00000100:00080000:1.0:1775775512.383948:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775512.383951:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775512.383954:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775512.383963:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612662400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775512.383971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775512.383973:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775512.383975:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775512.383977:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11484 00000100:00080000:1.0:1775775512.383980:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775512.383983:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775512.383986:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775512.383996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612662528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775512.384004:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775512.384005:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775512.384010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775512.384011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775512.384015:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11484 00000100:00080000:1.0:1775775512.384018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775512.384021:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775512.384024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775512.384031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612662656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775512.384045:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775512/real 1775775512] req@ffff8de1c2e17800 x1862023612662144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775512.384120:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612662144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775512.384131:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775512.384135:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775512.384139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612662144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775512.384162:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775512.384188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775512.384201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775512/real 1775775512] req@ffff8de1c2e17b80 x1862023612662272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775512.384306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612662272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775512.384312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775512.384315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775512.384319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775512.384383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775512.384403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775512.384412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775512/real 1775775512] req@ffff8de1c2e16680 x1862023612662400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775512.384421:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612662400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775512.384426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775512.384428:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775512.384431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775512.384434:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775512.384446:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775512.384451:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775512/real 1775775512] req@ffff8de1c2e14380 x1862023612662528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775512.384471:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612662528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775512.384491:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775512.384495:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775512.384499:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775512.384505:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775512.384527:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775512.384539:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775512/real 1775775512] req@ffff8de1c2e17100 x1862023612662656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775512.384551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612662656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775512.384557:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775512.384560:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775512.384562:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775513.343925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775514.367872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775515.391925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775516.415893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775517.439907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775517.503814:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775517.503826:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775517.503831:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775517.503842:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11489 00000100:00080000:1.0:1775775517.503855:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775517.503861:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775517.503893:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612662784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775517.503917:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775517.503920:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775517.503922:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775517.503924:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11489 00000100:00080000:1.0:1775775517.503927:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775517.503929:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775517.503937:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775517.503946:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612662912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775517.503953:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775517.503956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775517.503957:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775517.503959:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11489 00000100:00080000:1.0:1775775517.503961:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775517.503963:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775517.503966:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775517.503974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612663040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775517.503981:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775517.503983:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775517.503984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775517.503986:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11489 00000100:00080000:1.0:1775775517.503988:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775517.503992:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775517.503994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612662784:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775775517.503996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775517.504007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612663168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775517.504013:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775517.504015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775517.504016:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775517.504019:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11489 00000100:00080000:1.0:1775775517.504021:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775517.504023:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775517.504026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775517.504034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612663296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775517.504057:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775517.504086:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775517/real 1775775517] req@ffff8de1c2e16a00 x1862023612662784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775517.504100:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612662784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775517.504107:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775517.504110:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775517.504113:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612662784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775517.504118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775517.504130:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775517.504137:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775517/real 1775775517] req@ffff8de1c2e17100 x1862023612662912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775517.504145:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612662912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775517.504149:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775517.504151:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775517.504153:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612662912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775517.504157:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775517.504167:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775517.504172:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775517/real 1775775517] req@ffff8de1c2e14380 x1862023612663040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775517.504179:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612663040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775517.504184:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775517.504186:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775517.504187:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775517.504206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775517.504215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775517.504220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775517/real 1775775517] req@ffff8de1c2e16680 x1862023612663168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775517.504227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612663168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775517.504232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775517.504233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775517.504235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775517.504239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775517.504247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775517.504252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775517/real 1775775517] req@ffff8de1c2e17b80 x1862023612663296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775517.504260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612663296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775517.504264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775517.504266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775517.504268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775518.463899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775519.487970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775520.511870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775521.535918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775522.559924:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775522.623881:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775522.623890:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775522.623894:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775522.623902:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11494 00000100:00080000:2.0:1775775522.623912:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775522.623917:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775522.623951:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612663424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775522.623977:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775522.623980:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775522.623981:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775522.623984:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11494 00000100:00080000:2.0:1775775522.623986:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775522.623988:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775522.623995:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775522.624002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612663552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775522.624010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775522.624012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775522.624014:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775522.624016:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11494 00000100:00080000:2.0:1775775522.624018:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775522.624020:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775522.624023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775522.624031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612663680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775522.624039:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612663424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775522.624040:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775522.624045:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775522.624046:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775522.624053:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11494 00000100:00080000:2.0:1775775522.624055:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775522.624058:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775522.624061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775522.624069:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612663808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775522.624074:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775522.624077:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775522.624078:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775522.624080:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11494 00000100:00080000:2.0:1775775522.624082:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775522.624084:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775522.624087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775522.624093:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612663936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775522.624119:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775522.624154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775522/real 1775775522] req@ffff8de1d0f2e680 x1862023612663424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775522.624169:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612663424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775522.624177:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775522.624180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775522.624183:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612663424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775522.624188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775522.624211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775522.624224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775522/real 1775775522] req@ffff8de1d0f2e300 x1862023612663552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775522.624253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612663552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775522.624271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775522.624276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775522.624280:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775522.624321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775522.624341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775522.624367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775522/real 1775775522] req@ffff8de1d0f2ca80 x1862023612663680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775522.624375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612663680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775522.624380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775522.624382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775522.624384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775522.624388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775522.624400:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775522.624406:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775522/real 1775775522] req@ffff8de1d0f2d500 x1862023612663808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775522.624413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612663808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775522.624417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775522.624419:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775522.624422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775522.624425:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775522.624438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775522.624447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775522/real 1775775522] req@ffff8de1d0f2df80 x1862023612663936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775522.624460:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612663936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775522.624467:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775522.624471:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775522.624474:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612663936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775523.583968:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775524.607914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775525.631919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775526.655880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775527.679859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775527.743866:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775527.743880:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775527.743885:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775527.743893:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11499 00000100:00080000:1.0:1775775527.743904:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775527.743909:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775527.743943:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612664064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775527.743967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775527.743970:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775527.743971:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775527.743977:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11499 00000100:00080000:1.0:1775775527.743979:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775527.743982:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775527.743990:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775527.744003:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612664192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775527.744010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775527.744012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775527.744013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775527.744015:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11499 00000100:00080000:1.0:1775775527.744017:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775527.744020:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775527.744024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775527.744031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612664320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775527.744032:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612664064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775527.744050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775527.744052:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775527.744053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775527.744056:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11499 00000100:00080000:1.0:1775775527.744058:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775527.744060:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775527.744064:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775527.744072:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612664448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775527.744078:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775527.744080:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775527.744082:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775527.744084:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11499 00000100:00080000:1.0:1775775527.744088:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775527.744090:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775527.744093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775527.744099:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775527.744102:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612664576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775527.744137:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775527/real 1775775527] req@ffff8de1c2e17800 x1862023612664064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775527.744151:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612664064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775527.744159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775527.744162:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775527.744165:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612664064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775527.744170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775527.744185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775527.744193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775527/real 1775775527] req@ffff8de1c2e15500 x1862023612664192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775527.744201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612664192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775527.744206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775527.744208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775527.744209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775527.744245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775527.744259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775527.744266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775527/real 1775775527] req@ffff8de1c2e14700 x1862023612664320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775527.744274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612664320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775527.744279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775527.744281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775527.744283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775527.744287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775527.744296:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775527.744301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775527/real 1775775527] req@ffff8de1c2e17480 x1862023612664448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775527.744308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612664448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775527.744314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775527.744316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775527.744317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775527.744321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775527.744329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775527.744334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775527/real 1775775527] req@ffff8de1c2e14a80 x1862023612664576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775527.744340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612664576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775527.744345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775527.744346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775527.744348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775528.703875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775529.727927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775530.751855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775531.775880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775532.799919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775532.863887:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775532.863909:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775532.863914:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775532.863925:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11504 00000100:00080000:2.0:1775775532.863937:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775532.863944:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775532.863980:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612664704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775532.864010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775532.864015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775532.864017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775532.864021:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11504 00000100:00080000:2.0:1775775532.864024:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775532.864028:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775532.864038:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775532.864054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612664832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775532.864065:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775532.864069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775532.864071:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775532.864076:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11504 00000100:00080000:2.0:1775775532.864080:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775532.864088:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775532.864091:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612664704:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775532.864095:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775532.864137:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612664960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775532.864150:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775532.864155:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775532.864157:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775532.864161:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11504 00000100:00080000:2.0:1775775532.864168:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775532.864175:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775532.864181:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775532.864195:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612665088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775532.864206:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775532.864211:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775532.864214:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775532.864221:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11504 00000100:00080000:2.0:1775775532.864228:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775532.864235:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775532.864244:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775532.864247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775532.864269:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612665216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775532.864302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775532.864322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775532.864349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775533.823887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775534.847860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775535.871851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775535.936016:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775535.936060:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775535.936096:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775535.936154:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775535.936164:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775535.936172:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775535.936180:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775775535.936281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775532/real 1775775535] req@ffff8de1d0f2df80 x1862023612664960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775535.936317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612664960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775535.936328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775535.936332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775535.936337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775535.936344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775532/real 1775775535] req@ffff8de1d0f2d500 x1862023612665088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775535.936358:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612665088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775535.936365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775535.936369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775535.936372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775535.936379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775532/real 1775775535] req@ffff8de1d0f2ca80 x1862023612665216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775535.936390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612665216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775535.936397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775535.936400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775535.936402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665216:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775535.936409:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775532/real 1775775535] req@ffff8de1d0f2f100 x1862023612664704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775535.936429:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612664704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775535.936437:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775535.936442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775535.936445:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612664704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775535.936452:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775532/real 1775775535] req@ffff8de1d0f2c700 x1862023612664832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775535.936465:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612664832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775535.936473:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775535.936476:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775535.936479:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612664832:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775775536.895849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775537.919844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775537.983857:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775537.983869:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775537.983874:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775537.983884:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11509 00000100:00080000:0.0:1775775537.983897:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775537.983903:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775537.983939:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612665344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775537.983971:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775537.983976:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775537.983978:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775537.983982:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11509 00000100:00080000:0.0:1775775537.983986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775537.983990:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775537.984000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775537.984016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612665472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775537.984029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775775537.984030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612665344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775537.984045:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775537.984049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775537.984056:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11509 00000100:00080000:0.0:1775775537.984061:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775537.984065:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775537.984072:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775537.984087:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612665600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775537.984105:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775537.984108:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775537.984110:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775537.984117:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11509 00000800:00000100:3.0:1775775537.984117:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775537.984125:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775537.984130:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775537.984136:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775537.984151:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612665728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775537.984161:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775537.984164:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775537.984166:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775537.984172:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11509 00000100:00100000:3.0:1775775537.984173:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775537/real 1775775537] req@ffff8de1c5683b80 x1862023612665344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775537.984179:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775537.984184:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775537.984189:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775537.984205:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612665856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775537.984213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612665344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775537.984229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775537.984234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775537.984239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612665344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775537.984266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775537.984290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775537.984304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775537/real 1775775537] req@ffff8de1c5682300 x1862023612665472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775537.984317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612665472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775537.984326:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775537.984330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775537.984334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775537.984340:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775537.984361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775537.984378:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775537/real 1775775537] req@ffff8de1c5680700 x1862023612665600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775537.984391:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612665600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775537.984399:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775537.984403:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775537.984406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775537.984412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775537.984433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775537.984443:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775537/real 1775775537] req@ffff8de1c5682d80 x1862023612665728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775537.984455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612665728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775537.984463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775537.984466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775537.984470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775537.984476:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775537.984493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775537.984503:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775537/real 1775775537] req@ffff8de1c5682680 x1862023612665856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775537.984516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612665856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775537.984524:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775537.984528:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775537.984531:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612665856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775538.943863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775539.967861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775540.991906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775542.015906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775543.039876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775543.103796:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775543.103808:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775543.103812:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775543.103822:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11514 00000100:00080000:0.0:1775775543.103834:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775543.103841:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775543.103887:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612665984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775543.103912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775543.103916:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775543.103918:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775543.103922:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11514 00000100:00080000:0.0:1775775543.103926:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775543.103930:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775543.103940:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775543.103973:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612665984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775543.103974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612666112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775543.103985:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775543.103988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775543.103990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775543.103994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11514 00000100:00080000:0.0:1775775543.103997:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775543.104001:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775543.104005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775543.104015:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612666240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775543.104023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775543.104025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775543.104027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775543.104030:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11514 00000100:00080000:0.0:1775775543.104033:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775775543.104034:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775543.104037:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775543.104041:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775543.104049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612666368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775543.104057:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775543.104061:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775543.104062:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775543.104065:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11514 00000100:00100000:3.0:1775775543.104067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775543/real 1775775543] req@ffff8de1c5682680 x1862023612665984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775543.104068:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775543.104072:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775543.104076:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775543.104084:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612666496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775543.104085:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612665984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775543.104103:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775543.104107:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775543.104111:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612665984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775543.104135:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775543.104159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775543.104175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775543/real 1775775543] req@ffff8de1c5682d80 x1862023612666112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775543.104185:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612666112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775543.104193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775543.104196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775543.104198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775543.104204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775543.104219:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775543.104225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775543/real 1775775543] req@ffff8de1c5680700 x1862023612666240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775543.104232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612666240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775543.104237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775543.104239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775543.104241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775543.104245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775543.104256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775543.104261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775543/real 1775775543] req@ffff8de1c5682300 x1862023612666368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775543.104268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612666368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775543.104273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775543.104275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775543.104277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775543.104280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775543.104289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775543.104293:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775543/real 1775775543] req@ffff8de1c5683b80 x1862023612666496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775543.104300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612666496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775543.104307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775543.104310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775543.104314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775544.063865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775545.087853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775546.111856:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775547.135999:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775548.159844:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775548.223843:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775548.223880:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775548.223885:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775548.223894:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11519 00000100:00080000:3.0:1775775548.223904:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775548.223910:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775548.223951:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612666624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775548.223986:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775548.223990:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775548.223991:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775548.223995:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11519 00000100:00080000:3.0:1775775548.223997:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775548.224000:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775548.224010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775548.224019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612666752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775548.224027:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775548.224030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775548.224031:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775548.224034:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11519 00000100:00080000:3.0:1775775548.224038:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775548.224041:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775548.224045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775548.224050:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612666624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775548.224063:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612666880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775548.224080:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775548.224084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775548.224086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775548.224093:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11519 00000100:00080000:3.0:1775775548.224106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775548.224111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775548.224115:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775548.224121:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775548.224127:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612667008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775548.224136:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775548.224140:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775548.224144:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775548.224150:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11519 00000100:00080000:3.0:1775775548.224154:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775548.224158:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775548.224163:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775548.224168:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775548/real 1775775548] req@ffff8de1c7af5c00 x1862023612666624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775548.224178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612667136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775548.224187:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612666624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775548.224199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775548.224204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775548.224208:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612666624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775548.224215:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775548.224233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775548.224250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775548/real 1775775548] req@ffff8de1c7af7b80 x1862023612666752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775548.224263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612666752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775548.224284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775548.224292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775548.224298:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775548.224341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775548.224356:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775548.224372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775548/real 1775775548] req@ffff8de1c7af7480 x1862023612666880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775548.224380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612666880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775548.224385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775548.224387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775548.224393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612666880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775548.224403:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775548.224427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775548.224449:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775548/real 1775775548] req@ffff8de1c7af4000 x1862023612667008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775548.224463:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612667008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775548.224467:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775548.224469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775548.224471:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775548.224475:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775548.224486:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775548.224491:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775548/real 1775775548] req@ffff8de1c7af4700 x1862023612667136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775548.224499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612667136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775548.224504:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775548.224505:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775548.224507:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775549.183935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775550.207908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775551.231990:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775552.255926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775553.279917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775553.343887:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775553.343897:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775553.343902:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775553.343913:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11525 00000100:00080000:2.0:1775775553.343926:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775553.343933:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775553.343979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612667264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775553.344012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775553.344015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775553.344016:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775553.344020:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11525 00000100:00080000:2.0:1775775553.344022:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775553.344025:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775553.344037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775553.344051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612667392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775553.344064:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612667264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775553.344068:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775553.344078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775553.344080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775553.344086:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11525 00000100:00080000:2.0:1775775553.344092:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775553.344097:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775553.344103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775553.344121:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612667520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775553.344132:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775553.344136:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775553.344140:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775775553.344141:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775553.344149:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11525 00000100:00080000:2.0:1775775553.344156:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775553.344162:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775553.344170:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775553.344179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775553/real 1775775553] req@ffff8de1d0f2e300 x1862023612667264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775553.344185:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612667648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775553.344245:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775553.344261:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775553.344264:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775553.344269:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11525 00000100:00080000:2.0:1775775553.344272:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775775553.344273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612667264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775553.344279:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775553.344291:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775775553.344296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775775553.344302:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612667776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775553.344306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775553.344322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612667264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775553.344360:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775553.344381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775553.344389:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775553/real 1775775553] req@ffff8de1d0f2e680 x1862023612667392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775553.344397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612667392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775553.344403:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775553.344406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775553.344408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775553.344412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775553.344423:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775553.344430:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775553/real 1775775553] req@ffff8de1d0f2c700 x1862023612667520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775553.344442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612667520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775553.344457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775553.344461:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775553.344465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775553.344471:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775553.344493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775553.344503:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775553/real 1775775553] req@ffff8de1d0f2f100 x1862023612667648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775553.344511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612667648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775553.344517:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775553.344519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775553.344521:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775553.344526:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775553.344538:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775553.344544:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775553/real 1775775553] req@ffff8de1d0f2ca80 x1862023612667776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775553.344551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612667776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775553.344555:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775553.344557:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775553.344560:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612667776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775554.303910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775555.327889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775556.351908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775557.375851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775558.399937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775558.463797:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775558.463805:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775558.463809:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775558.463817:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11530 00000100:00080000:2.0:1775775558.463828:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775558.463833:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775558.463871:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612667904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775558.463912:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775558.463916:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775558.463918:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775558.463921:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11530 00000100:00080000:2.0:1775775558.463925:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775558.463928:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775558.463942:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775558.463949:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612667904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775558.463955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612668032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775558.463964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775558.463967:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775558.463968:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775558.463971:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11530 00000100:00080000:2.0:1775775558.463973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775558.463976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775558.463979:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775558.463989:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612668160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775558.463995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775558.463998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775558.463999:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775558.464002:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11530 00000100:00080000:2.0:1775775558.464005:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775558.464007:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775558.464011:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775558.464017:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775558.464021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612668288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775558.464028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775558.464031:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775558.464033:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775558.464035:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11530 00000100:00080000:2.0:1775775558.464038:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775558.464040:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775558.464042:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775558.464049:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612668416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775558.464059:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775558/real 1775775558] req@ffff8de1d0f2d500 x1862023612667904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775558.464079:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612667904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775558.464089:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775558.464093:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775558.464097:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612667904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775558.464120:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775558.464142:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775558.464154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775558/real 1775775558] req@ffff8de1d0f2df80 x1862023612668032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775558.464166:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612668032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775558.464175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775558.464178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775558.464182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775558.464188:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775558.464205:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775558.464215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775558/real 1775775558] req@ffff8de1d0f2ca80 x1862023612668160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775558.464237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612668160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775558.464246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775558.464249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775558.464253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775558.464259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775558.464278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775558.464289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775558/real 1775775558] req@ffff8de1d0f2f100 x1862023612668288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775558.464300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612668288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775558.464308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775558.464312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775558.464315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775558.464321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775558.464337:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775558.464346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775558/real 1775775558] req@ffff8de1d0f2c700 x1862023612668416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775558.464359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612668416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775558.464368:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775558.464371:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775558.464375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775559.423857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775560.447946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775561.471900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775562.495939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775563.519915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775563.583812:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775563.583821:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775563.583826:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775563.583835:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11535 00000100:00080000:2.0:1775775563.583848:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775563.583856:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775563.583894:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612668544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775563.583924:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775563.583927:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775563.583928:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775563.583931:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11535 00000100:00080000:2.0:1775775563.583935:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775563.583938:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775563.583946:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775563.583955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612668672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775563.583962:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775563.583965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775563.583966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775563.583968:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11535 00000100:00080000:2.0:1775775563.583971:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775563.583974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775563.583977:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775563.583985:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612668800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775563.583993:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612668544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775563.583995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775563.584002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775563.584004:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775563.584008:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11535 00000100:00080000:2.0:1775775563.584009:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775563.584012:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775563.584015:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775563.584023:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612668928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775563.584034:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775563.584036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775563.584037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775563.584039:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11535 00000100:00080000:2.0:1775775563.584043:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775563.584045:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775563.584048:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775563.584057:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612669056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775563.584057:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775563.584098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775563/real 1775775563] req@ffff8de1d0f2e680 x1862023612668544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775563.584118:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612668544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775563.584129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775563.584132:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775563.584135:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612668544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775563.584141:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775563.584160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775563.584169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775563/real 1775775563] req@ffff8de1d0f2e300 x1862023612668672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775563.584177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612668672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775563.584183:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775563.584185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775563.584187:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775563.584205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775563.584216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775563.584221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775563/real 1775775563] req@ffff8de1d0f2c700 x1862023612668800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775563.584229:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612668800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775563.584234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775563.584235:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775563.584237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775563.584241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775563.584251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775563.584256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775563/real 1775775563] req@ffff8de1d0f2f100 x1862023612668928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775563.584263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612668928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775563.584268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775563.584269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775563.584271:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612668928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775563.584274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775563.584283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775563.584288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775563/real 1775775563] req@ffff8de1d0f2ca80 x1862023612669056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775563.584295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612669056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775563.584300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775563.584302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775563.584304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775564.543881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775565.567869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775566.591857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775567.615904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775568.639924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775568.703826:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775568.703833:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775568.703838:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775568.703846:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11540 00000100:00080000:2.0:1775775568.703857:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775568.703863:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775568.703896:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612669184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775568.703920:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775568.703923:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775568.703924:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775568.703927:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11540 00000100:00080000:2.0:1775775568.703929:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775568.703931:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775568.703940:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775568.703947:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612669312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775568.703954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775568.703956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775568.703958:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775568.703961:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11540 00000100:00080000:2.0:1775775568.703963:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775568.703966:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775568.703970:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775568.703978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612669440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775568.703985:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775568.703987:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775568.703989:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775568.703991:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11540 00000100:00080000:2.0:1775775568.703994:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775568.704001:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775568.704002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612669184:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775568.704005:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775568.704024:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612669568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775568.704031:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775568.704034:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775568.704036:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775568.704040:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11540 00000100:00080000:2.0:1775775568.704043:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775568.704045:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775568.704048:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775568.704061:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612669696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775568.704102:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775568.704142:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775568/real 1775775568] req@ffff8de1d0f2df80 x1862023612669184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775568.704159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612669184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775568.704168:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775568.704172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775568.704175:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612669184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775568.704180:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775568.704194:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775568.704202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775568/real 1775775568] req@ffff8de1d0f2d500 x1862023612669312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775568.704209:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612669312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775568.704219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775568.704222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775568.704224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775568.704247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775568.704257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775568.704262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775568/real 1775775568] req@ffff8de1d0f2ca80 x1862023612669440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775568.704269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612669440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775568.704275:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775568.704276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775568.704278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775568.704282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775568.704293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775568.704298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775568/real 1775775568] req@ffff8de1d0f2f100 x1862023612669568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775568.704306:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612669568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775568.704310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775568.704312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775568.704315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775568.704319:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775568.704329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775568.704334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775568/real 1775775568] req@ffff8de1d0f2c700 x1862023612669696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775568.704341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612669696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775568.704346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775568.704348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775568.704350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775569.663904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775570.687927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775571.711877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775572.735870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775573.759899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775573.823805:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775573.823816:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775573.823821:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775573.823831:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11545 00000100:00080000:2.0:1775775573.823843:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775573.823851:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775573.823888:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612669824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775573.823913:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775573.823916:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775573.823917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775573.823920:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11545 00000100:00080000:2.0:1775775573.823923:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775573.823926:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775573.823934:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775573.823943:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612669952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775573.823954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775573.823956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775573.823958:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775573.823960:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11545 00000100:00080000:2.0:1775775573.823962:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775573.823965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775573.823968:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775573.823975:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612670080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775573.823982:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775573.823985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775573.823987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775775573.823988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612669824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775573.823991:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11545 00000100:00080000:2.0:1775775573.823994:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775573.823999:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775573.824003:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775573.824010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612670208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775573.824016:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775573.824019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775573.824020:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775573.824022:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11545 00000100:00080000:2.0:1775775573.824025:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775573.824027:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775573.824031:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775573.824037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612670336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775573.824066:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775573.824108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775573/real 1775775573] req@ffff8de1d0f2e300 x1862023612669824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775573.824122:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612669824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775573.824130:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775573.824133:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775573.824136:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612669824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775573.824141:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775573.824158:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775573.824166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775573/real 1775775573] req@ffff8de1d0f2e680 x1862023612669952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775573.824173:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612669952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775573.824178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775573.824180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775573.824182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612669952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775573.824200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775573.824211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775573.824216:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775573/real 1775775573] req@ffff8de1d0f2c700 x1862023612670080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775573.824223:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612670080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775573.824228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775573.824230:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775573.824231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775573.824235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775573.824245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775573.824250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775573/real 1775775573] req@ffff8de1d0f2f100 x1862023612670208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775573.824257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612670208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775573.824262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775573.824264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775573.824266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775573.824269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775573.824278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775573.824283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775573/real 1775775573] req@ffff8de1d0f2ca80 x1862023612670336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775573.824289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612670336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775573.824293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775573.824295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775573.824297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775574.783970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775575.807914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775576.831899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775577.855923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775578.879905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775578.943851:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775578.943859:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775578.943864:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775578.943872:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11550 00000100:00080000:1.0:1775775578.943881:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775578.943887:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775578.943920:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612670464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775578.943944:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775578.943947:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775578.943948:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775578.943951:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11550 00000100:00080000:1.0:1775775578.943952:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775578.943955:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775578.943962:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775578.943971:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612670592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775578.943978:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775578.943981:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775578.943982:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775578.943985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11550 00000100:00080000:1.0:1775775578.943987:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775578.943992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775578.943995:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612670464:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775775578.943996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775578.944004:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612670720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775578.944010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775578.944013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775578.944014:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775578.944016:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11550 00000100:00080000:1.0:1775775578.944019:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775578.944021:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775578.944024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775578.944030:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612670848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775578.944036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775578.944038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775578.944040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775578.944042:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11550 00000100:00080000:1.0:1775775578.944045:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775578.944047:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775578.944050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775578.944056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612670976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775578.944071:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775578.944108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775578/real 1775775578] req@ffff8de1c2e14e00 x1862023612670464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775578.944125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612670464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775578.944134:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775578.944138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775578.944142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612670464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775578.944150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775578.944173:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775578.944183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775578/real 1775775578] req@ffff8de1c2e14a80 x1862023612670592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775578.944195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612670592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775578.944203:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775578.944206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775578.944209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775578.944232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775578.944249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775578.944258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775578/real 1775775578] req@ffff8de1c2e17480 x1862023612670720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775578.944270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612670720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775578.944278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775578.944281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775578.944283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775578.944288:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775578.944304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775578.944312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775578/real 1775775578] req@ffff8de1c2e14700 x1862023612670848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775578.944338:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612670848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775578.944345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775578.944348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775578.944351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775578.944356:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775578.944375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775578.944386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775578/real 1775775578] req@ffff8de1c2e15500 x1862023612670976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775578.944396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612670976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775578.944403:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775578.944406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775578.944409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612670976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775579.903894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775580.927962:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775581.951915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775582.975920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775583.999920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775584.063853:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775584.063866:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775584.063872:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775584.063883:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11555 00000100:00080000:1.0:1775775584.063895:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775584.063903:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775584.063942:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612671104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775584.063976:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775584.063982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775584.063984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775584.063991:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11555 00000100:00080000:1.0:1775775584.063996:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775584.064001:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775584.064013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775584.064029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612671104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775584.064031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612671232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775584.064049:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775584.064054:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775584.064056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775584.064063:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11555 00000100:00080000:1.0:1775775584.064069:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775584.064086:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775584.064093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775584.064107:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612671360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775584.064119:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775584.064123:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775584.064126:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775775584.064131:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775584.064136:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11555 00000100:00080000:1.0:1775775584.064143:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775584.064147:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775584.064153:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775584.064168:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612671488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775584.064172:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775584/real 1775775584] req@ffff8de1c2e17800 x1862023612671104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775584.064188:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775584.064194:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775584.064196:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775584.064201:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11555 00000100:00100000:2.0:1775775584.064206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612671104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775584.064208:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775584.064217:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775584.064226:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775584.064228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775584.064249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775584.064263:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612671104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775584.064269:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612671616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775584.064290:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775584.064313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775584.064323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775584/real 1775775584] req@ffff8de1c2e17b80 x1862023612671232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775584.064332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612671232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775584.064337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775584.064340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775584.064342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775584.064346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775584.064362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775584.064373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775584/real 1775775584] req@ffff8de1c2e16680 x1862023612671360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775584.064388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612671360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775584.064397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775584.064401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775584.064405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775584.064413:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775584.064434:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775584.064447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775584/real 1775775584] req@ffff8de1c2e14380 x1862023612671488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775584.064466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612671488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775584.064474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775584.064478:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775584.064483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775584.064492:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775584.064512:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775584.064522:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775584/real 1775775584] req@ffff8de1c2e17100 x1862023612671616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775584.064530:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612671616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775584.064535:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775584.064538:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775584.064539:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775585.023933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775586.047998:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775587.071886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775588.095901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775589.119913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775589.183855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775589.183865:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775589.183869:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775589.183881:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11560 00000100:00080000:2.0:1775775589.183894:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775589.183901:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775589.183950:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612671744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775589.183978:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775589.183982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775589.183983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775589.183987:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11560 00000100:00080000:2.0:1775775589.183989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775589.183991:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775589.184003:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775589.184012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612671872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775589.184022:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775589.184025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775589.184028:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775775589.184029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612671744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775589.184033:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11560 00000100:00080000:2.0:1775775589.184038:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775589.184040:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775589.184043:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775589.184053:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612672000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775589.184060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775589.184063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775589.184064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775589.184066:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11560 00000100:00080000:2.0:1775775589.184068:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775589.184071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775589.184074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775589.184081:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612672128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775589.184087:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775589.184089:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775589.184091:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775589.184093:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11560 00000100:00080000:2.0:1775775589.184097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775589.184100:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775589.184104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775589.184112:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612672256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775775589.184116:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775589.184195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775589/real 1775775589] req@ffff8de1d0f2d500 x1862023612671744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775589.184212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612671744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775589.184226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775589.184230:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775589.184234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612671744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775589.184257:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775589.184277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775589.184286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775589/real 1775775589] req@ffff8de1d0f2df80 x1862023612671872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775589.184294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612671872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775589.184309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775589.184312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775589.184314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612671872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775589.184317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775589.184328:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775589.184333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775589/real 1775775589] req@ffff8de1d0f2ca80 x1862023612672000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775589.184340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612672000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775589.184346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775589.184347:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775589.184349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775589.184353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775589.184364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775589.184369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775589/real 1775775589] req@ffff8de1d0f2f100 x1862023612672128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775589.184376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612672128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775589.184382:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775589.184383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775589.184385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775589.184388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775589.184398:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775589.184403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775589/real 1775775589] req@ffff8de1d0f2c700 x1862023612672256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775589.184409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612672256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775589.184413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775589.184415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775589.184417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775590.143920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775591.167892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775592.191905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775593.215980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775594.239901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775594.303869:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775594.303878:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775594.303883:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775594.303891:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11566 00000100:00080000:1.0:1775775594.303901:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775594.303907:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775594.303940:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612672384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775594.303964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775594.303967:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775594.303968:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775594.303971:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11566 00000100:00080000:1.0:1775775594.303973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775594.303976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775594.303984:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775594.303993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612672512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775594.304000:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775594.304002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775594.304003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775594.304005:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11566 00000100:00080000:1.0:1775775594.304007:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775594.304009:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775594.304011:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775594.304017:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612672640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775594.304027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775594.304030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775594.304031:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775594.304034:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11566 00000100:00080000:1.0:1775775594.304036:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775594.304038:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775594.304041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775594.304065:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612672384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775594.304083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612672768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775594.304095:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775594.304105:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775594.304107:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775594.304114:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11566 00000100:00080000:1.0:1775775594.304120:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775594.304125:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775594.304131:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775775594.304136:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775594.304146:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612672896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775775594.304175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775594/real 1775775594] req@ffff8de1c2e16a00 x1862023612672384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775594.304196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612672384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775594.304208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775594.304213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775594.304217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612672384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775594.304225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775594.304248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775594.304257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775594/real 1775775594] req@ffff8de1c2e17100 x1862023612672512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775594.304266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612672512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775594.304271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775594.304273:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775594.304275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775594.304279:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775775594.304290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775594.304296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775594/real 1775775594] req@ffff8de1c2e14380 x1862023612672640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775594.304303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612672640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775594.304312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775594.304314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775594.304316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775594.304335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775594.304354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775594.304361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775594/real 1775775594] req@ffff8de1c2e16680 x1862023612672768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775594.304368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612672768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775594.304374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775594.304376:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775594.304378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775775594.304381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775775594.304392:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775594.304397:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775594/real 1775775594] req@ffff8de1c2e17b80 x1862023612672896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775594.304404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612672896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775594.304409:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775594.304411:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775594.304413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612672896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775595.263911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775596.287874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775597.311899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775598.335847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775599.359994:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775599.423840:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775599.423850:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775599.423856:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775599.423866:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11571 00000100:00080000:3.0:1775775599.423879:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775599.423885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775599.423924:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612673024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775599.423957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775599.423974:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775599.423975:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775599.423980:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11571 00000100:00080000:3.0:1775775599.423985:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775599.423989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775599.423999:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775599.424014:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612673152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775599.424021:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612673024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775599.424035:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775599.424039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775599.424041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775599.424046:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11571 00000100:00080000:3.0:1775775599.424051:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775599.424056:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775599.424063:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775599.424076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612673280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775599.424087:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775599.424122:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775599.424154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673280:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775775599.424287:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775599.424290:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775599.424295:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11571 00000100:00080000:3.0:1775775599.424301:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775599.424305:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775599.424313:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775599.425788:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612673408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775599.425817:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775599.425821:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775599.425823:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775599.425828:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11571 00000100:00080000:3.0:1775775599.425836:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775599.425842:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775599.425851:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775599.425865:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612673536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775599.425885:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775599.425957:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775600.383934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775601.407887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775602.431840:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775775602.495961:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775775602.496000:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775775602.496014:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775602.496049:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775602.496059:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775602.496067:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775775602.496075:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775775602.496255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775599/real 1775775602] req@ffff8de1c7af4000 x1862023612673536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775602.496285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612673536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775602.496297:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775602.496304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775602.496308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673536:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775602.496316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775599/real 1775775602] req@ffff8de1c7af4700 x1862023612673408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775602.496329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612673408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775602.496337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775602.496342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775602.496345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775602.496351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775599/real 1775775602] req@ffff8de1c7af6a00 x1862023612673152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775602.496363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612673152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775602.496370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775602.496374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775602.496377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775602.496383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775599/real 1775775602] req@ffff8de1c7af6300 x1862023612673280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775602.496393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612673280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775602.496399:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775602.496403:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775602.496406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775602.496413:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775599/real 1775775602] req@ffff8de1c7af6680 x1862023612673024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775602.496426:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612673024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775602.496433:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775602.496437:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775602.496440:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612673024:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775775603.455843:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775604.479889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775604.543947:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775604.543956:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775604.543960:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775604.543969:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11576 00000100:00080000:3.0:1775775604.543982:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775604.543989:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775604.544028:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612673664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775604.544063:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775604.544067:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775604.544069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775604.544073:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11576 00000100:00080000:3.0:1775775604.544077:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775604.544081:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775604.544091:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775604.544116:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612673792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775604.544130:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612673664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775604.544131:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775604.544141:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775604.544143:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775604.544148:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11576 00000100:00080000:3.0:1775775604.544152:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775604.544157:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775604.544163:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775604.544178:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612673920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775604.544190:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775604.544194:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775604.544196:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775775604.544203:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775604.544203:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11576 00000100:00080000:3.0:1775775604.544210:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775604.544215:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775604.544221:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775604.544243:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612674048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775604.544247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775604/real 1775775604] req@ffff8de1c7af7480 x1862023612673664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775604.544268:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775604.544273:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775604.544275:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775604.544281:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11576 00000100:00080000:3.0:1775775604.544286:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775604.544287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612673664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775604.544295:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775604.544306:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775604.544309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775604.544316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775604.544324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612673664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775604.544324:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612674176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775604.544356:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775604.544383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775604.544396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775604/real 1775775604] req@ffff8de1c7af7b80 x1862023612673792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775604.544409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612673792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775604.544416:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775604.544420:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775604.544424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775604.544430:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775604.544452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775604.544462:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775604/real 1775775604] req@ffff8de1c7af5c00 x1862023612673920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775604.544475:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612673920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775604.544482:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775604.544485:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775604.544488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612673920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775604.544495:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775604.544514:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775604.544524:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775604/real 1775775604] req@ffff8de1c7af6d80 x1862023612674048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775604.544536:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612674048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775604.544543:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775604.544546:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775604.544549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775604.544555:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775604.544575:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775604.544586:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775604/real 1775775604] req@ffff8de1c7af4e00 x1862023612674176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775604.544600:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612674176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775604.544610:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775604.544615:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775604.544620:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775605.503873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775606.527881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775607.551980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775608.575936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775609.599996:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775609.663895:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775609.663912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775609.663919:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775609.663934:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11581 00000100:00080000:3.0:1775775609.663953:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775609.663964:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775609.664015:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612674304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775609.664054:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775609.664059:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775609.664061:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775609.664066:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11581 00000100:00080000:3.0:1775775609.664071:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775609.664075:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775609.664087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775609.664103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612674432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775609.664115:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775609.664120:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775609.664122:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775609.664126:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11581 00000100:00080000:3.0:1775775609.664131:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775609.664135:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775609.664141:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775609.664152:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612674560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775609.664164:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775609.664170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612674304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775609.664170:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775609.664174:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775609.664186:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11581 00000100:00080000:3.0:1775775609.664190:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775609.664193:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775609.664199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775609.664214:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612674688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775609.664225:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775609.664228:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775609.664231:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775609.664235:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11581 00000100:00080000:3.0:1775775609.664250:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775609.664254:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775609.664261:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775609.664267:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775609.664282:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612674816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775609.664320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775609/real 1775775609] req@ffff8de1c7af5500 x1862023612674304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775609.664344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612674304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775609.664357:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775609.664363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775609.664368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612674304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775609.664375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775609.664410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775609.664430:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775609/real 1775775609] req@ffff8de1c7af5880 x1862023612674432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775609.664452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612674432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775609.664480:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775609.664486:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775609.664493:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775609.664530:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775609.664558:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775609.664571:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775609/real 1775775609] req@ffff8de1c7af4a80 x1862023612674560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775609.664585:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612674560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775609.664594:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775609.664598:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775609.664601:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775609.664607:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775609.664623:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775609.664632:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775609/real 1775775609] req@ffff8de1c7af5f80 x1862023612674688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775609.664645:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612674688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775609.664653:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775609.664656:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775609.664660:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775609.664666:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775609.664682:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775609.664691:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775609/real 1775775609] req@ffff8de1c7af4380 x1862023612674816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775609.664703:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612674816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775609.664711:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775609.664714:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775609.664717:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612674816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775610.623978:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775611.647862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775612.671888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775613.695924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775614.719970:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775614.783852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775614.783863:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775614.783869:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775614.783881:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11586 00000100:00080000:3.0:1775775614.783895:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775614.783904:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775614.783950:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612674944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775614.783988:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775614.783994:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775614.783998:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775614.784006:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11586 00000100:00080000:3.0:1775775614.784013:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775614.784020:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775614.784035:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775614.784064:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612675072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775614.784082:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612674944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775614.784098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775614.784107:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775614.784111:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775614.784128:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11586 00000100:00080000:3.0:1775775614.784135:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775614.784141:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775614.784150:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775614.784170:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612675200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775614.784189:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775775614.784190:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775614.784201:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775614.784206:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775614.784216:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11586 00000100:00080000:3.0:1775775614.784227:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775614.784236:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775614.784247:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775614.784265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775614/real 1775775614] req@ffff8de1c7af7100 x1862023612674944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775614.784276:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612675328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775614.784324:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775614.784325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612674944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775614.784344:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775614.784355:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775614.784358:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775614.784375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775775614.784376:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11586 00000100:00100000:2.0:1775775614.784383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612674944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775614.784391:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775614.784404:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775614.784416:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775614.784420:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775614.784449:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612675456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775614.784467:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775614.784490:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775614/real 1775775614] req@ffff8de1c7af7800 x1862023612675072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775614.784509:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612675072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775614.784521:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775614.784526:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775614.784531:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775614.784538:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775614.784558:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775614.784568:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775614/real 1775775614] req@ffff8de1c7af5180 x1862023612675200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775614.784582:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612675200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775614.784591:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775614.784595:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775614.784598:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775614.784605:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775614.784622:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775614.784632:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775614/real 1775775614] req@ffff8de1c7af4380 x1862023612675328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775614.784645:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612675328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775614.784655:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775614.784659:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775614.784663:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775614.784680:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775614.784824:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775614.784841:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775614/real 1775775614] req@ffff8de1c7af5f80 x1862023612675456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775614.784862:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612675456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775614.784873:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775614.784880:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775614.784886:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775615.743932:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775616.767886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775617.791889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775618.815955:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775619.839949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775619.903825:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775619.903835:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775619.903841:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775619.903852:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11591 00000100:00080000:3.0:1775775619.903864:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775619.903872:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775619.903912:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612675584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775619.903954:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775619.903959:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775619.903962:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775619.903968:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11591 00000100:00080000:3.0:1775775619.903973:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775619.903976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775619.903987:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775619.904004:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612675712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775619.904016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775619.904020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775619.904022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775619.904025:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11591 00000100:00080000:3.0:1775775619.904028:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775619.904031:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775619.904036:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775619.904043:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612675584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775619.904056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612675840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775619.904071:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775619.904076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775619.904090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775619.904097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11591 00000100:00080000:3.0:1775775619.904102:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775619.904107:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775619.904113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775619.904125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612675968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775619.904135:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775619.904139:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775619.904144:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775775619.904148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775619.904153:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11591 00000100:00080000:3.0:1775775619.904159:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775619.904163:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775619.904168:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775619.904182:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612676096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775619.904236:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775619/real 1775775619] req@ffff8de1c7af4a80 x1862023612675584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775619.904280:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612675584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775619.904298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775619.904312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775619.904321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612675584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775619.904337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775619.904379:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775619.904402:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775619/real 1775775619] req@ffff8de1c7af5880 x1862023612675712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775619.904424:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612675712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775619.904439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775619.904447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775619.904453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775619.904497:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775619.904556:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775619.904576:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775619/real 1775775619] req@ffff8de1c7af5500 x1862023612675840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775619.904600:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612675840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775619.904669:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775619.904675:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775619.904681:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775619.904690:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775619.904720:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775619.904783:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775619/real 1775775619] req@ffff8de1c7af4e00 x1862023612675968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775619.904806:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612675968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775619.904819:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775619.904825:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775619.904829:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612675968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775619.904839:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775619.904880:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775619.904896:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775619/real 1775775619] req@ffff8de1c7af6d80 x1862023612676096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775619.904914:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612676096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775619.904926:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775619.904932:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775619.904937:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775620.863891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775621.887901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775622.911892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775623.935889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775624.959921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775625.023928:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775625.023938:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775625.023943:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775625.023954:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11596 00000100:00080000:0.0:1775775625.023968:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775625.023975:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775625.024032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612676224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775625.024059:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775625.024064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775625.024066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775625.024069:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11596 00000100:00080000:0.0:1775775625.024073:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775625.024076:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775625.024087:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775625.024097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612676352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775625.024107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775625.024109:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775625.024111:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775625.024118:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11596 00000100:00100000:1.0:1775775625.024120:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612676224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775625.024122:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775625.024131:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775625.024140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775625.024149:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612676480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775625.024158:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775625.024160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775625.024161:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775625.024165:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11596 00000100:00080000:0.0:1775775625.024168:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775625.024172:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775625.024176:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775625.024183:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612676608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775625.024189:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775625.024193:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775625.024195:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775625.024197:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11596 00000100:00080000:0.0:1775775625.024200:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775625.024202:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775625.024205:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775625.024210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775625.024215:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612676736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775625.024283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775625/real 1775775625] req@ffff8de1c5681c00 x1862023612676224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775625.024321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612676224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775625.024333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775625.024338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775625.024343:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612676224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775625.024382:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775625.024404:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775625.024414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775625/real 1775775625] req@ffff8de1c5681f80 x1862023612676352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775625.024423:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612676352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775625.024429:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775625.024431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775625.024434:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775625.024438:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775625.024449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775625.024455:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775625/real 1775775625] req@ffff8de1c5682a00 x1862023612676480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775625.024463:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612676480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775625.024468:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775625.024470:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775625.024472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775625.024476:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775625.024486:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775625.024492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775625/real 1775775625] req@ffff8de1c5680380 x1862023612676608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775625.024499:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612676608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775625.024504:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775625.024507:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775625.024509:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775625.024512:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775625.024579:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775625.024587:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775625/real 1775775625] req@ffff8de1c5680000 x1862023612676736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775625.024595:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612676736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775625.024601:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775625.024603:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775625.024605:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775625.983916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775627.008053:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775628.031846:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775629.055869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775630.079890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775630.143837:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775630.143848:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775630.143853:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775630.143863:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11601 00000100:00080000:2.0:1775775630.143875:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775630.143883:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775630.143931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612676864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775630.143960:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775630.143965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775630.143967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775630.143972:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11601 00000100:00080000:2.0:1775775630.143976:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775630.143981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775630.143991:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775630.144014:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612676992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775630.144027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775630.144030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775630.144032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775630.144037:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11601 00000100:00080000:2.0:1775775630.144042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775630.144046:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612676864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775630.144049:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775630.144057:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775630.144073:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612677120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775630.144082:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775630.144085:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775630.144086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775630.144089:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11601 00000100:00080000:2.0:1775775630.144092:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775630.144095:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775630.144099:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775630.144110:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775630.144110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612677248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775630.144119:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775630.144122:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775630.144123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775630.144126:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11601 00000100:00080000:2.0:1775775630.144128:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775630.144130:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775630.144133:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775630.144141:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612677376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775630.144147:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775630/real 1775775630] req@ffff8de1d0f2e680 x1862023612676864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775630.144164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612676864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775630.144172:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775630.144176:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775630.144179:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612676864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775630.144183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775630.144197:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775630.144204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775630/real 1775775630] req@ffff8de1d0f2e300 x1862023612676992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775630.144212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612676992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775630.144217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775630.144218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775630.144220:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612676992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775630.144238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775630.144249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775630.144255:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775630/real 1775775630] req@ffff8de1d0f2c700 x1862023612677120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775630.144262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612677120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775630.144267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775630.144268:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775630.144270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775630.144274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775630.144283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775630.144297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775630/real 1775775630] req@ffff8de1d0f2f100 x1862023612677248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775630.144305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612677248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775630.144310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775630.144312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775630.144313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775630.144317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775630.144327:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775630.144332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775630/real 1775775630] req@ffff8de1d0f2ca80 x1862023612677376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775630.144340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612677376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775630.144344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775630.144346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775630.144348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775631.103953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775632.127947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775633.151867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775634.175881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775635.199855:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775635.263814:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775635.263822:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775635.263827:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775635.263834:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11607 00000100:00080000:2.0:1775775635.263845:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775635.263851:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775635.263884:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612677504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775635.263909:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775635.263912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775635.263913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775635.263916:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11607 00000100:00080000:2.0:1775775635.263919:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775635.263921:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775635.263929:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775635.263937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612677632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775635.263945:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775635.263947:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775635.263949:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775635.263951:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11607 00000100:00080000:2.0:1775775635.263953:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775635.263956:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775635.263958:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775635.263965:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612677760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775635.263973:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775635.263974:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612677504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775635.263975:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775635.263979:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775635.263985:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11607 00000100:00080000:2.0:1775775635.263987:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775635.263989:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775635.263993:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775635.264000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612677888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775635.264010:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775635.264013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775635.264015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775635.264018:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11607 00000100:00080000:2.0:1775775635.264022:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775635.264026:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775635.264031:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775635.264042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612678016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775635.264048:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775635.264090:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775635/real 1775775635] req@ffff8de1d0f2df80 x1862023612677504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775635.264110:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612677504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775635.264120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775635.264125:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775635.264129:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612677504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775635.264136:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775635.264160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775635.264173:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775635/real 1775775635] req@ffff8de1d0f2d500 x1862023612677632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775635.264185:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612677632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775635.264199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775635.264203:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775635.264206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775635.264231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775635.264253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775635.264265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775635/real 1775775635] req@ffff8de1d0f2ca80 x1862023612677760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775635.264277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612677760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775635.264285:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775635.264288:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775635.264292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775635.264298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775635.264318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775635.264329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775635/real 1775775635] req@ffff8de1d0f2f100 x1862023612677888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775635.264378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612677888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775635.264388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775635.264391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775635.264395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612677888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775635.264402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775635.264424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775635.264436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775635/real 1775775635] req@ffff8de1d0f2c700 x1862023612678016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775635.264449:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612678016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775635.264457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775635.264460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775635.264463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775636.223855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775637.247868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775638.271862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775639.295854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775640.319969:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775640.383828:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775640.383841:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775640.383847:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775640.383858:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11612 00000100:00080000:2.0:1775775640.383872:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775640.383881:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775640.383928:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612678144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775640.383954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775640.383957:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775640.383959:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775640.383962:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11612 00000100:00080000:2.0:1775775640.383965:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775640.383968:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775640.383978:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775640.383987:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612678272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775640.383995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775640.383998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775640.383999:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775640.384002:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11612 00000100:00080000:2.0:1775775640.384004:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775640.384006:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775640.384009:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775640.384018:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612678400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775640.384025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775640.384028:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775640.384030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775640.384033:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11612 00000100:00080000:2.0:1775775640.384035:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775640.384038:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775640.384042:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775640.384047:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612678144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775640.384052:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612678528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775640.384061:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775640.384064:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775640.384066:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775640.384068:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11612 00000100:00080000:2.0:1775775640.384070:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775640.384073:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775640.384076:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775640.384085:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612678656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775640.384115:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775640.384148:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775640/real 1775775640] req@ffff8de1d0f2e300 x1862023612678144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775640.384164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612678144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775640.384173:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775640.384177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775640.384180:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612678144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775640.384186:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775640.384200:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775640.384209:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775640/real 1775775640] req@ffff8de1d0f2e680 x1862023612678272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775640.384218:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612678272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775640.384224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775640.384226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775640.384228:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775640.384232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775640.384243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775640.384279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775640/real 1775775640] req@ffff8de1d0f2c700 x1862023612678400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775640.384288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612678400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775640.384294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775640.384296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775640.384299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775640.384320:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775640.384334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775640.384341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775640/real 1775775640] req@ffff8de1d0f2f100 x1862023612678528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775640.384349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612678528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775640.384355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775640.384358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775640.384360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775640.384364:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775640.384374:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775640.384379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775640/real 1775775640] req@ffff8de1d0f2ca80 x1862023612678656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775640.384387:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612678656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775640.384393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775640.384395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775640.384397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775641.343904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775642.367920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775643.391856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775644.415863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775645.439864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775645.503820:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775645.503828:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775645.503832:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775645.503841:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11617 00000100:00080000:3.0:1775775645.503851:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775645.503857:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775645.503886:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612678784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775645.503912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775645.503915:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775645.503917:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775645.503922:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11617 00000100:00080000:3.0:1775775645.503926:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775645.503931:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775645.503941:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775645.503963:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612678784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775645.503965:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612678912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775645.503980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775645.503982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775645.503984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775645.503987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11617 00000100:00080000:3.0:1775775645.503990:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775645.503993:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775645.503997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775645.504007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612679040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775645.504015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775645.504018:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775645.504020:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775645.504024:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11617 00000800:00000100:1.0:1775775645.504028:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775645.504032:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775645.504039:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775645.504045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775645.504058:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612679168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775645.504061:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775645/real 1775775645] req@ffff8de1c7af5c00 x1862023612678784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775645.504091:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775645.504094:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612678784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775645.504094:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775645.504098:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775645.504107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11617 00000100:00080000:1.0:1775775645.504112:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775645.504113:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775645.504122:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775775645.504123:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775645.504132:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612678784:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775645.504132:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775645.504150:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612679296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775645.504179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775645.504201:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775645.504211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775645/real 1775775645] req@ffff8de1c7af7b80 x1862023612678912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775645.504220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612678912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775645.504226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775645.504228:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775645.504231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612678912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775645.504235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775645.504246:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775645.504251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775645/real 1775775645] req@ffff8de1c7af7480 x1862023612679040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775645.504258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612679040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775645.504263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775645.504265:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775645.504267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775645.504272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775645.504289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775645.504300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775645/real 1775775645] req@ffff8de1c7af6680 x1862023612679168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775645.504312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612679168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775645.504318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775645.504320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775645.504322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775645.504335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775645.504349:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775645.504355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775645/real 1775775645] req@ffff8de1c7af6300 x1862023612679296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775645.504363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612679296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775645.504368:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775645.504370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775645.504372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775646.463938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775647.487929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775648.511891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775649.535879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775650.559899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775650.623868:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775650.623877:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775650.623882:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775650.623890:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11622 00000100:00080000:0.0:1775775650.623902:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775650.623909:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775650.623946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612679424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775650.623973:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775650.623976:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775650.623977:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775650.623981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11622 00000100:00080000:0.0:1775775650.623983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775650.623986:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775650.623995:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775650.624004:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612679552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775650.624020:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775650.624023:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775650.624026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775650.624027:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612679424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775650.624031:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11622 00000100:00080000:0.0:1775775650.624038:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775650.624041:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775650.624045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775650.624055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612679680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775650.624062:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775650.624065:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775650.624067:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775650.624100:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11622 00000100:00080000:0.0:1775775650.624113:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775650.624116:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775650.624122:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775650.624125:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775650.624138:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612679808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775650.624148:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775650.624150:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775650.624152:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775650.624164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775650/real 1775775650] req@ffff8de1c5680e00 x1862023612679424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775650.624165:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11622 00000100:00080000:0.0:1775775650.624172:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775650.624180:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775650.624186:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775650.624197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612679424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775650.624198:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612679936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775650.624243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775650.624247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775650.624252:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612679424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775650.624285:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775650.624306:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775650.624316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775650/real 1775775650] req@ffff8de1c5683480 x1862023612679552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775650.624327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612679552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775650.624333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775650.624336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775650.624339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775650.624344:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775650.624366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775650.624373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775650/real 1775775650] req@ffff8de1c5683800 x1862023612679680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775650.624381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612679680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775650.624387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775650.624390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775650.624392:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775650.624397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775650.624409:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775650.624415:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775650/real 1775775650] req@ffff8de1c5681500 x1862023612679808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775650.624424:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612679808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775650.624430:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775650.624432:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775650.624434:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775650.624438:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775650.624449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775650.624455:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775650/real 1775775650] req@ffff8de1c5681880 x1862023612679936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775650.624464:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612679936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775650.624474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775650.624479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775650.624482:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612679936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775651.583944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775652.607893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775653.631906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775654.655854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775655.679897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775655.743848:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775655.743860:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775655.743877:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775655.743890:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11627 00000100:00080000:3.0:1775775655.743902:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775655.743909:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775655.743947:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612680064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775655.744008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775655.744013:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775655.744016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775655.744022:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11627 00000100:00080000:3.0:1775775655.744027:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775655.744033:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775655.744045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775655.744062:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612680192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775655.744068:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612680064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775655.744084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775655.744088:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775655.744091:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775655.744097:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11627 00000100:00080000:3.0:1775775655.744101:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775655.744107:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775655.744113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775775655.744137:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775655.744172:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775655/real 1775775655] req@ffff8de1c7af6a00 x1862023612680064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775655.744194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612680064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775655.744200:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612680320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775655.744205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775655.744213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775655.744219:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612680064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775655.744221:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775655.744226:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775655.744228:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775655.744234:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11627 00000100:00080000:3.0:1775775655.744239:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775655.744242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775655.744262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775655.744270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775655/real 1775775655] req@ffff8de1c7af4700 x1862023612680192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775655.744282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612680192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775655.744298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775655.744301:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775655.744305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775655.744312:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775655.744338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775655.744348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775655/real 1775775655] req@ffff8de1c7af4000 x1862023612680320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775655.744357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612680320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775655.744366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775655.744368:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:2.0:1775775655.744375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775655.744380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680320:192.168.201.137@tcp:38:kworker.0 00000008:00100000:3.0:1775775655.744380:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775655.744453:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612680448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775655.744467:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775655.744469:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775655.744471:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775655.744474:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11627 00000100:00080000:3.0:1775775655.744478:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775655.744481:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775655.744486:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775655.744496:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612680576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775655.744501:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775655.744535:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775655.744548:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775655/real 1775775655] req@ffff8de1c7af6a00 x1862023612680448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775655.744561:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612680448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775655.744569:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775655.744572:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775655.744575:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775655.744599:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775655.744619:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775655.744630:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775655/real 1775775655] req@ffff8de1c7af6300 x1862023612680576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775655.744641:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612680576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775655.744649:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775655.744652:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775655.744656:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775656.703903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775657.727860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775658.751901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775659.775887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775660.799952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775660.863851:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775660.863862:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775660.863867:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775660.863879:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11632 00000100:00080000:3.0:1775775660.863908:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775660.863917:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775660.863967:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612680704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775660.864001:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775660.864004:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775660.864006:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775660.864010:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11632 00000100:00080000:3.0:1775775660.864014:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775660.864019:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775660.864031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775660.864050:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612680704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775660.864050:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612680832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775660.864075:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775660.864078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775660.864080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775660.864085:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11632 00000100:00080000:3.0:1775775660.864089:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775660.864091:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775660.864097:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775660.864121:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612680960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775660.864129:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775660.864132:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775660.864133:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775660.864136:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11632 00000800:00000100:2.0:1775775660.864140:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775660.864140:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775660.864147:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775660.864152:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775660.864161:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612681088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775660.864168:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775660.864170:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775660.864171:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775660.864175:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11632 00000100:00080000:3.0:1775775660.864178:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775660.864183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775660/real 1775775660] req@ffff8de1c7af6680 x1862023612680704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775660.864184:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775660.864193:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775660.864207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612680704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775660.864210:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612681216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775660.864232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775660.864238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775660.864242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612680704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775660.864273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775660.864291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775660.864301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775660/real 1775775660] req@ffff8de1c7af7480 x1862023612680832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775660.864310:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612680832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775660.864315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775660.864318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775660.864321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775660.864324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775660.864335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775660.864340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775660/real 1775775660] req@ffff8de1c7af7b80 x1862023612680960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775660.864348:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612680960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775660.864352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775660.864354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775660.864356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612680960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775660.864360:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775660.864380:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775660.864386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775660/real 1775775660] req@ffff8de1c7af5c00 x1862023612681088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775660.864393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612681088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775660.864399:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775660.864402:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775660.864404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775660.864407:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775660.864418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775660.864423:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775660/real 1775775660] req@ffff8de1c7af6d80 x1862023612681216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775660.864430:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612681216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775660.864435:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775660.864437:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775660.864439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775661.823939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775662.847927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775663.871903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775664.895886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775665.919939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775665.983918:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775665.983930:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775665.983935:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775665.983945:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11637 00000100:00080000:1.0:1775775665.983958:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775665.983964:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775665.983997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612681344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775665.984026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775665.984029:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775665.984030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775665.984033:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11637 00000100:00080000:1.0:1775775665.984036:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775665.984038:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775665.984046:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775665.984054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612681472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775665.984061:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775665.984064:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775665.984065:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775665.984068:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11637 00000100:00080000:1.0:1775775665.984070:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775665.984074:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612681344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775665.984075:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775665.984081:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775665.984089:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612681600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775665.984099:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775665.984102:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775665.984103:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775665.984106:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11637 00000100:00080000:1.0:1775775665.984108:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775665.984110:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775665.984113:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775665.984120:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612681728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775665.984126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775665.984128:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775665.984129:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775665.984131:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11637 00000100:00080000:1.0:1775775665.984133:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775665.984136:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775665.984138:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775665.984144:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612681856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775665.984170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775665.984204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775665.984236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775665.984258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775666.943925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775667.967872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775668.991851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775775669.056106:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775775669.056147:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775775669.056165:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775669.056198:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775669.056204:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775669.056210:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775669.056215:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775775669.056250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775665/real 1775775669] req@ffff8de1c2e14700 x1862023612681600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775669.056279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612681600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775669.056296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775669.056302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775669.056307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775669.056315:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775665/real 1775775669] req@ffff8de1c2e17480 x1862023612681728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775669.056335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612681728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775669.056344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775669.056348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775669.056352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775669.056359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775665/real 1775775669] req@ffff8de1c2e14a80 x1862023612681856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775669.056371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612681856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775669.056380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775669.056383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775669.056387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681856:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775669.056395:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775665/real 1775775669] req@ffff8de1c2e17800 x1862023612681344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775669.056411:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612681344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775669.056419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775669.056423:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775669.056427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612681344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775669.056434:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775665/real 1775775669] req@ffff8de1c2e15500 x1862023612681472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775669.056446:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612681472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775669.056454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775669.056457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775669.056461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612681472:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775775670.015861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775671.039859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775671.103854:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775671.103862:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775671.103866:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775671.103874:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11642 00000100:00080000:0.0:1775775671.103884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775671.103889:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775671.103919:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612681984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775671.103941:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775671.103944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775671.103946:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775671.103948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11642 00000100:00080000:0.0:1775775671.103951:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775671.103953:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775671.103961:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775671.103973:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612682112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775671.103983:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612681984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775671.103988:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775671.103992:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775671.103994:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775671.103998:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11642 00000100:00080000:0.0:1775775671.104005:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775671.104010:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775671.104016:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775671.104033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612682240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775671.104042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775671.104046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775671.104048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775671.104052:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11642 00000100:00080000:0.0:1775775671.104056:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775671.104059:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775775671.104065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775671.104066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775671.104081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612682368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775671.104092:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775671.104095:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775671.104097:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775671.104104:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11642 00000100:00100000:1.0:1775775671.104104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775671/real 1775775671] req@ffff8de1c5681880 x1862023612681984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775671.104111:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775671.104119:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775671.104126:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775671.104135:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612681984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775671.104141:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612682496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775671.104159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775671.104167:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775671.104172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612681984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775671.104204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775671.104232:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775671.104246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775671/real 1775775671] req@ffff8de1c5681500 x1862023612682112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775671.104260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612682112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775671.104268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775671.104272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775671.104275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775671.104282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775671.104302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775671.104312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775671/real 1775775671] req@ffff8de1c5683800 x1862023612682240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775671.104324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612682240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775671.104333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775671.104336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775671.104339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775671.104345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775671.104368:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775671.104394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775671/real 1775775671] req@ffff8de1c5683480 x1862023612682368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775671.104415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612682368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775671.104424:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775671.104426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775671.104430:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775671.104436:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775671.104456:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775671.104466:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775671/real 1775775671] req@ffff8de1c5680e00 x1862023612682496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775671.104479:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612682496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775671.104487:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775671.104491:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775671.104493:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775672.063839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775673.087852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775674.111926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775675.135930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775676.159857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775676.223825:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775676.223834:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775676.223839:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775676.223849:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11647 00000100:00080000:0.0:1775775676.223862:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775676.223868:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775676.223910:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612682624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775676.223936:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775676.223939:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775676.223940:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775676.223944:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11647 00000100:00080000:0.0:1775775676.223946:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775676.223949:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775676.223958:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775676.223967:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612682752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775676.223974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775676.223977:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775676.223979:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775676.223982:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11647 00000100:00080000:0.0:1775775676.223984:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775676.223986:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775676.223990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775676.223997:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612682880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775676.224011:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612682624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775676.224013:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775676.224026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775676.224030:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775676.224034:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11647 00000100:00080000:0.0:1775775676.224036:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775676.224038:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775676.224043:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775676.224056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612683008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775676.224063:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775676.224067:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775676.224068:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775676.224071:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11647 00000100:00080000:0.0:1775775676.224086:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775676.224089:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775676.224092:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775676.224098:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775676.224102:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612683136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775676.224148:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775676/real 1775775676] req@ffff8de1c5680000 x1862023612682624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775676.224171:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612682624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775676.224190:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775676.224193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775676.224196:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612682624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775676.224203:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775676.224223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775676.224232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775676/real 1775775676] req@ffff8de1c5680380 x1862023612682752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775676.224240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612682752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775676.224246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775676.224248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775676.224250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775676.224272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775676.224290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775676.224301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775676/real 1775775676] req@ffff8de1c5682a00 x1862023612682880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775676.224314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612682880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775676.224322:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775676.224326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775676.224329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612682880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775676.224336:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775676.224352:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775676.224359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775676/real 1775775676] req@ffff8de1c5681f80 x1862023612683008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775676.224367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612683008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775676.224380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775676.224383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775676.224385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775676.224389:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775676.224401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775676.224407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775676/real 1775775676] req@ffff8de1c5681c00 x1862023612683136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775676.224414:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612683136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775676.224419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775676.224421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775676.224423:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775677.183869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775678.207870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775679.231945:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775680.255885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775681.279891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775681.343867:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775681.343918:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775681.343924:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775681.343937:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11653 00000100:00080000:0.0:1775775681.345134:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775681.346223:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775681.346274:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612683264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775681.346304:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775681.346308:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775681.346310:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775681.346329:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11653 00000100:00080000:0.0:1775775681.346335:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775681.346339:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775681.346354:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775681.346371:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612683392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775681.346384:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775681.346391:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775775681.346393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612683264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775681.346394:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775681.346413:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11653 00000100:00080000:0.0:1775775681.346418:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775681.346424:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775681.346432:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775681.346448:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612683520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775681.346459:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775681.346464:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775681.346466:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775681.346473:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11653 00000800:00000100:1.0:1775775681.346474:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775681.346484:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775681.346492:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775681.346500:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775681.346520:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775681/real 1775775681] req@ffff8de1c5683b80 x1862023612683264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775681.346522:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612683648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775681.346587:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775681.346593:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775775681.346593:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612683264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775681.346602:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775681.346618:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11653 00000100:00080000:1.0:1775775681.346619:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775681.346631:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:0.0:1775775681.346632:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775681.346641:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775681.346644:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612683264:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775775681.346650:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775681.346672:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775681.346676:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612683776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775681.346701:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775681.346719:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775681/real 1775775681] req@ffff8de1c5682300 x1862023612683392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775681.346776:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612683392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775681.346782:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775681.346784:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775681.346787:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775681.346791:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775681.346808:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775681.346816:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775681/real 1775775681] req@ffff8de1c5680700 x1862023612683520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775681.346824:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612683520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775681.346833:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775681.346836:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775681.346838:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775681.346842:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775681.346852:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775681.346857:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775681/real 1775775681] req@ffff8de1c5682d80 x1862023612683648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775681.346864:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612683648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775681.346869:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775681.346871:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775681.346873:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775681.346886:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775681.346896:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775681.346901:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775681/real 1775775681] req@ffff8de1c5682680 x1862023612683776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775681.346908:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612683776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775681.346912:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775681.346915:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775681.346917:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612683776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775682.303887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775683.327886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775684.351861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775685.375868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775686.399869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775686.463828:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775686.463839:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775686.463844:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775686.463853:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11658 00000100:00080000:1.0:1775775686.463866:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775686.463873:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775686.463908:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612683904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775686.463943:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775686.463947:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775686.463949:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775686.463953:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11658 00000100:00080000:1.0:1775775686.463958:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775686.463962:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775686.463972:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775686.463985:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612684032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775686.463992:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612683904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775686.464002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775686.464006:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775686.464008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775686.464012:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11658 00000100:00080000:1.0:1775775686.464016:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775686.464021:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775686.464025:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775686.464036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612684160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775686.464046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775686.464050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775686.464052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775775686.464055:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775686.464059:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11658 00000100:00080000:1.0:1775775686.464065:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775686.464069:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775686.464074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775686.464083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612684288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775686.464089:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775686.464092:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775686.464093:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775686.464098:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11658 00000100:00100000:2.0:1775775686.464099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775686/real 1775775686] req@ffff8de1c2e15500 x1862023612683904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775686.464101:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775686.464106:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775686.464113:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775686.464126:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612684416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775686.464126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612683904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775686.464159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775686.464164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775686.464168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612683904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775686.464187:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775686.464205:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775686.464218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775686/real 1775775686] req@ffff8de1c2e17800 x1862023612684032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775686.464240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612684032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775686.464250:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775686.464254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775686.464257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775686.464264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775686.464283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775686.464291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775686/real 1775775686] req@ffff8de1c2e14a80 x1862023612684160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775686.464299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612684160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775686.464304:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775686.464307:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775686.464309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775686.464313:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775686.464323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775686.464329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775686/real 1775775686] req@ffff8de1c2e17480 x1862023612684288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775686.464335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612684288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775686.464345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775686.464347:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775686.464349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775686.464353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775686.464362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775686.464366:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775686/real 1775775686] req@ffff8de1c2e14700 x1862023612684416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775686.464373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612684416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775686.464377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775686.464380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775686.464382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775687.423872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775688.447949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775689.471919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775690.495879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775691.519902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775691.583848:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775691.583859:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775691.583865:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775691.583876:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11663 00000100:00080000:2.0:1775775691.583888:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775691.583895:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775691.583931:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612684544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775691.583972:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775691.583977:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775691.583979:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775691.583985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11663 00000100:00080000:2.0:1775775691.583990:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775691.583995:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612684544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775691.583998:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775691.584013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775691.584031:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612684672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775691.584045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775691.584049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775691.584051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775691.584056:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11663 00000100:00080000:2.0:1775775691.584060:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775691.584065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775691.584069:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775691.584075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775691.584089:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612684800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775691.584098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775691/real 1775775691] req@ffff8de1d0f2d500 x1862023612684544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775691.584102:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775691.584113:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775691.584116:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775691.584121:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11663 00000100:00100000:0.0:1775775691.584123:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612684544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775691.584129:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775691.584136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775691.584137:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775775691.584142:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775691.584147:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612684544:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775691.584147:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775691.584166:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612684928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775691.584171:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684672:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775775691.584188:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775691.584192:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775691.584195:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775775691.584196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775691.584204:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11663 00000100:00080000:2.0:1775775691.584209:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775691.584212:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775691/real 1775775691] req@ffff8de1d0f2df80 x1862023612684672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775691.584216:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775691.584226:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775691.584230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612684672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775691.584238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775691.584242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775691.584243:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612685056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775691.584246:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775691.584251:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775691.584263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775691.584274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775691/real 1775775691] req@ffff8de1d0f2ca80 x1862023612684800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775691.584281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612684800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775691.584287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775691.584290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775691.584292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775691.584302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775691.584313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775691.584320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775691/real 1775775691] req@ffff8de1d0f2f100 x1862023612684928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775691.584327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612684928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775691.584332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775691.584333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775691.584342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612684928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775691.584346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775691.584374:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775691.584384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775691/real 1775775691] req@ffff8de1d0f2c700 x1862023612685056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775691.584393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612685056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775691.584398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775691.584401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775691.584402:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775692.544021:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775693.567892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775694.591877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775695.615888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775696.639971:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775696.703835:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775696.703847:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775696.703853:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775696.703866:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11668 00000100:00080000:1.0:1775775696.703881:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775696.703889:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775696.703940:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612685184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775696.703971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775696.703975:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775696.703976:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775696.703980:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11668 00000100:00080000:1.0:1775775696.703983:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775696.703987:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775696.703997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775696.704010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612685312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775696.704019:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775696.704022:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775775696.704023:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612685184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775696.704024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775696.704031:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11668 00000100:00080000:1.0:1775775696.704033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775696.704035:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775696.704038:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775696.704045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612685440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775696.704052:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775696.704055:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775696.704056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775696.704059:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11668 00000100:00080000:1.0:1775775696.704060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775696.704063:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775696.704066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775696.704073:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612685568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775696.704079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775696.704081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775696.704083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775696.704085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11668 00000100:00080000:1.0:1775775696.704097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775696.704099:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775696.704103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775696.704111:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775696.704112:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612685696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775696.704152:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775696/real 1775775696] req@ffff8de1c2e14e00 x1862023612685184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775696.704170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612685184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775696.704178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775696.704182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775696.704185:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612685184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775696.704207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775696.704225:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775696.704233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775696/real 1775775696] req@ffff8de1c2e14700 x1862023612685312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775696.704242:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612685312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775696.704247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775696.704248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775696.704250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775696.704254:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775696.704293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775696.704302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775696/real 1775775696] req@ffff8de1c2e17480 x1862023612685440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775696.704315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612685440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775696.704321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775696.704323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775696.704325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775696.704329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775696.704342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775696.704348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775696/real 1775775696] req@ffff8de1c2e14a80 x1862023612685568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775696.704355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612685568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775696.704361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775696.704362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775696.704364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775696.704374:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775696.704386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775696.704391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775696/real 1775775696] req@ffff8de1c2e17800 x1862023612685696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775696.704399:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612685696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775696.704408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775696.704411:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775696.704413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775697.663911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775698.687857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775699.711892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775700.735888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775701.759925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775701.823840:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775701.823866:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775701.823871:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775701.823880:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11673 00000100:00080000:3.0:1775775701.823891:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775701.823898:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775701.823936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612685824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775701.823964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775701.823968:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775701.823969:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775701.823978:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11673 00000100:00080000:3.0:1775775701.823981:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775701.823984:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775701.823994:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775701.824008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612685952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775701.824036:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612685824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775701.824043:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775701.824049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775701.824051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775701.824057:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11673 00000100:00080000:3.0:1775775701.824062:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775701.824068:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775701.824074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775701.824106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612686080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775701.824118:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775701.824118:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775701.824123:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775701.824125:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775701.824130:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11673 00000100:00080000:3.0:1775775701.824135:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775701.824139:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775701.824154:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775701.824159:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775701/real 1775775701] req@ffff8de1c7af4e00 x1862023612685824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775701.824169:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612686208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775701.824197:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775701.824203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612685824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775701.824203:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775701.824204:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775701.824213:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11673 00000100:00080000:3.0:1775775701.824244:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775701.824251:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775775701.824254:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:3.0:1775775701.824257:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775701.824262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775701.824267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612685824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775701.824272:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612686336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775701.824293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775701.824334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775701.824346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775701/real 1775775701] req@ffff8de1c7af5500 x1862023612685952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775701.824357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612685952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775701.824363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775701.824367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775701.824369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612685952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775701.824374:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775701.824399:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775701.824412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775701/real 1775775701] req@ffff8de1c7af5880 x1862023612686080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775701.824422:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612686080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775701.824457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775701.824460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775701.824463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775701.824468:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775701.824485:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775701.824493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775701/real 1775775701] req@ffff8de1c7af4a80 x1862023612686208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775701.824503:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612686208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775701.824510:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775701.824512:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775701.824515:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775701.824520:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775701.824533:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775701.824540:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775701/real 1775775701] req@ffff8de1c7af5f80 x1862023612686336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775701.824550:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612686336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775701.824556:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775701.824558:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775701.824561:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775702.784089:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775703.807925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775704.831937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775705.855914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775706.879862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775706.943794:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775706.943801:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775706.943805:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775706.943813:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11678 00000100:00080000:3.0:1775775706.943823:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775706.943840:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775706.943872:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612686464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775706.943895:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775706.943897:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775706.943899:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775706.943913:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11678 00000100:00080000:3.0:1775775706.943916:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775706.943918:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775706.943926:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775706.943936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612686592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775706.943944:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775706.943947:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775706.943948:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775706.943950:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11678 00000100:00100000:0.0:1775775706.943955:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612686464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775706.943956:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775706.943961:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775706.943967:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775706.943974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612686720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775706.943981:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775706.943983:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775706.943984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775706.943987:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11678 00000100:00080000:3.0:1775775706.943989:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775706.943992:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775706.943996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775706.944002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612686848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775706.944008:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775706.944010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775706.944011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775706.944014:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11678 00000100:00080000:3.0:1775775706.944017:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775706.944020:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775706.944023:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775706.944027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775706.944036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612686976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775706.944072:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775706/real 1775775706] req@ffff8de1c7af4380 x1862023612686464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775706.944104:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612686464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775706.944113:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775706.944116:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775706.944131:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612686464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775706.944136:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775706.944154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775706.944163:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775706/real 1775775706] req@ffff8de1c7af5180 x1862023612686592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775706.944172:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612686592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775706.944178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775706.944180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775706.944182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775706.944200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775706.944210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775706.944216:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775706/real 1775775706] req@ffff8de1c7af7800 x1862023612686720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775706.944223:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612686720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775706.944228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775706.944229:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775706.944231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775706.944235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775706.944244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775706.944249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775706/real 1775775706] req@ffff8de1c7af7100 x1862023612686848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775706.944256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612686848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775706.944261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775706.944264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775706.944266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775706.944269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775706.944278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775706.944283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775706/real 1775775706] req@ffff8de1c7af5f80 x1862023612686976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775706.944289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612686976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775706.944293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775706.944296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775706.944297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612686976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775707.904016:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775708.927951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775709.952108:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775710.976005:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775712.000101:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775712.063876:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775712.063887:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775712.063893:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775712.063904:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11683 00000100:00080000:2.0:1775775712.063930:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775712.063943:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775712.063983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612687104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775712.064036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775712.064043:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775712.064045:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775712.064053:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11683 00000100:00080000:2.0:1775775712.064060:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775712.064068:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775712.064082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775712.064103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612687104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775712.064109:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612687232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775712.064134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775712.064140:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775712.064143:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775712.064150:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11683 00000100:00080000:2.0:1775775712.064157:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775712.064164:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775712.064172:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775712.064211:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612687360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775712.064220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775712.064266:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775712.064274:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775712.064278:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775712.064298:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775712/real 1775775712] req@ffff8de1d0f2e680 x1862023612687104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775712.064299:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11683 00000100:00080000:2.0:1775775712.064315:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775712.064325:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775712.064334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612687104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775775712.064336:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775712.064356:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775775712.064374:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612687488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775712.064375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775712.064388:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612687104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775712.064415:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775712.064422:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775712.064426:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775712.064432:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687232:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775775712.064441:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11683 00000100:00080000:2.0:1775775712.064453:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775712.064477:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775712.064486:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775712.064493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775712.064510:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775712/real 1775775712] req@ffff8de1d0f2e300 x1862023612687232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775712.064520:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612687616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775712.064536:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612687232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775712.064553:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775712.064560:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775712.064587:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775712.064595:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775712.064617:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775712.064628:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775712/real 1775775712] req@ffff8de1d0f2c700 x1862023612687360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775712.064640:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612687360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775712.064648:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775712.064651:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775712.064655:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775712.064661:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775712.064678:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775712.064686:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775712/real 1775775712] req@ffff8de1d0f2f100 x1862023612687488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775712.064698:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612687488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775712.064706:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775712.064709:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775712.064712:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775712.064728:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775712.064744:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775712.064753:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775712/real 1775775712] req@ffff8de1d0f2ca80 x1862023612687616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775712.064782:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612687616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775712.064793:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775712.064798:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775712.064803:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775713.023890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775714.047909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775715.071873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775716.095924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775717.119849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775717.183823:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775717.183832:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775717.183836:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775717.183844:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11688 00000100:00080000:3.0:1775775717.183854:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775717.183859:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775717.183892:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612687744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775717.183931:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775717.183935:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775717.183937:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775717.183942:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11688 00000100:00080000:3.0:1775775717.183946:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775717.183951:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775717.183962:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775717.183975:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612687744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775717.183983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612687872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775717.183995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775717.183999:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775717.184002:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775717.184007:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11688 00000100:00080000:3.0:1775775717.184012:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775717.184016:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775717.184029:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775775717.184034:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775717.184046:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612688000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775717.184056:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775717.184060:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775717.184062:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775717.184067:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11688 00000100:00080000:3.0:1775775717.184071:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775717.184078:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775717/real 1775775717] req@ffff8de1c7af4a80 x1862023612687744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775717.184078:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775717.184087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775717.184109:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612687744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775717.184113:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612688128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775717.184130:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775775717.184134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775717.184138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775775717.184142:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775717.184145:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775717.184147:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612687744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775717.184153:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11688 00000100:00080000:3.0:1775775717.184158:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775717.184161:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775717.184166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775717.184176:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612688256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775717.184181:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775717.184212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775717.184226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775717/real 1775775717] req@ffff8de1c7af5880 x1862023612687872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775717.184241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612687872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775717.184250:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775717.184253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775717.184257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612687872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775717.184263:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775717.184282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775717.184292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775717/real 1775775717] req@ffff8de1c7af5500 x1862023612688000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775717.184304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612688000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775717.184318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775717.184321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775717.184324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775717.184331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775717.184353:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775717.184363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775717/real 1775775717] req@ffff8de1c7af4e00 x1862023612688128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775717.184376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612688128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775717.184385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775717.184388:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775717.184391:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775717.184408:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775717.184430:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775717.184442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775717/real 1775775717] req@ffff8de1c7af6d80 x1862023612688256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775717.184454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612688256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775717.184462:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775717.184466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775717.184469:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775718.143947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775719.167851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775720.191886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775721.215886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775722.239905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775722.303860:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775722.303869:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775722.303874:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775722.303885:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11694 00000100:00080000:2.0:1775775722.303898:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775722.303905:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775722.303955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612688384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775722.303979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775722.303981:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775722.303983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775722.303986:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11694 00000100:00080000:2.0:1775775722.303989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775722.303992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775722.304000:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775722.304009:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612688512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775722.304016:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775722.304019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775722.304021:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775722.304028:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11694 00000100:00100000:0.0:1775775722.304029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612688384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775722.304032:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775722.304040:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775722.304045:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775722.304062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612688640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775722.304083:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775722.304085:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775722.304087:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775722.304090:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11694 00000100:00080000:2.0:1775775722.304094:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775722.304098:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775722.304102:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775722.304108:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775722.304118:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612688768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775722.304124:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775722.304127:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775722.304128:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775722.304131:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11694 00000100:00080000:2.0:1775775722.304134:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775722.304136:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775722.304139:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775722.304141:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775722/real 1775775722] req@ffff8de1d0f2df80 x1862023612688384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775722.304149:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612688896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775722.304169:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612688384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775722.304180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775722.304185:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775722.304190:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612688384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775722.304198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775722.304217:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775722.304228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775722/real 1775775722] req@ffff8de1d0f2d500 x1862023612688512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775722.304239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612688512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775722.304246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775722.304250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775722.304253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775722.304276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775722.304293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775722.304301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775722/real 1775775722] req@ffff8de1d0f2ca80 x1862023612688640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775722.304312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612688640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775722.304319:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775722.304322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775722.304325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775722.304330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775722.304345:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775722.304352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775722/real 1775775722] req@ffff8de1d0f2f100 x1862023612688768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775722.304362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612688768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775722.304370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775722.304373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775722.304375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775722.304381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775722.304396:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775722.304406:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775722/real 1775775722] req@ffff8de1d0f2c700 x1862023612688896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775722.304425:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612688896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775722.304432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775722.304435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775722.304438:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612688896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775723.263909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775724.288038:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775725.311897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775726.335881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775727.359965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775727.423851:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775727.423861:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775727.423866:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775727.423877:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11699 00000100:00080000:3.0:1775775727.423890:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775727.423898:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775727.423951:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612689024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775727.423986:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775727.423991:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775727.423993:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775727.423998:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11699 00000100:00080000:3.0:1775775727.424003:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775727.424008:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775727.424021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775727.424033:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612689024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775727.424038:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612689152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775727.424058:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775727.424061:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775727.424063:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775727.424067:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11699 00000100:00080000:3.0:1775775727.424072:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775727.424076:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775727.424082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775727.424095:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612689280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775727.424112:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775727.424116:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775727.424118:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775727.424122:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11699 00000100:00080000:3.0:1775775727.424126:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775727.424131:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775775727.424132:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775775727.424137:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775727.424147:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612689408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775727.424154:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775727.424157:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775727.424158:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775727.424160:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11699 00000100:00080000:3.0:1775775727.424162:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775727.424165:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775727.424168:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775727.424201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775727/real 1775775727] req@ffff8de1c7af5c00 x1862023612689024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775727.424225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612689024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775727.424238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775727.424243:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775727.424249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612689024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775727.424253:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612689536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775727.424286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775727.424314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775727.424329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775727/real 1775775727] req@ffff8de1c7af7b80 x1862023612689152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775727.424342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612689152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775727.424362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775727.424367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775727.424371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775727.424378:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775727.424403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775727.424416:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775727/real 1775775727] req@ffff8de1c7af7480 x1862023612689280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775727.424436:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612689280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775727.424445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775727.424449:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775727.424453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775727.424461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775727.424496:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775727.424513:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775727/real 1775775727] req@ffff8de1c7af6680 x1862023612689408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775727.424529:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612689408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775727.424538:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775727.424543:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775727.424548:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775727.424557:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775727.424580:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775727.424592:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775727/real 1775775727] req@ffff8de1c7af6300 x1862023612689536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775727.424603:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612689536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775727.424618:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775727.424621:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775727.424624:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775728.383928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775729.407895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775730.431856:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775731.455897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775732.479861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775732.543885:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775732.543893:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775732.543897:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775732.543905:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11704 00000100:00080000:0.0:1775775732.543915:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775732.543920:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775732.543954:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612689664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775732.543979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775732.543982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775732.543984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775732.543987:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11704 00000100:00080000:0.0:1775775732.543989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775732.543992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775732.544001:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775732.544013:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612689792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775732.544025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775732.544026:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612689664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775732.544034:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775732.544037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775732.544043:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11704 00000100:00080000:0.0:1775775732.544047:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775732.544052:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775732.544057:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775732.544070:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612689920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775732.544081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775732.544084:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775732.544086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775732.544090:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11704 00000100:00080000:0.0:1775775732.544093:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775732.544097:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775732.544102:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775732.544112:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612690048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775732.544121:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775732.544126:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775732.544128:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775732.544133:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11704 00000100:00080000:0.0:1775775732.544137:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775732.544138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689792:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775775732.544144:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775732.544150:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775732.544163:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612690176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775732.544179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775732.544202:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775732.544223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775733.503863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775734.527847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775735.551870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775735.616024:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775735.616071:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775735.616092:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775735.616167:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775735.616180:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775735.616190:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775735.616198:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775775735.616292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775732/real 1775775735] req@ffff8de1c5683b80 x1862023612690176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775735.616324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612690176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775735.616338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775735.616346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775735.616351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690176:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775735.616361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775732/real 1775775735] req@ffff8de1c5682d80 x1862023612689792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775735.616376:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612689792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775735.616384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775735.616389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775735.616403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775735.616412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775732/real 1775775735] req@ffff8de1c5680700 x1862023612689920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775735.616426:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612689920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775735.616436:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775735.616440:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775735.616443:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612689920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775735.616451:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775732/real 1775775735] req@ffff8de1c5682300 x1862023612690048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775735.616466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612690048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775735.616472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775735.616476:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775735.616479:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775735.616491:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775732/real 1775775735] req@ffff8de1c5682680 x1862023612689664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775735.616511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612689664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775735.616520:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775735.616524:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775735.616527:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612689664:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775775736.575866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775737.599831:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775737.663862:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775737.663873:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775737.663878:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775737.663887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11709 00000100:00080000:2.0:1775775737.663900:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775737.663907:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775737.663937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612690304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775737.663975:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775737.663979:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775737.663981:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775737.663985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11709 00000100:00080000:2.0:1775775737.663989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775737.663993:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775737.664004:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775737.664021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612690432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775737.664038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775737.664041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775737.664042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775737.664046:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11709 00000100:00080000:2.0:1775775737.664056:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775737.664061:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775737.664066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775737.664081:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612690560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775737.664084:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612690304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775737.664100:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775737.664110:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775737.664112:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775737.664115:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11709 00000100:00080000:2.0:1775775737.664124:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775737.664128:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775737.664134:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775737.664147:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612690688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775737.664157:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:0.0:1775775737.664163:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775737.664164:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775737.664168:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775737.664173:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11709 00000100:00080000:2.0:1775775737.664179:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775737.664183:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775737.664189:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775737.664202:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612690816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775737.664210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775737/real 1775775737] req@ffff8de1d0f2e300 x1862023612690304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775737.664232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612690304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775737.664244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775737.664249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775737.664260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612690304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775737.664269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775737.664293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775737.664317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775737/real 1775775737] req@ffff8de1d0f2e680 x1862023612690432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775737.664331:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612690432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775737.664339:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775737.664342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775737.664345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775737.664371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775737.664393:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775737.664404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775737/real 1775775737] req@ffff8de1d0f2c700 x1862023612690560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775737.664415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612690560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775737.664422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775737.664426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775737.664429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775737.664434:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775737.664455:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775737.664464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775737/real 1775775737] req@ffff8de1d0f2f100 x1862023612690688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775737.664474:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612690688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775737.664487:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775737.664490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775737.664493:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775737.664498:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775737.664515:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775737.664525:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775737/real 1775775737] req@ffff8de1d0f2ca80 x1862023612690816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775737.664538:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612690816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775737.664546:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775737.664549:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775737.664566:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612690816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775738.623842:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775739.647853:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775740.671867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775741.695891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775742.719848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775742.783793:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775742.783804:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775742.783809:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775742.783819:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11714 00000100:00080000:2.0:1775775742.783831:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775742.783839:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775742.783874:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612690944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775742.783902:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775742.783906:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775742.783908:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775742.783912:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11714 00000100:00080000:2.0:1775775742.783916:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775742.783920:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775742.783931:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775742.783945:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612690944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775742.783945:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612691072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775742.783960:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775742.783963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775742.783966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775742.783970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11714 00000100:00080000:2.0:1775775742.783974:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775742.783978:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775742.783983:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775742.783995:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612691200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775742.784004:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775742.784008:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775742.784013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775742.784015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775742.784021:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11714 00000100:00080000:2.0:1775775742.784025:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775742.784029:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775742.784036:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775742.784040:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775742/real 1775775742] req@ffff8de1d0f2d500 x1862023612690944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775742.784050:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612691328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775742.784064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775742.784068:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612690944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775742.784069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775742.784073:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775742.784081:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11714 00000100:00080000:2.0:1775775742.784089:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775742.784092:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775742.784094:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775742.784102:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775742.784103:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775742.784111:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612690944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775742.784117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612691456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775742.784138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775742.784166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775742.784179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775742/real 1775775742] req@ffff8de1d0f2df80 x1862023612691072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775742.784193:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612691072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775742.784203:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775742.784206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775742.784210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775742.784217:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775742.784233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775742.784241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775742/real 1775775742] req@ffff8de1d0f2ca80 x1862023612691200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775742.784249:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612691200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775742.784254:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775742.784257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775742.784259:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775742.784262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775742.784273:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775742.784278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775742/real 1775775742] req@ffff8de1d0f2f100 x1862023612691328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775742.784286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612691328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775742.784291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775742.784293:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775742.784294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775742.784298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775742.784307:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775742.784312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775742/real 1775775742] req@ffff8de1d0f2c700 x1862023612691456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775742.784319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612691456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775742.784323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775742.784325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775742.784327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775743.743987:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775744.767896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775745.791874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775746.815858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775747.839978:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775747.903860:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775747.903874:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775747.903878:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775747.903887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11719 00000100:00080000:2.0:1775775747.903898:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775747.903904:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775747.903945:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612691584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775747.903970:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775747.903975:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775747.903977:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775747.903982:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11719 00000100:00080000:2.0:1775775747.903988:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775747.903993:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775747.903998:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612691584:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775747.904006:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775747.904021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612691712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775747.904040:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775747.904044:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775747.904046:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775747.904050:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11719 00000800:00000100:0.0:1775775747.904054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775747.904055:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775747.904062:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775747.904066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775747.904077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612691840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775747.904084:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775747.904087:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775747.904089:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775747.904093:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11719 00000100:00100000:0.0:1775775747.904094:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775747/real 1775775747] req@ffff8de1d0f2e680 x1862023612691584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775747.904095:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775747.904101:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775747.904107:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775747.904116:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612691968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775747.904123:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775747.904126:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1775775747.904129:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612691584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775747.904129:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775747.904138:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11719 00000100:00080000:2.0:1775775747.904142:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775747.904150:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:0.0:1775775747.904157:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:2.0:1775775747.904158:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775747.904165:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775747.904170:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612691584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775747.904175:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612692096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775747.904194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775747.904215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775747.904225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775747/real 1775775747] req@ffff8de1d0f2e300 x1862023612691712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775747.904233:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612691712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775747.904239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775747.904241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775747.904243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775747.904248:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775747.904267:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775747.904278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775747/real 1775775747] req@ffff8de1d0f2c700 x1862023612691840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775747.904290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612691840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775747.904300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775747.904302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775747.904304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775747.904308:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775747.904323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775747.904329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775747/real 1775775747] req@ffff8de1d0f2f100 x1862023612691968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775747.904337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612691968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775747.904341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775747.904344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775747.904345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612691968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775747.904349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775747.904358:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775747.904363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775747/real 1775775747] req@ffff8de1d0f2ca80 x1862023612692096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775747.904370:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612692096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775747.904404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775747.904406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775747.904409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775748.863926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775749.887921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775750.911949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775751.935877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775752.959967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775753.023854:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775753.023865:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775753.023870:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775753.023880:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11724 00000100:00080000:3.0:1775775753.023894:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775753.023901:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775753.023952:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612692224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775753.023980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775753.023984:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775753.023986:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775753.023991:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11724 00000100:00080000:3.0:1775775753.023995:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775753.023999:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775753.024011:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775753.024029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612692224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775753.024039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612692352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775753.024052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775753.024055:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775753.024056:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775753.024060:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11724 00000100:00080000:3.0:1775775753.024063:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775753.024066:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775753.024070:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775753.024079:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612692480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775753.024087:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775753.024097:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775753.024099:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775775753.024103:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775753.024107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11724 00000100:00080000:3.0:1775775753.024111:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775753.024114:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775753.024120:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775753.024133:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612692608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775753.024144:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775753.024147:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775753.024149:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775753.024153:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775753/real 1775775753] req@ffff8de1c7af6a00 x1862023612692224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775753.024157:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11724 00000100:00080000:3.0:1775775753.024166:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775753.024172:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775753.024177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612692224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775775753.024179:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775753.024193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775753.024199:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775753.024200:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612692736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775753.024204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612692224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775753.024232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775753.024250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775753.024259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775753/real 1775775753] req@ffff8de1c7af4000 x1862023612692352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775753.024267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612692352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775753.024273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775753.024276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775753.024278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775753.024281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775753.024312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775753.024320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775753/real 1775775753] req@ffff8de1c7af4700 x1862023612692480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775753.024328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612692480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775753.024335:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775753.024338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775753.024341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775753.024348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775753.024367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775753.024379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775753/real 1775775753] req@ffff8de1c7af6300 x1862023612692608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775753.024392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612692608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775753.024401:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775753.024403:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775753.024406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775753.024410:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775753.024433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775753.024440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775753/real 1775775753] req@ffff8de1c7af6680 x1862023612692736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775753.024452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612692736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775753.024457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775753.024459:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775753.024461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775753.983933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775755.007956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775756.031906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775757.055925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775758.079889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775758.143813:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775758.143821:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775758.143825:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775758.143833:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11729 00000100:00080000:3.0:1775775758.143843:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775758.143849:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775758.143882:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612692864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775758.143907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775758.143909:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775758.143911:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775758.143914:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11729 00000100:00080000:3.0:1775775758.143916:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775758.143920:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775758.143930:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775758.143945:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612692992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775758.143958:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775758.143963:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612692864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775758.143964:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775758.143967:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775758.143976:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11729 00000100:00080000:3.0:1775775758.143980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775758.143985:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775758.143991:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775758.144006:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612693120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775758.144016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775758.144020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775758.144022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775758.144027:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11729 00000100:00080000:3.0:1775775758.144032:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775758.144033:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775758.144041:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775758.144047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775758.144058:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612693248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775758.144065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775758.144068:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775758.144069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775758.144072:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11729 00000100:00080000:3.0:1775775758.144076:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775758.144077:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775758/real 1775775758] req@ffff8de1c7af7480 x1862023612692864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775758.144081:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775758.144088:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775758.144099:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612693376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775758.144107:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612692864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775758.144119:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775758.144125:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775758.144130:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612692864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775758.144153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775758.144174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775758.144185:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775758/real 1775775758] req@ffff8de1c7af7b80 x1862023612692992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775758.144240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612692992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775758.144249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775758.144252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775758.144256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612692992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775758.144262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775758.144282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775758.144291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775758/real 1775775758] req@ffff8de1c7af5c00 x1862023612693120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775758.144303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612693120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775758.144310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775758.144313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775758.144316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775758.144323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775758.144339:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775758.144349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775758/real 1775775758] req@ffff8de1c7af6d80 x1862023612693248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775758.144362:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612693248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775758.144376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775758.144380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775758.144383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775758.144397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775758.144420:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775758.144430:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775758/real 1775775758] req@ffff8de1c7af4e00 x1862023612693376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775758.144442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612693376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775758.144450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775758.144453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775758.144457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775759.103923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775760.127856:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775761.151934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775762.175928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775763.199862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775763.263826:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775763.263835:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775763.263840:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775763.263849:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11735 00000100:00080000:3.0:1775775763.263859:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775763.263872:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775763.263911:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612693504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775763.263939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775763.263942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775763.263944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775763.263948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11735 00000100:00080000:3.0:1775775763.263953:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775763.263957:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775763.263967:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775763.263973:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612693504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775763.263986:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612693632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775763.263999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775763.264003:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775763.264005:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775763.264011:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11735 00000100:00080000:3.0:1775775763.264027:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775763.264033:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775763.264034:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775763.264042:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775763.264055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612693760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775763.264064:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775763/real 1775775763] req@ffff8de1c7af5500 x1862023612693504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775763.264064:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775763.264078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775763.264081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775763.264085:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612693504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775763.264092:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11735 00000100:00080000:0.0:1775775763.264099:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775763.264120:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775763.264125:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612693504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775763.264152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775763.264178:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775763.264192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775763/real 1775775763] req@ffff8de1c7af5880 x1862023612693632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775763.264195:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775763.264205:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775763.264208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612693632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775775763.264212:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775763.264216:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775763.264220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775763.264223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775775763.264228:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612693888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775763.264231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693760:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775775763.264246:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775763.264249:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775763.264252:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775775763.264257:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775763.264259:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11735 00000100:00080000:3.0:1775775763.264264:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775763.264268:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775763.264272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775763/real 1775775763] req@ffff8de1c7af4a80 x1862023612693760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775775763.264274:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775763.264286:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612694016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775763.264288:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612693760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775763.264314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775763.264318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775763.264321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775763.264334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775763.264347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775763.264353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775763/real 1775775763] req@ffff8de1c7af5f80 x1862023612693888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775763.264360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612693888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775763.264365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775763.264367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775763.264369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612693888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775763.264372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775763.264381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775763.264386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775763/real 1775775763] req@ffff8de1c7af7100 x1862023612694016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775763.264393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612694016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775763.264398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775763.264408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775763.264410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775764.223996:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775765.247946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775766.271906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775767.295938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775768.319901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775768.383798:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775768.383807:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775768.383811:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775768.383819:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11740 00000100:00080000:3.0:1775775768.383829:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775768.383835:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775768.383872:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612694144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775768.383912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775768.383915:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775768.383917:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775768.383920:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11740 00000100:00080000:3.0:1775775768.383924:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775768.383927:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775768.383935:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775768.383948:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612694272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775768.383955:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775768.383958:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775768.383959:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775768.383962:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11740 00000100:00080000:3.0:1775775768.383964:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775768.383967:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775768.383970:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775768.383974:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612694144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775768.383980:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612694400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775768.383987:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775768.383989:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775768.383990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775768.383993:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11740 00000100:00080000:3.0:1775775768.383996:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775768.383998:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775768.384001:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775768.384009:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612694528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775768.384042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775768.384045:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:0.0:1775775768.384049:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775768.384049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775768.384055:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11740 00000100:00080000:3.0:1775775768.384059:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775768.384062:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775768.384067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775768.384076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612694656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775768.384086:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775768/real 1775775768] req@ffff8de1c7af7800 x1862023612694144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775768.384102:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612694144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775768.384109:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775768.384112:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775768.384115:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612694144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775768.384120:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775768.384135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775768.384143:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775768/real 1775775768] req@ffff8de1c7af5180 x1862023612694272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775768.384151:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612694272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775768.384156:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775768.384158:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775768.384160:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775768.384180:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775768.384190:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775768.384196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775768/real 1775775768] req@ffff8de1c7af4380 x1862023612694400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775768.384203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612694400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775768.384213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775768.384215:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775768.384217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775768.384220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775768.384230:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775768.384234:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775768/real 1775775768] req@ffff8de1c7af7100 x1862023612694528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775768.384241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612694528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775768.384247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775768.384249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775768.384250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775768.384253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775768.384262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775768.384267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775768/real 1775775768] req@ffff8de1c7af5f80 x1862023612694656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775768.384273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612694656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775768.384278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775768.384280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775768.384282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775769.343857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775770.367894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775771.391870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775772.415902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775773.439851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775773.503871:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775773.503882:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775773.503887:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775773.503897:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11745 00000100:00080000:0.0:1775775773.503910:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775773.503917:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775773.503989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612694784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775773.504016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775773.504019:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775773.504020:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775773.504024:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11745 00000100:00080000:0.0:1775775773.504027:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775773.504030:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775773.504039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775773.504049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612694912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775773.504055:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612694784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775773.504062:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775773.504065:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775773.504066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775773.504069:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11745 00000100:00080000:0.0:1775775773.504072:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775773.504076:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775773.504080:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775773.504089:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612695040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775773.504097:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775773.504099:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775773.504101:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775773.504103:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11745 00000100:00080000:0.0:1775775773.504109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775773.504112:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775773.504115:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775773.504119:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775773.504124:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612695168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775773.504132:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775773.504135:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775773.504137:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775773.504141:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11745 00000100:00080000:0.0:1775775773.504145:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775773.504149:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775773.504156:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775773.504164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775773/real 1775775773] req@ffff8de1c5681c00 x1862023612694784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775773.504170:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612695296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775773.504232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612694784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775773.504245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775773.504250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775773.504254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612694784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775773.504273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775773.504292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775773.504301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775773/real 1775775773] req@ffff8de1c5681f80 x1862023612694912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775773.504309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612694912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775773.504315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775773.504317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775773.504319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612694912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775773.504323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775773.504332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775773.504338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775773/real 1775775773] req@ffff8de1c5682a00 x1862023612695040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775773.504345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612695040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775773.504350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775773.504352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775773.504354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775773.504357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775773.504366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775773.504372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775773/real 1775775773] req@ffff8de1c5680380 x1862023612695168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775773.504379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612695168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775773.504384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775773.504386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775773.504387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775773.504391:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775773.504400:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775773.504404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775773/real 1775775773] req@ffff8de1c5680000 x1862023612695296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775773.504410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612695296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775773.504415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775773.504417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775773.504419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775774.463875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775775.487920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775776.511947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775777.535904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775778.559890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775778.623855:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775778.623865:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775778.623870:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775778.623882:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11750 00000100:00080000:3.0:1775775778.623900:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775778.623908:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775778.623955:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612695424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775778.623979:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775778.623982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775778.623984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775778.623987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11750 00000100:00080000:3.0:1775775778.623990:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775778.623992:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775778.624003:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775778.624014:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612695552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775778.624023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775778.624026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775778.624027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775778.624029:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11750 00000100:00080000:3.0:1775775778.624031:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775778.624035:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775778.624037:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612695424:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775778.624039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775778.624049:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612695680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775778.624056:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775778.624059:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775778.624060:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775778.624063:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11750 00000100:00080000:3.0:1775775778.624065:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775778.624067:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775778.624071:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775778.624077:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612695808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775778.624084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775778.624087:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775778.624089:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775778.624092:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11750 00000100:00080000:3.0:1775775778.624102:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775778.624106:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775778.624110:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775778.624117:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612695936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775778.624122:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775778.624166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775778/real 1775775778] req@ffff8de1c7af4a80 x1862023612695424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775778.624189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612695424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775778.624197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775778.624201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775778.624204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612695424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775778.624210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775778.624226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775778.624233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775778/real 1775775778] req@ffff8de1c7af5880 x1862023612695552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775778.624242:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612695552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775778.624247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775778.624248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775778.624250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775778.624274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775778.624285:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775778.624291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775778/real 1775775778] req@ffff8de1c7af5500 x1862023612695680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775778.624299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612695680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775778.624309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775778.624311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775778.624313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775778.624316:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775778.624334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775778.624339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775778/real 1775775778] req@ffff8de1c7af4e00 x1862023612695808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775778.624346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612695808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775778.624351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775778.624353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775778.624355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775778.624358:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775778.624367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775778.624372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775778/real 1775775778] req@ffff8de1c7af6d80 x1862023612695936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775778.624379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612695936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775778.624384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775778.624386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775778.624388:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612695936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775779.583928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775780.607903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775781.631975:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775782.655919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775783.679983:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775783.743896:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775783.743906:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775783.743911:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775783.743923:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11755 00000100:00080000:3.0:1775775783.743936:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775783.743945:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775783.743998:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612696064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775783.744031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775783.744034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775783.744036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775783.744040:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11755 00000100:00080000:3.0:1775775783.744043:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775783.744046:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775783.744057:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775783.744069:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612696192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775783.744083:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1775775783.744087:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612696064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775783.744088:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775783.744091:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775783.744098:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11755 00000100:00080000:3.0:1775775783.744100:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775783.744102:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775783.744106:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775783.744116:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612696320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775783.744123:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775783.744126:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775783.744127:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775783.744130:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11755 00000100:00080000:3.0:1775775783.744133:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775783.744135:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775783.744138:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775783.744144:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612696448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775783.744150:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775783.744153:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775783.744154:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775783.744157:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11755 00000100:00080000:3.0:1775775783.744160:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775775783.744165:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775783.744165:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775783.744171:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775783.744179:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612696576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775783.744205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775783/real 1775775783] req@ffff8de1c7af5c00 x1862023612696064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775783.744222:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612696064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775783.744231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775783.744235:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775783.744238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612696064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775783.744261:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775783.744283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775783.744292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775783/real 1775775783] req@ffff8de1c7af7b80 x1862023612696192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775783.744301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612696192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775783.744307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775783.744310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775783.744312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775783.744318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775783.744328:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775783.744333:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775783/real 1775775783] req@ffff8de1c7af7480 x1862023612696320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775783.744341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612696320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775783.744345:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775783.744347:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775783.744349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775783.744352:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775783.744362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775783.744367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775783/real 1775775783] req@ffff8de1c7af6680 x1862023612696448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775783.744375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612696448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775783.744379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775783.744381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775783.744383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775783.744386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775783.744395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775783.744400:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775783/real 1775775783] req@ffff8de1c7af6300 x1862023612696576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775783.744408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612696576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775783.744413:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775783.744415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775783.744417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775784.703950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775785.727956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775786.751897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775787.775913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775788.799875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775788.863901:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775788.863910:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775788.863914:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775788.863922:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11760 00000100:00080000:0.0:1775775788.863933:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775788.863939:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775788.863974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612696704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775788.864000:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775788.864003:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775788.864004:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775788.864007:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11760 00000100:00080000:0.0:1775775788.864009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775788.864011:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775788.864019:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775788.864026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612696832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775788.864038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775788.864040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775788.864042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775788.864045:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11760 00000100:00080000:0.0:1775775788.864047:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775788.864049:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775788.864052:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775788.864062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612696960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775788.864068:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775788.864071:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775788.864072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775788.864075:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11760 00000100:00080000:0.0:1775775788.864076:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775788.864078:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775788.864081:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775788.864086:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612697088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775788.864091:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775788.864093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775788.864094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775788.864096:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11760 00000100:00080000:0.0:1775775788.864099:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775788.864101:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775788.864104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775788.864110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612697216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775788.864138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612696704:192.168.201.137@tcp:250:kworker.0 00000800:00000100:2.0:1775775788.864272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775788.864311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775788/real 1775775788] req@ffff8de1c5680e00 x1862023612696704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775788.864328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612696704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775788.864337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775788.864341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775788.864344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612696704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775788.864350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775788.864365:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775788.864374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775788/real 1775775788] req@ffff8de1c5683480 x1862023612696832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775788.864382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612696832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775788.864388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775788.864392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775788.864395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775788.864402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775788.864422:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775788.864433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775788/real 1775775788] req@ffff8de1c5683800 x1862023612696960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775788.864446:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612696960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775788.864455:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775788.864459:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775788.864462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612696960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775788.864468:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775788.864485:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775788.864492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775788/real 1775775788] req@ffff8de1c5681500 x1862023612697088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775788.864500:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612697088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775788.864505:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775788.864507:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775788.864510:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775788.864537:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775788.864548:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775788.864554:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775788/real 1775775788] req@ffff8de1c5681880 x1862023612697216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775788.864561:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612697216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775788.864566:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775788.864568:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775788.864570:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775789.823964:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775790.847948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775791.871941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775792.895953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775793.919922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775793.983923:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775793.983932:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775793.983937:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775793.983946:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11765 00000100:00080000:2.0:1775775793.983957:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775793.983965:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775793.984000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612697344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775793.984031:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775793.984034:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775793.984037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775793.984039:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11765 00000100:00080000:2.0:1775775793.984041:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775793.984045:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775793.984053:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775793.984062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612697472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775793.984072:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775793.984076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1775775793.984077:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612697344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775793.984079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775793.984094:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11765 00000100:00080000:2.0:1775775793.984098:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775793.984102:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775793.984108:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775793.984124:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612697600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775793.984134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775793.984137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775793.984140:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775793.984144:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11765 00000100:00080000:2.0:1775775793.984148:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775793.984152:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775793.984157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775793.984169:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612697728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775793.984180:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775793.984183:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775793.984185:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775793.984189:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11765 00000100:00080000:2.0:1775775793.984192:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775793.984196:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775793.984201:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775793.984215:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612697856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775793.984226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775793.984281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775793/real 1775775793] req@ffff8de1d0f2df80 x1862023612697344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775793.984301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612697344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775793.984311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775793.984315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775793.984327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612697344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775793.984353:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775793.984375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775793.984384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775793/real 1775775793] req@ffff8de1d0f2d500 x1862023612697472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775793.984393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612697472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775793.984406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775793.984410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775793.984413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775793.984420:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775793.984442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775793.984455:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775793/real 1775775793] req@ffff8de1d0f2ca80 x1862023612697600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775793.984467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612697600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775793.984473:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775793.984476:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775793.984478:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775793.984483:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775793.984500:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775793.984507:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775793/real 1775775793] req@ffff8de1d0f2f100 x1862023612697728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775793.984515:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612697728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775793.984519:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775793.984521:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775793.984524:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775793.984528:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775793.984539:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775793.984544:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775793/real 1775775793] req@ffff8de1d0f2c700 x1862023612697856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775793.984551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612697856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775793.984557:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775793.984559:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775793.984560:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612697856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775794.943883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775795.967903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775796.991902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775798.015875:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775799.039890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775799.103875:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775799.103882:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775799.103886:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775799.103894:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11770 00000100:00080000:2.0:1775775799.103904:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775799.103910:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775799.103943:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612697984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775799.103963:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775799.103966:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775799.103967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775799.103971:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11770 00000100:00080000:2.0:1775775799.103974:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775799.103977:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775799.103987:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775799.103996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612698112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775799.104003:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775799.104006:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775799.104008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775799.104011:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11770 00000100:00080000:2.0:1775775799.104013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775799.104016:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775799.104019:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775799.104028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612698240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775799.104036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775775799.104041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612697984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775799.104041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775799.104044:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775799.104051:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11770 00000100:00080000:2.0:1775775799.104053:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775799.104056:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775799.104060:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775799.104068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612698368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775799.104078:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775799.104081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775799.104084:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775799.104088:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11770 00000100:00080000:2.0:1775775799.104092:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775799.104096:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775799.104102:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775799.104114:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612698496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775799.104152:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775799.104189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775799.104204:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775799.104217:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775800.063975:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775801.087878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775802.111835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775802.176051:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775802.176108:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775802.176130:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775802.176176:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775802.176188:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775802.176198:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775802.176210:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775775802.176286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775799/real 1775775802] req@ffff8de1d0f2c700 x1862023612698240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775802.176341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612698240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775802.176354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775802.176359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775802.176364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775802.176374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775799/real 1775775802] req@ffff8de1d0f2f100 x1862023612698368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775802.176388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612698368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775802.176396:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775802.176400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775802.176403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775802.176411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775799/real 1775775802] req@ffff8de1d0f2ca80 x1862023612698496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775802.176423:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612698496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775802.176465:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775802.176470:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775802.176474:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698496:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775802.176483:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775799/real 1775775802] req@ffff8de1d0f2e300 x1862023612697984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775802.176500:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612697984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775802.176508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775802.176511:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775802.176514:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612697984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775802.176522:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775799/real 1775775802] req@ffff8de1d0f2e680 x1862023612698112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775802.176535:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612698112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775802.176544:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775802.176549:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775802.176554:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698112:192.168.201.137@tcp:38:kworker.0 00010000:00010000:2.0:1775775803.135884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775804.159905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775804.223894:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775804.223902:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775804.223906:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775804.223913:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11775 00000100:00080000:1.0:1775775804.223922:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775804.223927:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775804.223955:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612698624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775804.223981:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775804.223984:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775804.223985:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775804.223988:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11775 00000100:00080000:1.0:1775775804.223991:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775804.223993:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775804.224000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775804.224008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612698752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775804.224015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775804.224017:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775804.224019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775804.224021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11775 00000100:00080000:1.0:1775775804.224023:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775804.224026:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775804.224028:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775804.224036:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612698880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775804.224043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775804.224047:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775804.224049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775804.224050:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612698624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775804.224053:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11775 00000100:00080000:1.0:1775775804.224057:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775804.224061:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775804.224065:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775804.224072:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612699008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775804.224077:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775804.224080:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775804.224081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775804.224083:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11775 00000100:00080000:1.0:1775775804.224087:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775804.224091:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775804.224096:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775804.224106:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612699136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775804.224125:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775804.224161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775804/real 1775775804] req@ffff8de1c2e15500 x1862023612698624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775804.224180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612698624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775804.224192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775804.224197:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775804.224201:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612698624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775804.224210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775804.224236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775804.224249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775804/real 1775775804] req@ffff8de1c2e17b80 x1862023612698752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775804.224264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612698752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775804.224272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775804.224277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775804.224281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775804.224307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775804.224330:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775804.224341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775804/real 1775775804] req@ffff8de1c2e16680 x1862023612698880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775804.224355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612698880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775804.224365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775804.224368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775804.224372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612698880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775804.224379:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775804.224419:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775804.224431:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775804/real 1775775804] req@ffff8de1c2e14380 x1862023612699008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775804.224445:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612699008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775804.224453:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775804.224457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775804.224461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775804.224466:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775804.224499:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775804.224511:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775804/real 1775775804] req@ffff8de1c2e17100 x1862023612699136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775804.224523:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612699136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775804.224531:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775804.224535:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775804.224538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775805.183845:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775806.207870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775807.231975:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775808.255876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775809.279950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775809.343833:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775809.343841:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775809.343846:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775809.343854:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11781 00000100:00080000:3.0:1775775809.343865:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775809.343870:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775809.343905:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612699264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775809.343934:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775809.343938:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775809.343940:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775809.343944:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11781 00000100:00080000:3.0:1775775809.343949:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775809.343954:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775809.343964:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775809.343977:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612699264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775809.343978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612699392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775809.343992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775809.343995:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775809.343996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775809.344000:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11781 00000100:00080000:3.0:1775775809.344002:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775809.344005:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775809.344008:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775809.344017:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612699520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775809.344023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775809.344025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775809.344027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775809.344029:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11781 00000100:00080000:3.0:1775775809.344032:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775809.344034:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775809.344037:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775809.344045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612699648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775809.344048:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775809.344055:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775809.344065:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775809.344067:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775809.344070:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11781 00000100:00080000:3.0:1775775809.344072:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775809.344075:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775809.344079:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775809.344085:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612699776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775809.344104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775809/real 1775775809] req@ffff8de1c7af4700 x1862023612699264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775809.344126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612699264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775809.344138:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775809.344141:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775809.344145:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612699264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775809.344164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775809.344183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775809.344192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775809/real 1775775809] req@ffff8de1c7af4000 x1862023612699392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775809.344200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612699392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775809.344205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775809.344207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775809.344209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775809.344213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775809.344224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775809.344229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775809/real 1775775809] req@ffff8de1c7af6a00 x1862023612699520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775809.344248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612699520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775809.344254:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775809.344256:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775809.344258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775809.344263:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775809.344278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775809.344288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775809/real 1775775809] req@ffff8de1c7af6300 x1862023612699648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775809.344315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612699648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775809.344324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775809.344328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775809.344331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775809.344338:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775809.344359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775809.344368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775809/real 1775775809] req@ffff8de1c7af6680 x1862023612699776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775809.344375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612699776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775809.344380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775809.344383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775809.344385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612699776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775810.303865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775811.327946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775812.351926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775813.375921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775814.399852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775814.463825:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775814.463836:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775814.463842:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775814.463854:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11786 00000100:00080000:2.0:1775775814.463866:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775814.463874:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775814.463913:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612699904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775814.463944:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775814.463948:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775814.463951:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775814.463955:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11786 00000100:00080000:2.0:1775775814.463960:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775814.463965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775814.463988:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775814.463996:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612699904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775814.464007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612700032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775814.464020:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775814.464024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775814.464027:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775814.464031:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11786 00000100:00080000:2.0:1775775814.464037:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775814.464041:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775814.464047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775775814.464060:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775814.464063:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612700160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775814.464081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775814.464085:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775814.464088:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775814.464092:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11786 00000100:00080000:2.0:1775775814.464097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775814.464101:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775814/real 1775775814] req@ffff8de1d0f2d500 x1862023612699904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775814.464105:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775814.464114:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775814.464131:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612699904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775814.464132:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612700288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775814.464167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775814.464167:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775814.464175:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775814.464178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775775814.464179:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775814.464186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612699904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775814.464187:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11786 00000100:00080000:2.0:1775775814.464196:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775814.464201:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775814.464206:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775814.464235:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612700416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775814.464253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775814.464279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775814.464292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775814/real 1775775814] req@ffff8de1d0f2df80 x1862023612700032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775814.464305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612700032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775814.464314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775814.464317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775814.464321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775814.464327:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775814.464343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775814.464354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775814/real 1775775814] req@ffff8de1d0f2e680 x1862023612700160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775814.464368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612700160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775814.464383:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775814.464386:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775814.464389:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775814.464396:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775814.464413:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775814.464422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775814/real 1775775814] req@ffff8de1d0f2e300 x1862023612700288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775814.464434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612700288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775814.464442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775814.464446:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775814.464449:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775814.464455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775814.464480:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775814.464489:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775814/real 1775775814] req@ffff8de1d0f2ca80 x1862023612700416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775814.464501:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612700416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775814.464509:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775814.464512:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775814.464516:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775815.423891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775816.447878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775817.471905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775818.495857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775819.519883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775819.583827:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775819.583835:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775819.583840:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775819.583849:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11791 00000100:00080000:2.0:1775775819.583860:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775819.583866:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775819.583899:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612700544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775819.583926:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775819.583929:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775819.583931:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775819.583934:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11791 00000100:00080000:2.0:1775775819.583936:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775819.583939:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775819.583947:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775819.583955:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612700672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775819.583962:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775819.583965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775819.583967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775819.583970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11791 00000100:00080000:2.0:1775775819.583972:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775819.583975:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775819.583977:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775819.583987:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612700544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775819.583987:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612700800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775819.584002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775819.584004:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775819.584006:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775819.584008:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11791 00000100:00080000:2.0:1775775819.584009:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775819.584011:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775819.584015:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775819.584022:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612700928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775819.584028:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775819.584030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775819.584031:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775819.584033:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11791 00000100:00080000:2.0:1775775819.584044:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775819.584046:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775819.584049:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775819.584056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612701056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775819.584065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775819.584099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775819/real 1775775819] req@ffff8de1d0f2f100 x1862023612700544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775819.584112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612700544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775819.584121:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775819.584154:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775819.584159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612700544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775819.584167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775819.584192:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775819.584202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775819/real 1775775819] req@ffff8de1d0f2c700 x1862023612700672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775819.584211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612700672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775819.584217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775819.584219:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775819.584221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775819.584240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775819.584253:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775819.584260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775819/real 1775775819] req@ffff8de1d0f2ca80 x1862023612700800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775819.584268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612700800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775819.584273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775819.584276:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775819.584278:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775819.584281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775819.584291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775819.584296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775819/real 1775775819] req@ffff8de1d0f2e300 x1862023612700928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775819.584303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612700928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775819.584308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775819.584310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775819.584312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612700928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775819.584315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775819.584324:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775819.584329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775819/real 1775775819] req@ffff8de1d0f2e680 x1862023612701056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775819.584335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612701056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775819.584341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775819.584343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775819.584345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775820.543885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775821.567902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775822.591891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775823.615909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775824.639935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775824.703852:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775824.703859:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775824.703863:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775824.703871:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11796 00000100:00080000:1.0:1775775824.703880:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775824.703885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775824.703915:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612701184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775824.703939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775824.703942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775824.703943:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775824.703946:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11796 00000100:00080000:1.0:1775775824.703949:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775824.703951:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775824.703959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775824.703969:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612701312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775824.703977:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775824.703980:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775824.703981:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775824.703985:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612701184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775824.703986:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11796 00000100:00080000:1.0:1775775824.703991:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775824.703994:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775824.703997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775824.704006:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612701440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775824.704012:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775824.704015:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775824.704016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775824.704018:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11796 00000100:00080000:1.0:1775775824.704020:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775824.704022:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775824.704025:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775824.704031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612701568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775824.704054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775824.704056:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775824.704057:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775824.704060:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11796 00000100:00080000:1.0:1775775824.704063:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775824.704065:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775824.704069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775775824.704071:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775824.704080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612701696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775824.704104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775824/real 1775775824] req@ffff8de1c2e16a00 x1862023612701184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775824.704119:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612701184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775824.704126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775824.704129:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775824.704132:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612701184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775824.704150:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775824.704166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775824.704174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775824/real 1775775824] req@ffff8de1c2e17100 x1862023612701312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775824.704182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612701312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775824.704187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775824.704189:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775824.704191:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775824.704195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775824.704212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775824.704219:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775824/real 1775775824] req@ffff8de1c2e14380 x1862023612701440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775824.704226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612701440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775824.704231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775824.704233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775824.704235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775824.704239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775824.704250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775824.704260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775824/real 1775775824] req@ffff8de1c2e16680 x1862023612701568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775824.704272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612701568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775824.704281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775824.704285:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775824.704288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775824.704295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775824.704316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775824.704328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775824/real 1775775824] req@ffff8de1c2e17b80 x1862023612701696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775824.704341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612701696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775824.704349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775824.704352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775824.704355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775825.663903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775826.687889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775827.711859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775828.735913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775829.759919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775829.823849:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775829.823857:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775829.823861:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775829.823870:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11801 00000100:00080000:3.0:1775775829.823879:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775829.823920:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775829.823978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612701824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775829.823999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775829.824002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775829.824004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775829.824007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11801 00000100:00080000:3.0:1775775829.824010:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775829.824013:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775829.824021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775829.824033:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612701952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775829.824040:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775829.824043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775829.824044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775829.824046:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11801 00000100:00080000:3.0:1775775829.824049:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775829.824054:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775829.824056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612701824:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775829.824057:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775829.824068:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612702080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775829.824074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775829.824076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775829.824077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775829.824079:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11801 00000100:00080000:3.0:1775775829.824082:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775829.824084:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775829.824087:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775829.824097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612702208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775829.824111:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775829.824115:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775829.824117:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775829.824121:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11801 00000100:00080000:3.0:1775775829.824126:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775829.824131:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775829.824135:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775829.824140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775829.824154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612702336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775829.824173:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775829/real 1775775829] req@ffff8de1c7af7480 x1862023612701824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775829.824196:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612701824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775829.824206:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775829.824211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775829.824215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612701824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775829.824224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775829.824248:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775829.824261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775829/real 1775775829] req@ffff8de1c7af7b80 x1862023612701952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775829.824273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612701952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775829.824286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775829.824290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775829.824293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612701952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775829.824317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775829.824336:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775829.824345:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775829/real 1775775829] req@ffff8de1c7af5c00 x1862023612702080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775829.824356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612702080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775829.824363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775829.824366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775829.824369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775829.824375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775829.824410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775829.824422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775829/real 1775775829] req@ffff8de1c7af6d80 x1862023612702208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775829.824435:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612702208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775829.824443:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775829.824446:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775829.824450:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775829.824457:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775829.824476:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775829.824486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775829/real 1775775829] req@ffff8de1c7af4e00 x1862023612702336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775829.824498:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612702336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775829.824506:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775829.824509:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775829.824512:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775830.784042:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775831.807983:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775832.831929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775833.855950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775834.880001:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775834.943905:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775834.943916:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775834.943922:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775834.943932:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11806 00000100:00080000:3.0:1775775834.943944:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775834.943951:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775834.943996:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612702464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775834.944031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775834.944034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775834.944036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775834.944039:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11806 00000100:00080000:3.0:1775775834.944042:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775834.944044:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775834.944054:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775834.944066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612702592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775834.944075:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775834.944078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775834.944080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775775834.944083:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612702464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775834.944086:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11806 00000100:00080000:3.0:1775775834.944092:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775834.944095:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775834.944099:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775834.944106:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612702720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775834.944112:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775834.944115:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775834.944116:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775834.944119:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11806 00000100:00080000:3.0:1775775834.944122:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775834.944124:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775834.944128:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775834.944134:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612702848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775834.944149:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775834.944151:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775834.944152:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775834.944154:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11806 00000100:00080000:3.0:1775775834.944156:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775834.944159:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775834.944162:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775834.944169:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612702976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775775834.944176:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775834.944216:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775834/real 1775775834] req@ffff8de1c7af5500 x1862023612702464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775834.944239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612702464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775834.944252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775834.944258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775834.944264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612702464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775834.944294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775834.944321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775834.944332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775834/real 1775775834] req@ffff8de1c7af5880 x1862023612702592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775834.944345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612702592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775834.944354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775834.944357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775834.944361:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775834.944372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775834.944405:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775834.944416:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775834/real 1775775834] req@ffff8de1c7af4a80 x1862023612702720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775834.944426:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612702720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775834.944432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775834.944435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775834.944437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775834.944441:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775834.944465:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775834.944478:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775834/real 1775775834] req@ffff8de1c7af5f80 x1862023612702848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775834.944486:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612702848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775834.944496:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775834.944502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775834.944506:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775834.944514:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775834.944547:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775834.944559:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775834/real 1775775834] req@ffff8de1c7af7100 x1862023612702976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775834.944569:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612702976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775834.944575:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775834.944586:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775834.944589:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612702976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775835.903956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775836.927987:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775837.951905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775838.975940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775839.999961:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775840.063842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775840.063852:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775840.063856:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775840.063865:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11811 00000100:00080000:3.0:1775775840.063876:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775840.063883:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775840.063922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612703104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775840.063950:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775840.063954:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775840.063956:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775840.063961:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11811 00000100:00080000:3.0:1775775840.063965:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775840.063969:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775840.063980:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775840.063995:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612703232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775840.063999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612703104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775840.064006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775840.064008:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775840.064010:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775840.064014:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11811 00000100:00080000:3.0:1775775840.064017:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775840.064021:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775840.064025:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775840.064034:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612703360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775840.064047:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775840.064049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775840.064051:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775840.064054:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11811 00000100:00080000:3.0:1775775840.064057:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775775840.064059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775840.064061:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775840.064064:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775840.064073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612703488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775840.064081:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775840.064084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775840.064086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775840.064089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11811 00000100:00100000:0.0:1775775840.064090:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775840/real 1775775840] req@ffff8de1c7af4380 x1862023612703104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775840.064104:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775775840.064108:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612703104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775840.064112:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775840.064116:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:0.0:1775775840.064120:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775840.064124:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775775840.064125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612703616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775840.064128:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612703104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775840.064151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775840.064174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775840.064186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775840/real 1775775840] req@ffff8de1c7af5180 x1862023612703232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775840.064195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612703232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775840.064200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775840.064202:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775840.064205:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775840.064208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775775840.064221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775840.064226:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775840/real 1775775840] req@ffff8de1c7af7800 x1862023612703360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775840.064233:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612703360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775840.064238:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775840.064240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775840.064241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775840.064244:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775840.064254:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775840.064258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775840/real 1775775840] req@ffff8de1c7af7100 x1862023612703488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775840.064266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612703488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775840.064271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775840.064272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775840.064274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775840.064277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775775840.064286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775840.064290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775840/real 1775775840] req@ffff8de1c7af5f80 x1862023612703616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775840.064297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612703616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775840.064301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775840.064303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775840.064305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775841.023904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775842.047984:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775843.071906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775844.095968:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775845.119848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775845.183820:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775845.183829:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775845.183832:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775845.183840:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11816 00000100:00080000:0.0:1775775845.183849:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775845.183855:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775845.183888:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612703744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775845.183912:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775845.183915:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775845.183916:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775845.183919:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11816 00000100:00080000:0.0:1775775845.183921:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775845.183923:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775845.183930:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775845.183937:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612703872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775845.183945:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775845.183948:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775845.183949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775845.183952:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11816 00000100:00080000:0.0:1775775845.183954:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775845.183956:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775845.183959:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775845.183965:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612703744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775845.183966:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612704000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775845.183978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775845.183980:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775845.183981:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775845.183984:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11816 00000100:00080000:0.0:1775775845.183987:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775845.183990:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775845.183993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775845.184002:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612704128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775845.184008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775845.184010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775845.184011:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775845.184014:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11816 00000100:00080000:0.0:1775775845.184017:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775845.184019:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775845.184022:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775845.184026:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775845.184030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612704256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775845.184057:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775845/real 1775775845] req@ffff8de1c5681880 x1862023612703744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775845.184071:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612703744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775845.184078:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775845.184082:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775845.184087:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612703744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775845.184095:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775845.184132:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775845.184145:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775845/real 1775775845] req@ffff8de1c5681500 x1862023612703872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775845.184161:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612703872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775845.184167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775845.184169:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775845.184172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612703872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775845.184190:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775845.184204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775845.184211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775845/real 1775775845] req@ffff8de1c5683800 x1862023612704000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775845.184218:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612704000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775845.184223:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775845.184225:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775845.184227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775845.184231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775845.184240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775845.184246:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775845/real 1775775845] req@ffff8de1c5683480 x1862023612704128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775845.184254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612704128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775845.184263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775845.184266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775845.184269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775845.184285:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775845.184307:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775845.184318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775845/real 1775775845] req@ffff8de1c5680e00 x1862023612704256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775845.184326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612704256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775845.184332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775845.184334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775845.184336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775846.143887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775847.167849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775848.191870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775849.215848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775850.239953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775850.303878:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775850.303888:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775850.303893:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775850.303903:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11822 00000100:00080000:3.0:1775775850.303917:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775850.303924:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775850.303976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612704384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775850.303999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775850.304002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775850.304004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775850.304007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11822 00000100:00080000:3.0:1775775850.304010:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775850.304013:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775850.304023:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775850.304035:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612704512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775850.304043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775850.304047:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775850.304048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775850.304053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11822 00000100:00100000:2.0:1775775850.304054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612704384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775850.304056:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775850.304062:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775850.304066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775850.304073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612704640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775850.304080:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775850.304084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775850.304085:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775850.304088:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11822 00000100:00080000:3.0:1775775850.304090:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775850.304093:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775850.304096:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775850.304102:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612704768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775850.304107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775850.304109:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775850.304110:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775850.304113:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11822 00000100:00080000:3.0:1775775850.304117:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775850.304119:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775850.304123:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775850.304130:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612704896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775850.304138:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775850.304181:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775850/real 1775775850] req@ffff8de1c7af4a80 x1862023612704384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775850.304197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612704384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775850.304215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775850.304219:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775850.304222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612704384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775850.304267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775850.304286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775850.304295:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775850/real 1775775850] req@ffff8de1c7af5880 x1862023612704512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775850.304304:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612704512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775850.304310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775850.304313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775850.304315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775850.304319:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775850.304329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775850.304335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775850/real 1775775850] req@ffff8de1c7af5500 x1862023612704640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775850.304343:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612704640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775850.304370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775850.304372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775850.304374:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775850.304377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775850.304388:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775850.304394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775850/real 1775775850] req@ffff8de1c7af4e00 x1862023612704768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775850.304401:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612704768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775850.304405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775850.304407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775850.304409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775850.304412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775850.304422:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775850.304427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775850/real 1775775850] req@ffff8de1c7af6d80 x1862023612704896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775850.304433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612704896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775850.304438:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775850.304439:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775850.304442:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612704896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775851.263899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775852.287935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775853.311865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775854.335934:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775855.359934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775855.423837:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775855.423851:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775855.423857:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775855.423871:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11827 00000100:00080000:3.0:1775775855.423886:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775855.423895:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775855.423946:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612705024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775855.423978:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775855.423982:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775855.423984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775855.423990:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11827 00000100:00080000:3.0:1775775855.423995:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775855.423999:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775855.424009:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612705024:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775775855.424012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775855.424031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612705152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775855.424044:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775855.424048:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775855.424050:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775855.424054:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11827 00000100:00080000:3.0:1775775855.424069:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775855.424073:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775855.424077:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775775855.424087:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775855.424090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612705280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775855.424098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775855.424101:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775855.424103:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775855.424107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11827 00000100:00080000:3.0:1775775855.424110:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775855.424113:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775855.424117:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775855.424125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612705408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775855.424129:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775855/real 1775775855] req@ffff8de1c7af5c00 x1862023612705024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775855.424143:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775855.424148:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775855.424149:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775855.424153:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11827 00000100:00080000:3.0:1775775855.424155:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775855.424159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612705024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775855.424162:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775855.424168:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775855.424178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775775855.424181:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612705536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775855.424186:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775855.424195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612705024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775855.424224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775855.424240:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775855.424249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775855/real 1775775855] req@ffff8de1c7af7b80 x1862023612705152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775855.424258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612705152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775855.424263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775855.424266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775855.424269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775855.424273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775855.424284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775855.424289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775855/real 1775775855] req@ffff8de1c7af7480 x1862023612705280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775855.424296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612705280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775855.424301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775855.424303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775855.424305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775855.424308:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775855.424318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775855.424323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775855/real 1775775855] req@ffff8de1c7af6680 x1862023612705408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775855.424330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612705408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775855.424334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775855.424336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775855.424338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775855.424341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775855.424350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775855.424356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775855/real 1775775855] req@ffff8de1c7af6300 x1862023612705536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775855.424363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612705536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775855.424368:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775855.424369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775855.424371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775856.383936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775857.407967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775858.431965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775859.455959:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775860.479946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775860.543877:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775860.543891:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775860.543896:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775860.543907:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11832 00000100:00080000:3.0:1775775860.543921:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775860.543929:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775860.543974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612705664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775860.544005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775860.544009:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775860.544011:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775860.544014:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11832 00000100:00080000:3.0:1775775860.544017:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775860.544020:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775860.544031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775860.544043:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612705792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775860.544052:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775860.544056:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775860.544058:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775860.544062:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11832 00000100:00080000:3.0:1775775860.544066:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775860.544072:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612705664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775860.544072:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775860.544082:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775860.544097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612705920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775860.544110:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775860.544114:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775860.544117:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775860.544120:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11832 00000100:00080000:3.0:1775775860.544135:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775860.544140:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775860.544147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775860.544153:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775775860.544164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612706048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775860.544175:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775860.544180:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775860.544193:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775860.544198:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11832 00000100:00080000:3.0:1775775860.544202:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775860.544206:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775860.544211:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775860.544214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775860/real 1775775860] req@ffff8de1c7af6a00 x1862023612705664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775775860.544224:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612706176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775860.544236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612705664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775860.544245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775860.544249:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775860.544252:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612705664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775860.544259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775860.544292:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775860.544306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775860/real 1775775860] req@ffff8de1c7af4000 x1862023612705792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775860.544315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612705792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775860.544321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775860.544323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775860.544326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775860.544348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775860.544361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775860.544367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775860/real 1775775860] req@ffff8de1c7af4700 x1862023612705920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775860.544375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612705920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775860.544380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775860.544382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775860.544384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612705920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775860.544388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775860.544398:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775860.544403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775860/real 1775775860] req@ffff8de1c7af6300 x1862023612706048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775860.544439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612706048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775860.544446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775860.544448:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775860.544451:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775860.544455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775860.544470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775860.544476:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775860/real 1775775860] req@ffff8de1c7af6680 x1862023612706176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775860.544484:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612706176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775860.544489:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775860.544490:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775860.544492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775861.503958:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775862.527887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775863.551984:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775864.575865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775865.599948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775865.663826:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775865.663837:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775865.663842:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775865.663852:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11837 00000100:00080000:2.0:1775775865.663866:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775865.663873:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775865.663916:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612706304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775865.663944:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775865.663947:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775865.663948:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775865.663951:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11837 00000100:00080000:2.0:1775775865.663954:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775865.663957:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775865.663970:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775865.663984:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612706432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775865.663993:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612706304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775865.664000:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775865.664005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775865.664007:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775865.664012:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11837 00000100:00080000:2.0:1775775865.664017:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775865.664021:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775865.664025:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775865.664037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612706560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775865.664045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775865.664048:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775865.664049:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775865.664054:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11837 00000100:00080000:2.0:1775775865.664059:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775865.664063:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775865.664070:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775865.664082:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612706688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775865.664094:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775865.664098:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775865.664100:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775865.664105:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11837 00000100:00080000:2.0:1775775865.664109:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775865.664113:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775865.664118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706432:192.168.201.137@tcp:38:kworker.0 00000008:00100000:2.0:1775775865.664118:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775865.664131:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612706816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775775865.664163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775865.664185:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775865.664203:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775866.623902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775867.647833:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775868.671889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775775868.736060:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775775868.736120:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775775868.736143:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775868.736228:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775868.736246:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775868.736256:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775775868.736265:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775775868.736414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775865/real 1775775868] req@ffff8de1d0f2ca80 x1862023612706816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775868.736460:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612706816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775868.736472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775868.736478:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775868.736483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706816:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775868.736492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775865/real 1775775868] req@ffff8de1d0f2d500 x1862023612706432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775868.736505:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612706432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775868.736525:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775868.736532:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775868.736537:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775868.736546:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775865/real 1775775868] req@ffff8de1d0f2e680 x1862023612706560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775868.736558:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612706560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775868.736565:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775868.736569:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775868.736572:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775775868.736580:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775865/real 1775775868] req@ffff8de1d0f2e300 x1862023612706688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775868.736593:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612706688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775868.736602:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775868.736605:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775868.736608:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612706688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775775868.736617:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775865/real 1775775868] req@ffff8de1d0f2df80 x1862023612706304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775868.736631:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612706304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775868.736655:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775775868.736660:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775868.736664:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612706304:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775775869.695903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775870.719869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775870.783827:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775870.783838:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775870.783843:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775870.783853:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11842 00000100:00080000:2.0:1775775870.783866:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775870.783874:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775870.783918:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612706944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775870.783949:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775870.783952:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775870.783954:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775870.783958:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11842 00000100:00080000:2.0:1775775870.783961:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775870.783965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775870.783975:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775870.783989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612706944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775870.783990:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612707072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775870.784012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775870.784018:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775870.784021:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775870.784029:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11842 00000100:00080000:2.0:1775775870.784036:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775870.784042:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775870.784049:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775870.784065:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612707200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775870.784077:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775870.784081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775870.784084:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775870.784091:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11842 00000800:00000100:1.0:1775775870.784093:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775870.784101:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775870.784107:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775870.784115:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775870.784128:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612707328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775870.784137:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775870.784143:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775870/real 1775775870] req@ffff8de1d0f2c700 x1862023612706944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775870.784143:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775870.784145:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775870.784153:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11842 00000100:00080000:2.0:1775775870.784161:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775870.784167:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775870.784173:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775870.784182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612706944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775870.784187:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612707456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775870.784207:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775870.784216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775870.784223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612706944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775870.784282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775870.784317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775870.784339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775870/real 1775775870] req@ffff8de1d0f2f100 x1862023612707072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775870.784364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612707072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775870.784374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775870.784378:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775870.784382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775870.784390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775870.784416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775870.784429:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775870/real 1775775870] req@ffff8de1d0f2df80 x1862023612707200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775870.784444:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612707200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775870.784453:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775870.784457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775870.784460:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775870.784467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775870.784492:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775870.784503:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775870/real 1775775870] req@ffff8de1d0f2e300 x1862023612707328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775870.784516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612707328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775870.784528:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775870.784532:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775870.784535:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775870.784541:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775870.784560:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775870.784570:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775870/real 1775775870] req@ffff8de1d0f2e680 x1862023612707456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775870.784581:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612707456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775870.784588:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775870.784591:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775870.784594:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775871.743850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775872.767836:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775873.791888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775874.815891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775875.839872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775875.903876:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775875.903891:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775875.903896:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775875.903907:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11847 00000100:00080000:0.0:1775775875.903921:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775875.903931:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775875.903985:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612707584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775875.904014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775875.904020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775875.904022:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775875.904028:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11847 00000100:00080000:0.0:1775775875.904034:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775875.904039:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775875.904053:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775875.904054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612707584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775875.904070:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612707712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775875.904080:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775875.904083:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775875.904084:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775875.904087:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11847 00000100:00080000:0.0:1775775875.904090:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775875.904093:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775875.904096:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775875.904106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612707840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775875.904120:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775875.904123:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775875.904125:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775875.904127:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11847 00000100:00080000:0.0:1775775875.904137:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775875.904140:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775875.904159:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775875.904161:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775875.904171:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612707968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775875.904179:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775875.904182:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775875.904183:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775875.904187:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11847 00000100:00080000:0.0:1775775875.904190:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775875.904193:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775875.904197:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775875.904206:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612708096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775875.904214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775875/real 1775775875] req@ffff8de1c5680000 x1862023612707584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775875.904240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612707584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775875.904250:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775875.904253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775875.904257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612707584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775875.904282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775875.904302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775875.904311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775875/real 1775775875] req@ffff8de1c5680380 x1862023612707712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775875.904320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612707712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775875.904325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775875.904328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775875.904331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775875.904334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775875.904345:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775875.904350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775875/real 1775775875] req@ffff8de1c5682a00 x1862023612707840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775875.904357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612707840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775875.904362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775875.904364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775875.904366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775875.904369:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775875.904379:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775875.904393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775875/real 1775775875] req@ffff8de1c5681f80 x1862023612707968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775875.904402:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612707968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775875.904408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775875.904410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775875.904412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612707968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775875.904415:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775875.904427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775875.904433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775875/real 1775775875] req@ffff8de1c5681c00 x1862023612708096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775875.904440:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612708096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775875.904445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775875.904447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775875.904448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775876.864023:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775877.887967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775878.911971:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775879.935868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775880.959969:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775881.023859:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775881.023873:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775881.023879:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775881.023898:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11852 00000100:00080000:3.0:1775775881.023911:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775881.023918:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775881.023970:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612708224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775881.024000:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775881.024004:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775881.024005:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775881.024009:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11852 00000100:00080000:3.0:1775775881.024013:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775881.024017:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775881.024028:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775881.024042:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612708352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775881.024050:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612708224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775881.024081:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775881.024085:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775881.024087:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775881.024093:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11852 00000100:00080000:3.0:1775775881.024098:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775881.024102:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775881.024109:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775881.024124:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612708480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775881.024135:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775881.024138:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775881.024140:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775881.024144:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11852 00000800:00000100:1.0:1775775881.024149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775881.024151:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775881.024156:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775881.024160:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775881.024171:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612708608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775881.024183:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775881.024186:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775881.024188:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775881.024192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775881/real 1775775881] req@ffff8de1c7af7480 x1862023612708224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775881.024192:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11852 00000100:00080000:3.0:1775775881.024197:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775881.024204:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775881.024210:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775881.024219:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612708736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775881.024223:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612708224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775881.024247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775881.024260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775881.024265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612708224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775881.024292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775881.024309:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775881.024318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775881/real 1775775881] req@ffff8de1c7af7b80 x1862023612708352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775881.024327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612708352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775881.024332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775881.024335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775881.024337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775881.024341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775881.024351:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775881.024356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775881/real 1775775881] req@ffff8de1c7af5c00 x1862023612708480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775881.024364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612708480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775881.024369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775881.024371:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775881.024373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775881.024378:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775881.024388:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775881.024394:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775881/real 1775775881] req@ffff8de1c7af6d80 x1862023612708608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775881.024401:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612708608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775881.024406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775881.024408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775881.024410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775881.024413:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775881.024422:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775881.024429:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775881/real 1775775881] req@ffff8de1c7af4e00 x1862023612708736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775881.024440:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612708736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775881.024448:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775881.024451:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775881.024455:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775881.983906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775883.007940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775884.031905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775885.055917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775886.079946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775886.143881:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775886.143891:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775886.143896:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775886.143906:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11857 00000100:00080000:0.0:1775775886.143921:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775886.143928:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775886.144007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612708864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775886.144042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775886.144045:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775886.144047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775886.144051:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11857 00000100:00080000:0.0:1775775886.144055:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775886.144058:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775886.144068:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775886.144080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612708992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775886.144089:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775886.144092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775886.144095:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775886.144096:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612708864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775886.144099:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11857 00000100:00080000:0.0:1775775886.144104:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775886.144108:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775886.144111:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775886.144119:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612709120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775886.144125:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775886.144128:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775886.144129:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775886.144132:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11857 00000100:00080000:0.0:1775775886.144134:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775886.144136:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775886.144140:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775886.144147:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612709248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775886.144162:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775886.144165:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775886.144167:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775886.144170:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11857 00000100:00080000:0.0:1775775886.144174:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775775886.144180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775886.144182:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775886.144190:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775886.144204:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612709376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775886.144231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775886/real 1775775886] req@ffff8de1c5682680 x1862023612708864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775886.144250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612708864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775886.144259:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775886.144263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775886.144266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612708864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775886.144291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775886.144309:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775886.144318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775886/real 1775775886] req@ffff8de1c5682300 x1862023612708992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775886.144327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612708992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775886.144333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775886.144335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775886.144337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612708992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775886.144341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775886.144352:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775886.144357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775886/real 1775775886] req@ffff8de1c5680700 x1862023612709120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775886.144364:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612709120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775886.144374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775886.144376:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775886.144378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775886.144381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775886.144391:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775886.144396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775886/real 1775775886] req@ffff8de1c5682d80 x1862023612709248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775886.144403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612709248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775886.144408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775886.144410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775886.144412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775886.144415:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775886.144424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775886.144429:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775886/real 1775775886] req@ffff8de1c5683b80 x1862023612709376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775886.144435:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612709376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775886.144439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775886.144441:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775886.144445:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775887.103974:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775888.127915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775889.151880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775890.175876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775891.199868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775891.263901:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775891.263911:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775891.263917:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775891.263927:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11863 00000100:00080000:3.0:1775775891.263941:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775891.263948:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775891.263992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612709504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775891.264024:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775891.264028:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775891.264029:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775891.264033:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11863 00000100:00080000:3.0:1775775891.264039:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775891.264042:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775891.264053:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775891.264065:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612709632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775891.264074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775891.264078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775775891.264079:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612709504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775775891.264080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775891.264087:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11863 00000100:00080000:3.0:1775775891.264090:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775891.264092:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775891.264095:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775891.264103:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612709760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775891.264110:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775891.264113:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775891.264114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775891.264117:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11863 00000100:00080000:3.0:1775775891.264119:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775891.264121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775891.264124:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775891.264131:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612709888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775891.264137:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775891.264139:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775891.264140:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775891.264143:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11863 00000100:00080000:3.0:1775775891.264146:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775891.264148:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775891.264151:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775891.264157:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612710016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775891.264166:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775891.264209:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775891/real 1775775891] req@ffff8de1c7af5500 x1862023612709504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775891.264227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612709504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775891.264248:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775891.264252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775891.264255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612709504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775891.264281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775891.264300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775891.264309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775891/real 1775775891] req@ffff8de1c7af5880 x1862023612709632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775891.264317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612709632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775891.264323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775891.264325:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775891.264328:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775891.264331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775891.264341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775891.264348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775891/real 1775775891] req@ffff8de1c7af4a80 x1862023612709760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775891.264356:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612709760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775891.264361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775891.264363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775891.264365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775891.264368:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775891.264379:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775891.264384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775891/real 1775775891] req@ffff8de1c7af5f80 x1862023612709888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775891.264392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612709888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775891.264397:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775891.264398:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775891.264400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612709888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775891.264404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775891.264417:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775891.264427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775891/real 1775775891] req@ffff8de1c7af7100 x1862023612710016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775891.264439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612710016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775891.264449:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775891.264452:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775891.264454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775892.223888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775893.247963:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775894.271982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775895.295953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775896.320011:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775896.383842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775896.383852:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775896.383857:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775896.383868:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11868 00000100:00080000:2.0:1775775896.383881:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775896.383888:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775896.383933:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612710144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775896.383961:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775896.383964:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775896.383965:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775896.383968:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11868 00000100:00080000:2.0:1775775896.383971:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775896.383975:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775896.383985:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775896.383994:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612710272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775896.384002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775896.384004:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775896.384005:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775896.384009:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11868 00000100:00080000:2.0:1775775896.384012:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775775896.384013:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612710144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775896.384015:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775896.384020:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775896.384030:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612710400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775896.384036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775896.384038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775896.384040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775896.384042:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11868 00000100:00080000:2.0:1775775896.384044:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775896.384046:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775896.384050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775896.384057:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612710528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775896.384063:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775896.384066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775896.384067:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775896.384070:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11868 00000100:00080000:2.0:1775775896.384073:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775896.384075:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775896.384077:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775896.384083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612710656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775896.384103:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775896.384148:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775896/real 1775775896] req@ffff8de1d0f2d500 x1862023612710144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775896.384181:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612710144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775896.384193:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775896.384198:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775896.384202:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612710144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775896.384232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775896.384256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775896.384265:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775896/real 1775775896] req@ffff8de1d0f2ca80 x1862023612710272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775896.384274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612710272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775896.384280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775896.384283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775896.384285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775896.384290:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775896.384302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775896.384308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775896/real 1775775896] req@ffff8de1d0f2e680 x1862023612710400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775896.384315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612710400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775896.384320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775896.384322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775896.384324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775896.384328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775896.384338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775896.384344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775896/real 1775775896] req@ffff8de1d0f2e300 x1862023612710528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775896.384351:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612710528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775896.384356:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775896.384358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775896.384360:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775896.384363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775896.384373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775896.384378:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775896/real 1775775896] req@ffff8de1d0f2df80 x1862023612710656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775896.384386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612710656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775896.384391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775896.384392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775896.384394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775897.343897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775898.367943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775899.391923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775900.415975:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775901.439913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775901.503888:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775901.503902:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775901.503908:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775901.503921:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11873 00000100:00080000:0.0:1775775901.503938:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775901.503947:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775901.503994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612710784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775901.504022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775901.504025:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775901.504027:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775901.504030:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11873 00000100:00080000:0.0:1775775901.504033:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775901.504036:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775901.504046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775901.504056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612710912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775901.504065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775901.504069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775901.504070:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775901.504070:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612710784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775901.504078:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11873 00000100:00080000:0.0:1775775901.504080:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775901.504082:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775901.504085:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775901.504093:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612711040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775901.504100:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775901.504103:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775901.504104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775901.504107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11873 00000100:00080000:0.0:1775775901.504109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775901.504111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775901.504114:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775901.504122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612711168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775901.504127:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775901.504129:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775901.504131:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775901.504135:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11873 00000100:00080000:0.0:1775775901.504139:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775901.504142:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775901.504148:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775901.504154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775775901.504175:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612711296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775901.504210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775901/real 1775775901] req@ffff8de1c5683b80 x1862023612710784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775901.504235:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612710784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775901.504244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775901.504248:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775901.504251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612710784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775901.504277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775901.504297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775901.504306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775901/real 1775775901] req@ffff8de1c5682d80 x1862023612710912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775901.504314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612710912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775901.504324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775901.504326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775901.504329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612710912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775901.504332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775901.504343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775901.504348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775901/real 1775775901] req@ffff8de1c5680700 x1862023612711040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775901.504355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612711040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775901.504360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775901.504362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775901.504364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775901.504368:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775901.504378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775901.504383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775901/real 1775775901] req@ffff8de1c5682300 x1862023612711168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775901.504390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612711168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775901.504395:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775901.504397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775901.504400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775901.504404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775901.504414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775901.504430:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775901/real 1775775901] req@ffff8de1c5682680 x1862023612711296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775901.504443:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612711296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775901.504452:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775901.504455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775901.504459:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775902.463949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775903.487838:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775904.511951:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775905.535880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775906.559922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775906.623819:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775906.623830:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775906.623835:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775906.623845:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11878 00000100:00080000:0.0:1775775906.623856:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775906.623863:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775906.623894:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612711424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775906.623923:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775906.623926:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775906.623928:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775906.623931:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11878 00000100:00080000:0.0:1775775906.623934:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775906.623937:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775906.623944:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775906.623955:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612711552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775906.623967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775906.623969:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775906.623970:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775906.623973:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11878 00000100:00080000:0.0:1775775906.623976:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775906.623978:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612711424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775906.623981:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775906.623989:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775906.624000:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612711680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775906.624008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775906.624011:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775906.624012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775906.624016:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11878 00000100:00080000:0.0:1775775906.624020:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775906.624023:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775906.624026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775906.624034:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612711808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775906.624042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775775906.624046:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775906.624048:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775906.624050:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775906.624054:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11878 00000100:00080000:0.0:1775775906.624058:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775906.624062:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775906.624066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775906.624075:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612711936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775906.624081:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775906/real 1775775906] req@ffff8de1c5681c00 x1862023612711424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775906.624099:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612711424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775906.624108:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775906.624114:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775906.624118:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612711424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775906.624125:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775906.624145:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775906.624158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775906/real 1775775906] req@ffff8de1c5681f80 x1862023612711552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775906.624168:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612711552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775906.624174:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775906.624176:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775906.624180:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775906.624205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775906.624226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775906.624237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775906/real 1775775906] req@ffff8de1c5682a00 x1862023612711680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775906.624250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612711680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775906.624258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775906.624262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775906.624265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775906.624277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775906.624293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775906.624301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775906/real 1775775906] req@ffff8de1c5680380 x1862023612711808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775906.624308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612711808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775906.624313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775906.624315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775906.624318:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775906.624322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775906.624332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775906.624337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775906/real 1775775906] req@ffff8de1c5680000 x1862023612711936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775906.624344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612711936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775906.624349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775906.624352:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775906.624353:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612711936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775907.583849:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775908.607907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775909.631883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775910.655955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775911.679928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775911.743833:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775911.743848:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775911.743854:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775911.743868:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11883 00000100:00080000:0.0:1775775911.743883:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775911.743893:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775911.743946:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612712064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775911.743980:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775911.743985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775911.743986:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775911.743992:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11883 00000100:00080000:0.0:1775775911.743997:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775911.744002:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775911.744016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775911.744033:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612712064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775911.744034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612712192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775911.744054:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775911.744058:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775911.744060:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775911.744066:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11883 00000100:00080000:0.0:1775775911.744070:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775911.744075:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775911.744081:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775911.744095:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612712320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775911.744106:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775911.744110:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775911.744112:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775911.744117:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11883 00000100:00080000:0.0:1775775911.744121:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775911.744129:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775775911.744129:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775775911.744138:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775911.744151:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612712448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775911.744162:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775911.744167:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775911.744169:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775911.744175:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11883 00000100:00100000:2.0:1775775911.744175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775911/real 1775775911] req@ffff8de1c5680e00 x1862023612712064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775911.744183:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775911.744192:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775911.744201:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775911.744211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612712064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775775911.744217:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612712576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775911.744231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775911.744240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775911.744247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612712064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775911.744282:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775911.744310:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775911.744321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775911/real 1775775911] req@ffff8de1c5683480 x1862023612712192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775911.744330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612712192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775911.744336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775911.744338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775911.744340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775911.744345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775911.744356:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775911.744362:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775911/real 1775775911] req@ffff8de1c5683800 x1862023612712320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775911.744374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612712320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775911.744379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775911.744381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775911.744383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775911.744386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775911.744397:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775911.744402:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775911/real 1775775911] req@ffff8de1c5681500 x1862023612712448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775911.744410:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612712448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775911.744415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775911.744417:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775911.744419:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775911.744422:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775911.744431:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775911.744436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775911/real 1775775911] req@ffff8de1c5681880 x1862023612712576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775911.744443:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612712576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775911.744452:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775911.744454:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775911.744456:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775912.703927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775913.727950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775914.751969:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775915.775893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775916.799952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775916.863906:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775916.863919:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775916.863925:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775916.863938:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11888 00000100:00080000:1.0:1775775916.863955:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775916.863964:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775916.864013:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612712704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775916.864051:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775916.864054:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775916.864057:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775916.864062:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11888 00000100:00080000:1.0:1775775916.864065:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775916.864070:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775916.864082:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775916.864093:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612712832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775916.864106:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775916.864110:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775916.864112:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775916.864116:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11888 00000100:00080000:1.0:1775775916.864120:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775916.864124:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775916.864130:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775916.864146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612712960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775916.864148:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612712704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775916.864175:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775916.864179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775916.864181:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775916.864187:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11888 00000100:00080000:1.0:1775775916.864191:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775916.864195:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775916.864200:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775916.864210:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612713088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775916.864217:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775916.864221:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775916.864222:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775916.864225:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11888 00000100:00080000:1.0:1775775916.864227:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775916.864229:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775916.864232:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775916.864235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775916.864247:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612713216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775916.864281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775916/real 1775775916] req@ffff8de1c2e15500 x1862023612712704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775916.864297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612712704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775916.864305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775916.864310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775916.864314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612712704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775916.864323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775916.864349:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775916.864363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775916/real 1775775916] req@ffff8de1c2e17800 x1862023612712832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775916.864377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612712832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775916.864386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775916.864390:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775916.864394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775916.864421:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775916.864462:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775916.864480:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775916/real 1775775916] req@ffff8de1c2e14a80 x1862023612712960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775916.864493:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612712960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775916.864502:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775916.864506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775916.864509:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612712960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775916.864516:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775916.864535:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775916.864545:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775916/real 1775775916] req@ffff8de1c2e17480 x1862023612713088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775916.864558:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612713088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775916.864566:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775916.864570:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775916.864574:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775916.864581:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775916.864604:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775916.864615:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775916/real 1775775916] req@ffff8de1c2e14700 x1862023612713216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775916.864627:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612713216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775916.864635:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775916.864638:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775916.864641:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775917.823888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775918.847887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775919.871915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775920.895925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775921.919959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775775921.983831:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775921.983842:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775775921.983847:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775921.983859:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11893 00000100:00080000:3.0:1775775921.983874:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775921.983882:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775775921.983928:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612713344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775921.983956:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775921.983959:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775775921.983961:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775921.983966:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11893 00000100:00080000:3.0:1775775921.983970:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775921.983974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775921.983985:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775921.983989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612713344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775775921.984000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612713472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775775921.984018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775921.984021:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775775921.984023:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775921.984027:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11893 00000100:00080000:3.0:1775775921.984030:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775921.984040:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775921.984044:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775775921.984054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612713600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775921.984063:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775775921.984065:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775921.984069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775775921.984071:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775921.984075:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11893 00000100:00080000:3.0:1775775921.984079:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775775921.984083:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775921.984088:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775775921.984098:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612713728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775921.984104:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775921/real 1775775921] req@ffff8de1c7af7800 x1862023612713344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775921.984110:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775775921.984118:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775775921.984120:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775775921.984125:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11893 00000100:00080000:3.0:1775775921.984129:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775775921.984131:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612713344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775775921.984135:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775775921.984142:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775921.984146:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775775921.984152:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612713856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775921.984155:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775921.984164:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612713344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775921.984194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775921.984215:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775921.984224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775921/real 1775775921] req@ffff8de1c7af5180 x1862023612713472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775921.984232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612713472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775921.984237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775921.984239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775921.984241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775921.984245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775921.984254:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775921.984259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775921/real 1775775921] req@ffff8de1c7af4380 x1862023612713600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775921.984265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612713600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775921.984270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775921.984271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775921.984273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775921.984276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775921.984285:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775921.984290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775921/real 1775775921] req@ffff8de1c7af7100 x1862023612713728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775921.984297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612713728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775921.984301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775921.984303:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775921.984304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775921.984307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775921.984316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775921.984320:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775921/real 1775775921] req@ffff8de1c7af5f80 x1862023612713856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775921.984326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612713856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775921.984331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775921.984332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775921.984334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612713856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775922.943944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775923.967947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775924.991935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775926.015932:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775927.039895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775927.103905:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775927.103914:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775927.103919:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775927.103931:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11898 00000100:00080000:0.0:1775775927.103946:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775927.103955:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775927.104016:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612713984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775927.104048:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775927.104052:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775927.104054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775927.104060:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11898 00000100:00080000:0.0:1775775927.104064:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775927.104068:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775927.104080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775927.104094:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612714112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775927.104111:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775927.104114:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775927.104117:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775775927.104119:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612713984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775927.104121:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11898 00000100:00080000:0.0:1775775927.104129:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775927.104134:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775927.104139:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775927.104153:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612714240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775927.104172:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775927.104176:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775927.104177:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775927.104180:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11898 00000100:00080000:0.0:1775775927.104184:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775927.104187:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775927.104192:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775927.104203:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612714368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775775927.104204:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775927.104212:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775927.104215:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775927.104216:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775927.104220:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11898 00000100:00080000:0.0:1775775927.104224:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775927.104227:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775927.104232:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775927.104242:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612714496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775927.104276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775927/real 1775775927] req@ffff8de1c5681880 x1862023612713984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775927.104302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612713984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775927.104313:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775927.104318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775927.104322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612713984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775927.104349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775927.104374:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775927.104387:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775927/real 1775775927] req@ffff8de1c5681500 x1862023612714112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775927.104398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612714112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775927.104406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775927.104409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775927.104412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775927.104418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775927.104438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775927.104448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775927/real 1775775927] req@ffff8de1c5683800 x1862023612714240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775927.104459:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612714240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775927.104472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775927.104475:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775927.104478:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775927.104484:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775927.104504:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775927.104514:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775927/real 1775775927] req@ffff8de1c5683480 x1862023612714368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775927.104524:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612714368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775927.104532:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775927.104534:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775927.104536:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775927.104540:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775927.104553:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775927.104559:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775927/real 1775775927] req@ffff8de1c5680e00 x1862023612714496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775927.104566:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612714496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775927.104571:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775927.104573:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775927.104575:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775928.063943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775929.087885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775930.111958:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775931.135886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775932.159919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775932.223855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775932.223867:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775932.223872:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775932.223884:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11903 00000100:00080000:2.0:1775775932.223899:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775932.223908:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775932.223960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612714624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775932.224005:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775932.224009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775932.224011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775932.224016:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11903 00000100:00080000:2.0:1775775932.224019:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775932.224022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775932.224033:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775932.224047:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612714752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775932.224058:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775932.224062:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775932.224064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775932.224071:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11903 00000100:00100000:1.0:1775775932.224072:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612714624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775932.224075:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775932.224081:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775932.224086:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775932.224098:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612714880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775932.224106:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775932.224108:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775932.224110:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775932.224112:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11903 00000100:00080000:2.0:1775775932.224116:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775932.224118:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775932.224121:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775932.224127:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612715008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775932.224133:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775932.224135:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775932.224137:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775932.224138:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11903 00000100:00080000:2.0:1775775932.224140:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775932.224142:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775932.224145:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775932.224151:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612715136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775932.224187:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775932.224223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775932.224235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775932.224247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775933.183866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775934.207914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775935.231849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775775935.296197:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775775935.296263:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775775935.296287:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775935.296332:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775935.296346:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775775935.296352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775932/real 1775775935] req@ffff8de1d0f2f100 x1862023612714624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000100:2.0:1775775935.296361:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775775935.296375:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775775935.296392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612714624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775935.296406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775935.296412:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775935.296416:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612714624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775935.296423:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775932/real 1775775935] req@ffff8de1d0f2c700 x1862023612714752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775935.296437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612714752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775935.296443:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775935.296447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775935.296449:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775935.296475:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775932/real 1775775935] req@ffff8de1d0f2df80 x1862023612714880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775935.296485:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612714880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775935.296491:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775935.296494:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775935.296497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612714880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775935.296503:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775932/real 1775775935] req@ffff8de1d0f2e300 x1862023612715008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775935.296514:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612715008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775935.296520:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775935.296524:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775935.296526:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775935.296532:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775932/real 1775775935] req@ffff8de1d0f2e680 x1862023612715136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775935.296544:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612715136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775935.296552:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775935.296554:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775935.296557:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775936.255870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775937.279890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775937.343889:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775937.343903:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775937.343908:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775937.343921:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11909 00000100:00080000:1.0:1775775937.343933:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775937.343940:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775937.343986:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612715264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775937.344020:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775937.344024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775937.344026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775937.344031:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11909 00000100:00080000:1.0:1775775937.344034:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775937.344038:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775937.344051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775937.344066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612715392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775937.344092:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612715264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775937.344095:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775937.344101:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775937.344103:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775937.344108:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11909 00000100:00080000:1.0:1775775937.344111:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775937.344115:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775937.344119:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775937.344132:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612715520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775937.344141:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775937.344145:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775937.344147:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775937.344151:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11909 00000100:00080000:1.0:1775775937.344155:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775937.344158:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775937.344163:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775937.344173:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612715648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775937.344182:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775937.344185:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775937.344186:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775937.344189:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11909 00000100:00080000:1.0:1775775937.344195:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775775937.344196:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775937.344202:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775937.344207:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775937.344217:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612715776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775937.344249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775937/real 1775775937] req@ffff8de1c2e14e00 x1862023612715264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775937.344269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612715264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775937.344280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775937.344284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775937.344288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612715264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775937.344318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775937.344343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775937.344355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775937/real 1775775937] req@ffff8de1c2e14700 x1862023612715392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775937.344373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612715392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775937.344381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775937.344384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775937.344387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775937.344392:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775937.344418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775937.344429:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775937/real 1775775937] req@ffff8de1c2e17480 x1862023612715520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775937.344441:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612715520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775937.344448:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775937.344451:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775937.344454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775937.344461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775937.344483:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775937.344492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775937/real 1775775937] req@ffff8de1c2e14a80 x1862023612715648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775937.344503:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612715648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775937.344516:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775937.344519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775937.344522:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775937.344527:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775937.344552:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775937.344574:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775937/real 1775775937] req@ffff8de1c2e17800 x1862023612715776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775937.344587:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612715776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775937.344595:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775937.344598:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775937.344600:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612715776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775938.303839:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775939.327906:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775940.351906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775941.375908:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775942.399857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775942.463843:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775942.463851:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775942.463856:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775942.463866:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11914 00000100:00080000:1.0:1775775942.463877:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775942.463884:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775942.463918:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612715904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775942.463941:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775942.463944:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775942.463946:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775942.463950:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11914 00000100:00080000:1.0:1775775942.463953:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775942.463956:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775942.463965:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775942.463996:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612715904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775942.463997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612716032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775942.464014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775942.464017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775942.464019:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775942.464022:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11914 00000100:00080000:1.0:1775775942.464026:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775942.464029:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775942.464033:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775942.464044:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612716160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775942.464051:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775942.464054:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775942.464056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775942.464059:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11914 00000100:00080000:1.0:1775775942.464061:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775942.464063:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775942.464067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775775942.464068:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775942.464076:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612716288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775942.464083:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775942.464086:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775775942.464087:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775942.464090:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11914 00000100:00080000:1.0:1775775942.464092:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775942.464094:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775942.464098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775942.464106:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775942/real 1775775942] req@ffff8de1c2e15500 x1862023612715904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775942.464108:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612716416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775942.464147:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612715904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775942.464165:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775942.464170:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775942.464175:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612715904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775942.464200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775942.464232:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775942.464248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775942/real 1775775942] req@ffff8de1c2e17b80 x1862023612716032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775942.464262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612716032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775942.464271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775942.464275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775942.464281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775942.464289:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775942.464316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775942.464332:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775942/real 1775775942] req@ffff8de1c2e16680 x1862023612716160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775942.464344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612716160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775942.464354:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775942.464358:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775942.464363:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775942.464370:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775942.464392:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775942.464403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775942/real 1775775942] req@ffff8de1c2e14380 x1862023612716288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775942.464417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612716288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775942.464426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775942.464430:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775942.464435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775942.464442:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775942.464466:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775942.464484:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775942/real 1775775942] req@ffff8de1c2e17100 x1862023612716416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775942.464502:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612716416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775942.464513:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775942.464519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775942.464523:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775943.424001:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775944.447895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775945.471886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775946.495847:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775947.519972:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775947.583905:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775947.583914:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775947.583918:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775947.583927:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11919 00000100:00080000:2.0:1775775947.583937:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775947.583943:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775947.583974:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612716544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775947.584001:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775947.584003:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775947.584005:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775947.584007:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11919 00000100:00080000:2.0:1775775947.584009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775947.584012:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775947.584020:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775947.584028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612716672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775947.584038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775947.584040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775947.584041:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775947.584044:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11919 00000100:00080000:2.0:1775775947.584046:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775947.584054:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775947.584057:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775947.584058:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612716544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775947.584066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612716800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775947.584076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775947.584078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775947.584080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775947.584082:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11919 00000100:00080000:2.0:1775775947.584083:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775947.584086:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775947.584089:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775947.584097:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612716928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775947.584102:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775947.584104:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775947.584105:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775947.584107:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11919 00000100:00080000:2.0:1775775947.584112:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775947.584114:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775947.584119:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775947.584127:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612717056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775947.584165:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775947.584204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775947/real 1775775947] req@ffff8de1d0f2ca80 x1862023612716544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775947.584221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612716544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775947.584229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775947.584233:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775947.584235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612716544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775947.584259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775947.584282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775947.584290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775947/real 1775775947] req@ffff8de1d0f2d500 x1862023612716672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775947.584298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612716672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775947.584303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775947.584305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775947.584307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775947.584310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775947.584322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775947.584327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775947/real 1775775947] req@ffff8de1d0f2e680 x1862023612716800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775947.584333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612716800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775947.584338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775947.584339:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775947.584341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775947.584345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775947.584355:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775947.584359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775947/real 1775775947] req@ffff8de1d0f2e300 x1862023612716928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775947.584366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612716928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775947.584370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775947.584372:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775947.584375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612716928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775947.584380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775947.584395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775947.584405:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775947/real 1775775947] req@ffff8de1d0f2df80 x1862023612717056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775947.584424:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612717056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775947.584431:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775947.584434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775947.584436:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775948.543916:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775949.567991:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775950.591963:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775951.615940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775952.639962:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775952.703846:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775952.703857:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775952.703863:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775952.703875:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11924 00000100:00080000:1.0:1775775952.703890:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775952.703897:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775952.703942:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612717184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775952.703973:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775952.703976:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775952.703978:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775952.703983:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11924 00000100:00080000:1.0:1775775952.703986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775952.703990:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775952.704003:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775952.704007:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612717184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775952.704019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612717312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775952.704035:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775952.704039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775952.704040:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775952.704045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11924 00000100:00080000:1.0:1775775952.704048:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775952.704051:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775952.704055:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775952.704065:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612717440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775952.704074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775952.704077:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775952.704079:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775775952.704084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775952.704086:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11924 00000100:00080000:1.0:1775775952.704090:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775952.704094:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775952.704100:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775952.704109:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612717568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775952.704118:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775952.704123:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1775775952.704123:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775952/real 1775775952] req@ffff8de1c2e16a00 x1862023612717184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775952.704127:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775952.704136:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11924 00000100:00080000:1.0:1775775952.704140:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775952.704145:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775952.704146:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612717184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:1.0:1775775952.704150:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775775952.704157:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1775775952.704164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612717696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775952.704165:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775952.704171:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612717184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775952.704198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775952.704220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775952.704231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775952/real 1775775952] req@ffff8de1c2e17100 x1862023612717312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775952.704243:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612717312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775952.704251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775952.704255:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775952.704258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775952.704262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775952.704277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775952.704283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775952/real 1775775952] req@ffff8de1c2e14380 x1862023612717440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775952.704294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612717440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775952.704299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775952.704301:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775952.704303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775952.704306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775952.704319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775952.704327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775952/real 1775775952] req@ffff8de1c2e16680 x1862023612717568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775952.704339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612717568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775952.704346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775952.704349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775952.704353:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775952.704358:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775952.704373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775952.704379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775952/real 1775775952] req@ffff8de1c2e17b80 x1862023612717696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775952.704396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612717696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775952.704410:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775952.704413:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775952.704417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775953.663957:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775954.687949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775955.711965:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775956.735953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775957.759928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775775957.823862:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775957.823874:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775775957.823879:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775957.823897:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11929 00000100:00080000:1.0:1775775957.823912:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775957.823921:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775957.823968:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612717824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775957.823996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775957.823999:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775775957.824006:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775957.824009:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11929 00000100:00080000:1.0:1775775957.824012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775957.824016:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775957.824026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775957.824035:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612717952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775957.824042:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612717824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775775957.824044:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775957.824049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775775957.824050:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775957.824053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11929 00000100:00080000:1.0:1775775957.824055:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775957.824057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775957.824060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775957.824068:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612718080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775957.824075:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775957.824077:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775775957.824078:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775957.824081:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11929 00000100:00080000:1.0:1775775957.824083:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775957.824085:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775957.824089:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775957.824100:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612718208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775957.824108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775775957.824111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:2.0:1775775957.824115:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775775957.824116:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775775957.824121:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11929 00000100:00080000:1.0:1775775957.824137:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775775957.824141:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775775957.824147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775957.824154:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775957/real 1775775957] req@ffff8de1c2e15500 x1862023612717824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775957.824158:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612718336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775957.824183:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612717824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775957.824195:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775957.824201:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775957.824206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612717824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775957.824235:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775957.824259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775957.824272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775957/real 1775775957] req@ffff8de1c2e17800 x1862023612717952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775957.824283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612717952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775957.824289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775957.824292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775957.824294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612717952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775957.824298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775957.824312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775957.824318:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775957/real 1775775957] req@ffff8de1c2e14a80 x1862023612718080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775957.824325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612718080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775957.824330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775957.824333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775957.824334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775957.824337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775957.824346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775957.824351:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775957/real 1775775957] req@ffff8de1c2e17480 x1862023612718208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775957.824357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612718208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775957.824362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775957.824364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775957.824365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775957.824368:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775957.824377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775957.824382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775957/real 1775775957] req@ffff8de1c2e14700 x1862023612718336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775957.824388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612718336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775957.824393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775957.824394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775957.824396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775958.783949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775959.807895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775960.831864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775961.855920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775962.879978:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775962.943893:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775962.943907:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775962.943914:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775962.943926:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11934 00000100:00080000:0.0:1775775962.943941:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775962.943950:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775962.943997:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612718464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775962.944031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775962.944036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775962.944039:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775962.944044:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11934 00000100:00080000:0.0:1775775962.944047:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775962.944051:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775962.944063:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775962.944076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612718592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775962.944088:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775962.944091:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775962.944093:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775962.944100:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11934 00000100:00100000:2.0:1775775962.944102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612718464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775962.944103:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775962.944110:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775962.944115:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775962.944125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612718720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775962.944147:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775962.944151:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775962.944153:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775962.944157:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11934 00000100:00080000:0.0:1775775962.944161:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775962.944165:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775962.944171:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775962.944183:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612718848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775962.944192:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775962.944195:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775962.944197:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775775962.944203:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775962.944205:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11934 00000100:00080000:0.0:1775775962.944210:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775962.944214:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775962.944220:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775962.944233:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612718976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775775962.944259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775962/real 1775775962] req@ffff8de1c5680000 x1862023612718464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775962.944282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612718464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775962.944293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775962.944299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775962.944303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612718464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775962.944332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775962.944357:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775962.944370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775962/real 1775775962] req@ffff8de1c5680380 x1862023612718592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775962.944383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612718592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775962.944391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775962.944395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775962.944398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775962.944404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775775962.944425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775962.944435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775962/real 1775775962] req@ffff8de1c5682a00 x1862023612718720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775962.944447:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612718720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775962.944455:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775962.944459:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775962.944461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775775962.944467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775962.944486:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775962.944495:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775962/real 1775775962] req@ffff8de1c5681f80 x1862023612718848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775962.944513:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612718848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775962.944520:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775962.944524:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775962.944527:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775775962.944532:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775775962.944551:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775962.944561:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775962/real 1775775962] req@ffff8de1c5681c00 x1862023612718976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775962.944573:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612718976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775962.944581:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775775962.944585:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775962.944587:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612718976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775963.903919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775964.927913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775965.951936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775966.975935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775967.999880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775968.063831:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775968.063845:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775968.063851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775968.063864:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11939 00000100:00080000:2.0:1775775968.063879:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775968.063889:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775968.063937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612719104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775968.063971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775968.063975:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775968.063977:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775968.063983:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11939 00000100:00080000:2.0:1775775968.063987:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775968.063991:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775968.063999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612719104:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775775968.064005:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775968.064021:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612719232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775968.064032:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775968.064036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775968.064038:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775968.064042:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11939 00000100:00080000:2.0:1775775968.064046:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775968.064050:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775968.064055:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775968.064067:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612719360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775775968.064080:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775968.064089:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775968.064092:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775968.064094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775968.064098:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11939 00000100:00080000:2.0:1775775968.064101:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775968.064105:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775968.064110:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775968.064119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775968/real 1775775968] req@ffff8de1d0f2c700 x1862023612719104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775968.064120:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612719488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775968.064147:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775968.064151:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775968.064152:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775968.064158:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612719104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775968.064158:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11939 00000100:00080000:2.0:1775775968.064164:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775968.064170:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775968.064177:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775775968.064178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775968.064187:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775968.064192:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612719104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775968.064194:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612719616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775968.064225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775968.064243:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775968.064251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775968/real 1775775968] req@ffff8de1d0f2f100 x1862023612719232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775968.064259:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612719232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775968.064265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775968.064267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775968.064269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775968.064272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775968.064283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775968.064291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775968/real 1775775968] req@ffff8de1d0f2df80 x1862023612719360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775968.064302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612719360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775968.064309:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775968.064312:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775968.064315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775968.064322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775968.064341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775968.064348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775968/real 1775775968] req@ffff8de1d0f2e300 x1862023612719488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775968.064355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612719488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775968.064360:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775968.064363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775968.064366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775968.064372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775968.064388:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775968.064398:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775968/real 1775775968] req@ffff8de1d0f2e680 x1862023612719616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775968.064416:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612719616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775968.064422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775968.064424:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775968.064426:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775969.023936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775970.047863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775971.071911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775972.095933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775973.119896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775973.183829:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775973.183843:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775973.183848:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775973.183862:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11944 00000100:00080000:2.0:1775775973.183877:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775973.183886:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775973.183932:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612719744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775973.183967:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775973.183971:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775973.183973:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775973.183977:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11944 00000100:00080000:2.0:1775775973.183980:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775973.183984:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775973.183996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775973.184010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612719872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775973.184015:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612719744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775775973.184027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775973.184030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775973.184032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775973.184037:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11944 00000100:00080000:2.0:1775775973.184042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775973.184045:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775973.184050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775973.184066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612720000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775973.184074:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775973.184077:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775973.184079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775973.184082:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11944 00000100:00080000:2.0:1775775973.184086:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775775973.184088:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775973.184093:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775973.184099:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775973.184110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612720128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775973.184119:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775973.184123:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775973.184124:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775973.184128:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775973/real 1775775973] req@ffff8de1d0f2d500 x1862023612719744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775973.184131:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11944 00000100:00080000:2.0:1775775973.184138:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775973.184142:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775973.184148:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775973.184150:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612719744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775973.184160:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775775973.184161:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612720256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775973.184167:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775973.184171:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612719744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775973.184194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775973.184211:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775973.184219:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775973/real 1775775973] req@ffff8de1d0f2ca80 x1862023612719872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775973.184226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612719872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775973.184235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775973.184237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775973.184239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612719872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775973.184242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775973.184252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775973.184256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775973/real 1775775973] req@ffff8de1d0f2e680 x1862023612720000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775973.184262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612720000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775973.184267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775973.184269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775973.184270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775973.184273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775973.184288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775973.184296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775973/real 1775775973] req@ffff8de1d0f2e300 x1862023612720128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775973.184308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612720128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775973.184315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775973.184319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775973.184322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775973.184328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775973.184344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775973.184350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775973/real 1775775973] req@ffff8de1d0f2df80 x1862023612720256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775973.184357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612720256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775775998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775973.184361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775973.184363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775973.184365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775974.143973:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775975.167898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775976.191924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775977.215888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775978.239936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775978.303831:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775978.303841:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775978.303846:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775978.303856:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11950 00000100:00080000:2.0:1775775978.303868:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775978.303875:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775978.303914:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612720384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775978.303936:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775978.303939:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775978.303941:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775978.303944:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11950 00000100:00080000:2.0:1775775978.303946:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775978.303949:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775978.303964:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775978.303969:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612720384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775978.303980:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612720512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775978.303993:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775978.303997:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775978.303999:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775978.304004:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11950 00000100:00080000:2.0:1775775978.304009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775978.304016:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775978.304025:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775978.304038:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612720640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775978.304047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775978.304051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775978.304052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775978.304058:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11950 00000800:00000100:1.0:1775775978.304059:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775978.304064:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775978.304069:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775978.304074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775978.304093:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612720768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775978.304099:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775978/real 1775775978] req@ffff8de1d0f2f100 x1862023612720384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775978.304110:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775978.304114:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775978.304117:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775978.304121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612720384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775978.304123:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11950 00000100:00080000:2.0:1775775978.304129:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775978.304132:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775978.304143:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775775978.304144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775978.304152:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775775978.304156:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612720896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775978.304159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612720384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775978.304194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775978.304214:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775978.304223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775978/real 1775775978] req@ffff8de1d0f2c700 x1862023612720512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775978.304239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612720512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775978.304244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775978.304246:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775978.304248:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775978.304252:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775978.304263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775978.304269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775978/real 1775775978] req@ffff8de1d0f2df80 x1862023612720640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775978.304276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612720640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775978.304281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775978.304282:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775978.304284:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775978.304287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775978.304297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775978.304304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775978/real 1775775978] req@ffff8de1d0f2e300 x1862023612720768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775978.304311:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612720768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775978.304316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775978.304319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775978.304321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775978.304324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775978.304335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775978.304340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775978/real 1775775978] req@ffff8de1d0f2e680 x1862023612720896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775978.304347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612720896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775978.304351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775978.304354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775978.304372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612720896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775979.263872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775980.287988:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775981.311958:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775982.335983:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775983.359920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775983.423858:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775983.423868:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775983.423872:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775983.423884:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11955 00000100:00080000:0.0:1775775983.423900:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775983.423908:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775983.423954:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612721024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775983.423982:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775983.423985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775983.423987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775983.423993:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11955 00000100:00080000:0.0:1775775983.423997:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775983.424001:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775983.424012:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775983.424012:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612721024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775775983.424028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612721152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775983.424038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775983.424041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775983.424042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775983.424046:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11955 00000100:00080000:0.0:1775775983.424049:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775983.424053:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775983.424058:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775983.424067:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612721280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775983.424075:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775983.424078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775983.424080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775775983.424084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775775983.424087:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11955 00000100:00080000:0.0:1775775983.424091:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775983.424095:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775983.424100:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775983.424115:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612721408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775983.424125:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775775983.424128:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775983/real 1775775983] req@ffff8de1c5682680 x1862023612721024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775983.424135:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775983.424138:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775983.424147:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11955 00000100:00100000:1.0:1775775983.424147:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612721024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775775983.424153:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775983.424160:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775983.424166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775775983.424169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775983.424175:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775775983.424180:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612721536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775983.424183:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612721024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775983.424218:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775983.424241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775983.424253:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775983/real 1775775983] req@ffff8de1c5682300 x1862023612721152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775983.424265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612721152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775983.424286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775983.424290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775983.424293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775983.424300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775983.424318:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775983.424328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775983/real 1775775983] req@ffff8de1c5680700 x1862023612721280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775983.424340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612721280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775983.424348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775983.424351:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775983.424354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775983.424359:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775983.424378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775983.424387:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775983/real 1775775983] req@ffff8de1c5682d80 x1862023612721408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775983.424399:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612721408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775983.424407:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775983.424410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775983.424413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775983.424419:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775983.424435:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775983.424444:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775983/real 1775775983] req@ffff8de1c5683b80 x1862023612721536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775983.424455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612721536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775983.424463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775983.424466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775983.424469:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775984.383942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775985.407876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775986.431943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775987.455850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775988.479932:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775988.543911:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775988.543925:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775988.543939:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775988.543951:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11960 00000100:00080000:2.0:1775775988.543967:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775988.543976:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775988.544025:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612721664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775988.544056:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775988.544060:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775988.544062:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775988.544066:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11960 00000100:00080000:2.0:1775775988.544069:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775988.544074:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775988.544086:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775988.544102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612721664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775988.544102:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612721792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775988.544118:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775988.544120:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775988.544122:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775988.544127:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11960 00000100:00080000:2.0:1775775988.544131:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775988.544135:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775988.544140:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775988.544152:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612721920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775988.544161:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775988.544165:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775988.544166:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775988.544170:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11960 00000100:00080000:2.0:1775775988.544174:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775775988.544191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775775988.544206:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775988.544212:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775988.544225:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612722048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775988.544234:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775988.544237:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775988.544239:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775775988.544241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775988/real 1775775988] req@ffff8de1d0f2ca80 x1862023612721664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775775988.544246:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11960 00000100:00080000:2.0:1775775988.544252:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775988.544258:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775988.544263:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775775988.544268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612721664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775775988.544276:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612722176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775775988.544307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775988.544311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775988.544315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612721664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775988.544346:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775988.544363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775988.544372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775988/real 1775775988] req@ffff8de1d0f2d500 x1862023612721792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775988.544380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612721792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775988.544385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775988.544387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775988.544389:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775988.544393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775988.544403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775988.544407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775988/real 1775775988] req@ffff8de1d0f2e680 x1862023612721920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775988.544414:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612721920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775988.544419:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775988.544421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775988.544422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612721920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775988.544426:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775988.544436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775988.544440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775988/real 1775775988] req@ffff8de1d0f2e300 x1862023612722048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775988.544447:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612722048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775988.544451:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775988.544453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775988.544454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775988.544458:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775988.544467:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775988.544471:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775988/real 1775775988] req@ffff8de1d0f2df80 x1862023612722176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775988.544477:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612722176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775988.544482:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775988.544483:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775988.544485:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775989.503979:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775990.527956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775991.551941:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775992.575936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775993.599961:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775775993.663874:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775993.663887:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775775993.663893:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775993.663906:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11965 00000100:00080000:2.0:1775775993.663921:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775993.663930:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775775993.663982:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612722304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775993.664009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775993.664013:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775775993.664015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775993.664020:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11965 00000100:00080000:2.0:1775775993.664023:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775993.664028:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775993.664041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775775993.664047:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612722304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775775993.664057:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612722432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775993.664068:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775993.664072:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775775993.664073:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775993.664078:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11965 00000100:00080000:2.0:1775775993.664082:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775993.664086:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775993.664110:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775775993.664125:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612722560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775993.664134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775993.664137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775775993.664139:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775993.664143:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11965 00000100:00080000:2.0:1775775993.664148:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775993.664151:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775775993.664157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775775993.664164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775775993.664169:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612722688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775775993.664191:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775775993.664195:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775775993.664197:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775775993.664202:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11965 00000100:00080000:2.0:1775775993.664206:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775775993.664210:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775993.664215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775993/real 1775775993] req@ffff8de1d0f2c700 x1862023612722304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775775993.664217:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775775993.664232:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612722816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775993.664245:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612722304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775993.664258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775993.664263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775993.664267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612722304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775775993.664294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775993.664316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775993.664327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775993/real 1775775993] req@ffff8de1d0f2f100 x1862023612722432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775993.664339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612722432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775993.664346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775993.664349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775993.664352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775993.664357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775775993.664373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775993.664382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775993/real 1775775993] req@ffff8de1d0f2df80 x1862023612722560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775993.664394:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612722560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775993.664406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775993.664409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775993.664412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775775993.664418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775993.664435:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775993.664445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775993/real 1775775993] req@ffff8de1d0f2e300 x1862023612722688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775993.664455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612722688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775993.664461:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775993.664464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775993.664467:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775993.664473:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775775993.664490:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775775993.664497:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775993/real 1775775993] req@ffff8de1d0f2e680 x1862023612722816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775775993.664506:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612722816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775775993.664514:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775775993.664516:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775775993.664520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612722816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775775994.623884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775995.647867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775996.671885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775775997.695919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775775998.719876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775775998.783870:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775998.783882:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775775998.783887:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775998.783900:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11970 00000100:00080000:0.0:1775775998.783917:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775998.783924:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775775998.783976:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612722944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775998.784027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775998.784032:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775775998.784034:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775998.784038:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11970 00000100:00080000:0.0:1775775998.784042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775998.784046:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775998.784059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775998.784073:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612723072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775998.784080:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612722944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775775998.784089:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775998.784093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775775998.784094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775998.784099:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11970 00000100:00080000:0.0:1775775998.784103:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775998.784107:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775998.784112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775775998.784131:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612723200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775775998.784142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775998.784145:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775775998.784146:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775998.784150:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11970 00000100:00080000:0.0:1775775998.784155:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775998.784160:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775775998.784166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775998.784179:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612723328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775998.784192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723072:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775775998.784204:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775775998.784208:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775775998.784210:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775775998.784215:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11970 00000100:00080000:0.0:1775775998.784220:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775775998.784224:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775775998.784228:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723200:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775775998.784230:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775775998.784253:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612723456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775775998.784255:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775775998.784278:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775775999.743936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776000.767852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776001.791869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776001.856011:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776001.856049:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776001.856062:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776001.856094:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776001.856104:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776001.856113:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776001.856124:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775776001.856142:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775998/real 1775776001] req@ffff8de1c5682680 x1862023612723456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776001.856164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612723456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776001.856176:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776001.856181:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776001.856186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723456:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776001.856194:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775998/real 1775776001] req@ffff8de1c5682300 x1862023612723328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776001.856207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612723328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776001.856215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776001.856217:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776001.856221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776001.856228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775998/real 1775776001] req@ffff8de1c5682d80 x1862023612723072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776001.856241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612723072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776001.856249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776001.856253:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776001.856256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776001.856263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775998/real 1775776001] req@ffff8de1c5680700 x1862023612723200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776001.856282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612723200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776001.856290:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776001.856294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776001.856297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776001.856303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775775998/real 1775776001] req@ffff8de1c5683b80 x1862023612722944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776001.856315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612722944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776001.856323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776001.856326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776001.856330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612722944:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775776002.815835:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776003.839900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776003.903938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776003.903952:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776003.903957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776003.903970:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11975 00000100:00080000:2.0:1775776003.903986:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776003.903995:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776003.904043:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612723584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776003.904079:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776003.904083:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776003.904085:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776003.904089:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11975 00000100:00080000:2.0:1775776003.904093:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776003.904097:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776003.904108:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776003.904122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612723712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776003.904133:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776003.904136:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776003.904138:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776003.904142:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11975 00000100:00080000:2.0:1775776003.904145:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776003.904149:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776003.904154:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776003.904164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612723840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776003.904174:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776003.904178:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776003.904179:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776003.904183:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11975 00000100:00080000:2.0:1775776003.904186:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776003.904190:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776003.904195:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776003.904205:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612723968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776003.904214:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776003.904218:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776003.904220:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776003.904225:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11975 00000100:00080000:2.0:1775776003.904229:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776003.904234:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776003.904240:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776003.904245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612723584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776003.904254:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612724096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776003.904338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776003.904381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776003/real 1775776003] req@ffff8de1d0f2d500 x1862023612723584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776003.904404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612723584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776003.904416:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776003.904420:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776003.904424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612723584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776003.904432:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776003.904468:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776003.904481:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776003/real 1775776003] req@ffff8de1d0f2ca80 x1862023612723712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776003.904493:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612723712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776003.904502:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776003.904506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776003.904510:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776003.904516:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776003.904537:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776003.904556:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776003/real 1775776003] req@ffff8de1d0f2e680 x1862023612723840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776003.904569:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612723840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776003.904577:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776003.904581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776003.904584:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776003.904590:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776003.904613:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776003.904627:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776003/real 1775776003] req@ffff8de1d0f2e300 x1862023612723968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776003.904639:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612723968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776003.904647:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776003.904650:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776003.904654:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612723968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776003.904694:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776003.904716:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776003.904775:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776003/real 1775776003] req@ffff8de1d0f2df80 x1862023612724096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776003.904788:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612724096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776003.904804:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776003.904807:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776003.904811:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776004.863938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776005.887922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776006.911910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776007.935952:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776008.959974:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776009.023911:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776009.023923:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776009.023928:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776009.023939:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11980 00000100:00080000:2.0:1775776009.023953:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776009.023960:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776009.024014:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612724224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776009.024049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776009.024054:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776009.024056:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776009.024061:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11980 00000100:00080000:2.0:1775776009.024066:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776009.024070:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776009.024083:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776009.024102:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612724224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776009.024102:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612724352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776009.024126:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776009.024128:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776009.024130:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776009.024133:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11980 00000100:00080000:2.0:1775776009.024137:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776009.024139:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776009.024144:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776009.024164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612724480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776009.024171:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776009.024174:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776009.024175:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776009.024178:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11980 00000100:00080000:2.0:1775776009.024181:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776009.024184:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776009.024188:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776009.024195:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612724608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776009.024202:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776009.024207:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:1.0:1775776009.024209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776009.024209:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776009.024215:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11980 00000100:00080000:2.0:1775776009.024218:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776009.024221:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776009.024224:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776009.024231:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612724736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776009.024264:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776009/real 1775776009] req@ffff8de1d0f2f100 x1862023612724224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776009.024287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612724224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776009.024299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776009.024304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776009.024309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612724224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776009.024335:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776009.024360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776009.024373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776009/real 1775776009] req@ffff8de1d0f2c700 x1862023612724352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776009.024385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612724352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776009.024393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776009.024396:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776009.024400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776009.024406:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776009.024424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776009.024434:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776009/real 1775776009] req@ffff8de1d0f2df80 x1862023612724480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776009.024446:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612724480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776009.024454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776009.024457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776009.024461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776009.024467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776009.024484:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776009.024493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776009/real 1775776009] req@ffff8de1d0f2e300 x1862023612724608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776009.024505:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612724608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776009.024513:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776009.024516:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776009.024520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776009.024526:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776009.024541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776009.024551:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776009/real 1775776009] req@ffff8de1d0f2e680 x1862023612724736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776009.024563:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612724736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776009.024571:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776009.024574:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776009.024577:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776009.983940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776011.007907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776012.031947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776013.055952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776014.079914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776014.143882:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776014.143891:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776014.143895:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776014.143905:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11985 00000100:00080000:2.0:1775776014.143917:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776014.143923:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776014.143963:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612724864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776014.143996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776014.144001:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776014.144003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776014.144007:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11985 00000100:00080000:2.0:1775776014.144010:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776014.144014:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776014.144024:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776014.144035:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612724992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776014.144043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776014.144047:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776014.144048:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612724864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776014.144049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776014.144055:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11985 00000100:00080000:2.0:1775776014.144058:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776014.144060:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776014.144063:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776014.144073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612725120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776014.144079:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776014.144081:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776014.144083:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776014.144085:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11985 00000100:00080000:2.0:1775776014.144086:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776014.144089:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776014.144092:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776014.144097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612725248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776014.144102:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776014.144104:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776014.144106:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776014.144108:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11985 00000100:00080000:2.0:1775776014.144111:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776014.144113:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776014.144115:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776014.144122:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776014.144123:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612725376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776014.144171:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776014/real 1775776014] req@ffff8de1d0f2ca80 x1862023612724864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776014.144191:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612724864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776014.144199:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776014.144203:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776014.144207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612724864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776014.144233:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776014.144260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776014.144272:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776014/real 1775776014] req@ffff8de1d0f2d500 x1862023612724992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776014.144283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612724992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776014.144294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776014.144297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776014.144299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612724992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776014.144303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776014.144319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776014.144328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776014/real 1775776014] req@ffff8de1d0f2e680 x1862023612725120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776014.144337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612725120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776014.144342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776014.144345:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776014.144347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776014.144351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776014.144366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776014.144372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776014/real 1775776014] req@ffff8de1d0f2e300 x1862023612725248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776014.144382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612725248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776014.144389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776014.144392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776014.144396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776014.144402:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776014.144424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776014.144435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776014/real 1775776014] req@ffff8de1d0f2df80 x1862023612725376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776014.144445:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612725376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776014.144450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776014.144453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776014.144455:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776015.103939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776016.127919:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776017.151873:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776018.175930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776019.199922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776019.263869:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776019.263883:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776019.263888:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776019.263901:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11991 00000100:00080000:2.0:1775776019.263916:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776019.263924:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776019.263970:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612725504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776019.263999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776019.264004:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776019.264006:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776019.264011:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11991 00000100:00080000:2.0:1775776019.264015:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776019.264019:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776019.264024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612725504:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775776019.264032:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776019.264048:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612725632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776019.264076:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776019.264079:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776019.264081:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776019.264085:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11991 00000100:00080000:2.0:1775776019.264089:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776019.264093:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776019.264103:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775776019.264105:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776019.264119:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612725760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776019.264129:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776019.264133:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776019.264135:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776019.264139:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11991 00000100:00100000:1.0:1775776019.264144:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776019/real 1775776019] req@ffff8de1d0f2c700 x1862023612725504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776019.264144:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776019.264152:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776019.264159:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776019.264164:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612725504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776019.264173:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775776019.264173:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612725888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776019.264180:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776019.264186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612725504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776019.264192:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776019.264196:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776019.264198:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776019.264203:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11991 00000100:00080000:2.0:1775776019.264208:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776019.264213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725632:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775776019.264214:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776019.264221:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776019.264236:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612726016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776019.264244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776019.264259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776019/real 1775776019] req@ffff8de1d0f2f100 x1862023612725632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776019.264267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612725632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776019.264273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776019.264275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776019.264277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776019.264280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776019.264291:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776019.264296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776019/real 1775776019] req@ffff8de1d0f2df80 x1862023612725760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776019.264302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612725760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776019.264307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776019.264309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776019.264310:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776019.264313:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776019.264322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776019.264326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776019/real 1775776019] req@ffff8de1d0f2e300 x1862023612725888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776019.264332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612725888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776019.264337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776019.264338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776019.264340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612725888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776019.264349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776019.264357:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776019.264361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776019/real 1775776019] req@ffff8de1d0f2e680 x1862023612726016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776019.264367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612726016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776019.264372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776019.264373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776019.264374:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776020.223884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776021.247913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776022.271945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776023.295920:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776024.319905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776024.383849:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776024.383861:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776024.383867:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776024.383880:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 11996 00000100:00080000:0.0:1775776024.383894:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776024.383902:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776024.383949:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612726144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776024.383981:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776024.383985:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776024.383987:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776024.383992:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11996 00000100:00080000:0.0:1775776024.383995:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776024.383999:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776024.384012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776024.384025:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612726272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776024.384032:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612726144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776024.384038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776024.384043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776024.384044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776024.384049:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11996 00000100:00080000:0.0:1775776024.384053:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776024.384065:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776024.384071:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776024.384085:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612726400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776024.384095:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776024.384099:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776024.384101:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776024.384105:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11996 00000100:00080000:0.0:1775776024.384111:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776024.384115:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776024.384121:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776024.384126:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776024.384136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612726528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776024.384146:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776024.384150:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776024.384152:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776024.384155:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 11996 00000100:00080000:0.0:1775776024.384159:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776024.384162:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776024.384167:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776024.384177:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612726656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776024.384178:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776024/real 1775776024] req@ffff8de1c5681c00 x1862023612726144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776024.384215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612726144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776024.384226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776024.384232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776024.384237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612726144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776024.384265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776024.384308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776024.384321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776024/real 1775776024] req@ffff8de1c5681f80 x1862023612726272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776024.384334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612726272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776024.384343:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776024.384346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776024.384350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776024.384357:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776024.384377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776024.384386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776024/real 1775776024] req@ffff8de1c5682a00 x1862023612726400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776024.384398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612726400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776024.384405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776024.384408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776024.384412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776024.384418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776024.384438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776024.384449:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776024/real 1775776024] req@ffff8de1c5680380 x1862023612726528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776024.384461:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612726528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776024.384469:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776024.384472:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776024.384475:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776024.384480:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776024.384501:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776024.384511:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776024/real 1775776024] req@ffff8de1c5680000 x1862023612726656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776024.384523:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612726656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776024.384532:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776024.384535:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776024.384538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776025.343885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776026.367896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776027.391861:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776028.415963:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776029.439864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776029.503835:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776029.503842:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776029.503845:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776029.503853:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12001 00000100:00080000:3.0:1775776029.503862:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776029.503867:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776029.503901:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612726784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776029.503925:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776029.503928:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776029.503936:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776029.503940:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12001 00000100:00080000:3.0:1775776029.503944:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776029.503947:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776029.503955:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776029.503966:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612726784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776029.503968:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612726912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776029.503977:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776029.503980:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776029.503981:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776029.503984:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12001 00000100:00080000:3.0:1775776029.503987:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776029.503990:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776029.503994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776029.504001:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612727040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776029.504008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776029.504010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776029.504011:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776029.504014:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12001 00000800:00000100:1.0:1775776029.504017:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776029.504017:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776029.504020:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776029.504023:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776029.504030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612727168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776029.504037:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776029.504039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776029.504041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776029.504044:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12001 00000100:00080000:3.0:1775776029.504046:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776029.504047:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776029/real 1775776029] req@ffff8de1c7af4a80 x1862023612726784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776029.504049:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776029.504053:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776029.504060:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612727296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776029.504063:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612726784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776029.504078:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776029.504082:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776029.504085:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612726784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776029.504106:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776029.504123:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776029.504131:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776029/real 1775776029] req@ffff8de1c7af5880 x1862023612726912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776029.504137:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612726912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776029.504142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776029.504146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776029.504148:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612726912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776029.504154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776029.504170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776029.504186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776029/real 1775776029] req@ffff8de1c7af5500 x1862023612727040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776029.504197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612727040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776029.504205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776029.504208:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776029.504211:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776029.504216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776029.504234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776029.504243:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776029/real 1775776029] req@ffff8de1c7af4e00 x1862023612727168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776029.504253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612727168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776029.504258:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776029.504260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776029.504262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776029.504265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776029.504277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776029.504282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776029/real 1775776029] req@ffff8de1c7af6d80 x1862023612727296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776029.504289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612727296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776029.504293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776029.504294:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776029.504296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776030.463869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776031.487918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776032.511921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776033.535919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776034.559964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776034.623806:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776034.623814:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776034.623819:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776034.623828:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12006 00000100:00080000:3.0:1775776034.623841:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776034.623848:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776034.623886:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612727424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776034.623919:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776034.623921:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776034.623923:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776034.623929:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12006 00000100:00080000:3.0:1775776034.623931:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776034.623934:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776034.623944:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776034.623954:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612727552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776034.623961:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776034.623964:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776034.623965:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776034.623969:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12006 00000100:00100000:1.0:1775776034.623971:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612727424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776034.623973:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776034.623977:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776034.623983:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776034.623989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612727680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776034.623994:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776034.623996:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776034.623996:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776034.623999:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12006 00000100:00080000:3.0:1775776034.624000:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776034.624002:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776034.624005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776034.624011:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612727808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776034.624016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776034.624018:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776034.624019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776034.624021:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12006 00000100:00080000:3.0:1775776034.624024:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776034.624027:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776034.624031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776034.624040:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612727936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776034.624058:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776034.624100:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776034/real 1775776034] req@ffff8de1c7af5c00 x1862023612727424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776034.624121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612727424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776034.624132:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776034.624137:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776034.624140:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612727424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776034.624168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776034.624190:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776034.624201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776034/real 1775776034] req@ffff8de1c7af7b80 x1862023612727552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776034.624213:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612727552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776034.624221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776034.624223:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776034.624227:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776034.624232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776034.624250:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776034.624260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776034/real 1775776034] req@ffff8de1c7af7480 x1862023612727680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776034.624271:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612727680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776034.624284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776034.624287:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776034.624290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776034.624296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776034.624314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776034.624323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776034/real 1775776034] req@ffff8de1c7af6680 x1862023612727808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776034.624332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612727808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776034.624336:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776034.624338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776034.624340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776034.624343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776034.624359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776034.624368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776034/real 1775776034] req@ffff8de1c7af6300 x1862023612727936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776034.624393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612727936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776034.624401:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776034.624404:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776034.624407:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612727936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776035.583871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776036.607947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776037.631950:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776038.655907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776039.679911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776039.743880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776039.743893:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776039.743898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776039.743909:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12011 00000100:00080000:0.0:1775776039.743924:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776039.743933:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776039.743981:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612728064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776039.744012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776039.744016:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776039.744019:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776039.744025:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12011 00000100:00080000:0.0:1775776039.744029:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776039.744033:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776039.744044:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776039.744058:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612728064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776039.744059:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612728192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776039.744075:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776039.744078:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776039.744079:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776039.744084:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12011 00000100:00080000:0.0:1775776039.744088:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776039.744092:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776039.744097:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776039.744109:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612728320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776039.744118:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776039.744122:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776039.744123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776039.744127:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12011 00000100:00080000:0.0:1775776039.744132:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776039.744135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776039.744139:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776039.744144:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776039.744155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612728448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776039.744163:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776039.744166:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776039.744168:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776039.744172:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12011 00000100:00080000:0.0:1775776039.744176:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776039.744180:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776039/real 1775776039] req@ffff8de1c5680e00 x1862023612728064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776039.744182:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776039.744189:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776039.744203:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612728576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776039.744211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612728064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776039.744233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776039.744238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776039.744243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612728064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776039.744276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776039.744307:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776039.744317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776039/real 1775776039] req@ffff8de1c5683480 x1862023612728192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776039.744325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612728192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776039.744330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776039.744333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776039.744336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776039.744342:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776039.744360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776039.744371:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776039/real 1775776039] req@ffff8de1c5683800 x1862023612728320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776039.744383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612728320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776039.744391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776039.744393:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776039.744396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776039.744400:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776039.744414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776039.744420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776039/real 1775776039] req@ffff8de1c5681500 x1862023612728448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776039.744428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612728448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776039.744432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776039.744434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776039.744436:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776039.744439:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776039.744449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776039.744457:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776039/real 1775776039] req@ffff8de1c5681880 x1862023612728576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776039.744467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612728576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776039.744474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776039.744477:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776039.744480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776040.703942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776041.727850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776042.751866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776043.775828:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776044.799876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776044.863800:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776044.863811:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776044.863815:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776044.863824:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12016 00000100:00080000:3.0:1775776044.863836:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776044.863842:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776044.863873:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612728704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776044.863892:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776044.863894:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776044.863896:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776044.863898:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12016 00000100:00080000:3.0:1775776044.863901:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776044.863904:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776044.863911:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776044.863920:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612728832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776044.863923:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612728704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776044.863933:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776044.863935:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776044.863936:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776044.863938:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12016 00000100:00080000:3.0:1775776044.863940:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776044.863942:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776044.863953:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776044.863964:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612728960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776044.863974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776044.863978:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776044.863979:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775776044.863983:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776044.863984:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12016 00000100:00080000:3.0:1775776044.863989:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776044.863993:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776044.864005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776044.864009:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776044/real 1775776044] req@ffff8de1c7af4700 x1862023612728704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776044.864019:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612729088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776044.864026:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612728704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776044.864034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776044.864037:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776044.864038:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776044.864042:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775776044.864042:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776044.864047:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612728704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776044.864050:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12016 00000100:00080000:3.0:1775776044.864061:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776044.864064:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776044.864068:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776044.864069:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776044.864081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612729216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776044.864090:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776044.864101:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776044/real 1775776044] req@ffff8de1c7af4000 x1862023612728832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776044.864121:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612728832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776044.864129:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776044.864132:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776044.864135:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776044.864142:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776044.864160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776044.864169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776044/real 1775776044] req@ffff8de1c7af6a00 x1862023612728960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776044.864180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612728960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776044.864188:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776044.864191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776044.864206:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612728960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776044.864213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776044.864231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776044.864242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776044/real 1775776044] req@ffff8de1c7af6300 x1862023612729088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776044.864253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612729088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776044.864261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776044.864264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776044.864267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776044.864283:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776044.864302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776044.864311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776044/real 1775776044] req@ffff8de1c7af6680 x1862023612729216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776044.864323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612729216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776044.864329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776044.864331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776044.864333:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776045.823881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776046.847870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776047.871855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776048.895956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776049.919966:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776049.983848:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776049.983859:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776049.983864:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776049.983876:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12021 00000100:00080000:3.0:1775776049.983887:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776049.983893:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776049.983931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612729344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776049.983956:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776049.983958:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776049.983959:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776049.983962:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12021 00000100:00080000:3.0:1775776049.983965:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776049.983967:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776049.983977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776049.983991:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612729344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776049.983992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612729472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776049.984004:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776049.984006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776049.984007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776049.984009:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12021 00000100:00080000:3.0:1775776049.984011:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776049.984014:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776049.984018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776049.984030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612729600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776049.984045:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776049.984047:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776049.984049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776049.984052:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12021 00000100:00080000:3.0:1775776049.984055:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776049.984059:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776049.984064:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776049.984070:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776049.984081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612729728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776049.984089:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776049.984092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776049.984093:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776049.984097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12021 00000100:00080000:3.0:1775776049.984102:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776049.984117:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776049.984122:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776049.984133:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776049/real 1775776049] req@ffff8de1c7af7480 x1862023612729344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776049.984156:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612729344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776049.984168:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776049.984172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776049.984175:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612729344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776049.984201:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776049.984219:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776049.984230:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776049/real 1775776049] req@ffff8de1c7af7b80 x1862023612729472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776049.984239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612729472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776049.984249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776049.984252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776049.984255:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776049.984260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776049.984271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776049.984277:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776049/real 1775776049] req@ffff8de1c7af5c00 x1862023612729600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776049.984292:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612729600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776049.984298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776049.984300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776049.984302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776049.984306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776049.984315:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612729856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776049.984325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776049.984341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776049/real 1775776049] req@ffff8de1c7af6d80 x1862023612729728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776049.984359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612729728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776049.984363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776049.984368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776049.984371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776049.984393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776049.984418:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776049.984430:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776049/real 1775776049] req@ffff8de1c7af4e00 x1862023612729856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776049.984437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612729856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776049.984441:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776049.984443:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776049.984445:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612729856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776050.943943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776051.967934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776052.991910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776054.015957:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776055.039850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776055.103840:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776055.103847:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776055.103850:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776055.103858:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12026 00000100:00080000:2.0:1775776055.103867:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776055.103873:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776055.103908:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612729984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776055.103933:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776055.103936:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776055.103938:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776055.103942:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12026 00000100:00080000:2.0:1775776055.103946:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776055.103949:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776055.103959:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776055.103964:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612729984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776055.103970:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612730112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776055.103978:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776055.103981:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776055.103983:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776055.103986:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12026 00000100:00080000:2.0:1775776055.103988:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776055.103991:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776055.103995:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776055.104004:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612730240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776055.104011:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775776055.104014:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776055.104014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776055.104040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776055.104044:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12026 00000100:00080000:2.0:1775776055.104047:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776055.104051:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776055.104056:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776055.104059:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776055/real 1775776055] req@ffff8de1d0f2d500 x1862023612729984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776055.104065:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612730368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776055.104073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776055.104075:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775776055.104076:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612729984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776055.104077:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776055.104080:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12026 00000100:00080000:2.0:1775776055.104083:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776055.104086:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776055.104086:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776055.104089:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775776055.104090:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776055.104094:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612729984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776055.104096:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612730496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776055.104114:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776055.104135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776055.104147:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776055/real 1775776055] req@ffff8de1d0f2ca80 x1862023612730112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776055.104155:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612730112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776055.104160:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776055.104162:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776055.104164:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776055.104167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776055.104179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776055.104184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776055/real 1775776055] req@ffff8de1d0f2e680 x1862023612730240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776055.104190:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612730240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776055.104195:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776055.104196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776055.104198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776055.104201:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776055.104213:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776055.104218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776055/real 1775776055] req@ffff8de1d0f2e300 x1862023612730368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776055.104224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612730368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776055.104229:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776055.104231:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776055.104233:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776055.104236:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776055.104244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776055.104249:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776055/real 1775776055] req@ffff8de1d0f2df80 x1862023612730496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776055.104255:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612730496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776055.104260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776055.104261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776055.104262:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776056.063945:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776057.087910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776058.111947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776059.135935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776060.159981:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776060.223891:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776060.223912:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776060.223918:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776060.223940:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12031 00000100:00080000:3.0:1775776060.223956:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776060.223964:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776060.224005:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612730624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776060.224034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776060.224036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776060.224038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776060.224041:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12031 00000100:00080000:3.0:1775776060.224044:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776060.224046:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776060.224056:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776060.224066:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612730752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776060.224073:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776060.224075:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776060.224077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776060.224079:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12031 00000100:00080000:3.0:1775776060.224080:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776060.224082:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776060.224085:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776060.224089:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612730624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776060.224095:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612730880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776060.224101:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776060.224104:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776060.224105:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776060.224108:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12031 00000100:00080000:3.0:1775776060.224109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776060.224111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776060.224114:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776060.224121:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612731008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776060.224133:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776060.224135:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776060.224136:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776060.224138:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12031 00000100:00080000:3.0:1775776060.224141:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776060.224143:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776060.224146:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776060.224154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612731136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776060.224164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776060.224200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776060/real 1775776060] req@ffff8de1c7af5500 x1862023612730624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776060.224215:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612730624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776060.224226:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776060.224232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776060.224237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612730624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776060.224247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776060.224278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776060.224288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776060/real 1775776060] req@ffff8de1c7af5880 x1862023612730752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776060.224296:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612730752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776060.224301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776060.224304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776060.224306:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776060.224328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776060.224346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776060.224352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776060/real 1775776060] req@ffff8de1c7af4a80 x1862023612730880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776060.224359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612730880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776060.224364:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776060.224366:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776060.224368:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612730880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776060.224371:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776060.224381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776060.224386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776060/real 1775776060] req@ffff8de1c7af5f80 x1862023612731008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776060.224394:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612731008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776060.224401:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776060.224404:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776060.224407:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776060.224412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776060.224435:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776060.224446:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776060/real 1775776060] req@ffff8de1c7af7100 x1862023612731136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776060.224455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612731136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776060.224460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776060.224462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776060.224464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776061.183943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776062.207930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776063.231908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776064.255931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776065.279914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776065.343897:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776065.343905:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776065.343910:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776065.343919:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12037 00000100:00080000:1.0:1775776065.343931:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776065.343937:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776065.343977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612731264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776065.344004:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776065.344007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776065.344008:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776065.344011:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12037 00000100:00080000:1.0:1775776065.344013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776065.344015:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776065.344025:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776065.344034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612731392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776065.344040:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776065.344043:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776065.344044:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776065.344046:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12037 00000100:00080000:1.0:1775776065.344047:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776065.344049:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776065.344051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776065.344056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612731520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776065.344061:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776065.344064:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776065.344065:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776065.344068:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12037 00000100:00080000:1.0:1775776065.344071:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776065.344074:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776065.344078:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776065.344083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612731648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776065.344090:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776065.344092:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776065.344093:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776065.344097:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12037 00000100:00080000:1.0:1775776065.344104:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775776065.344106:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612731264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776065.344109:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776065.344117:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776065.344124:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612731776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776065.344200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776065.344225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776065.344257:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776065.344273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776066.303971:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776067.327944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776068.351825:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775776068.416009:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775776068.416047:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775776068.416068:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776068.416104:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776068.416114:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776068.416123:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776068.416132:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775776068.416157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776065/real 1775776068] req@ffff8de1c2e14a80 x1862023612731648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776068.416179:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612731648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776068.416187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776068.416191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776068.416194:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776068.416199:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776065/real 1775776068] req@ffff8de1c2e17800 x1862023612731776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776068.416206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612731776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776068.416210:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776068.416212:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776068.416214:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731776:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776068.416218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776065/real 1775776068] req@ffff8de1c2e14e00 x1862023612731264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776068.416224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612731264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776068.416232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776068.416234:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776068.416236:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612731264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776068.416240:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776065/real 1775776068] req@ffff8de1c2e14700 x1862023612731392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776068.416246:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612731392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776068.416249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776068.416251:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776068.416252:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776068.416256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776065/real 1775776068] req@ffff8de1c2e17480 x1862023612731520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776068.416264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612731520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776068.416269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776068.416272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776068.416274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612731520:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775776069.375896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776070.399886:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776070.463904:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776070.463917:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776070.463922:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776070.463931:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12042 00000100:00080000:1.0:1775776070.463941:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776070.463947:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776070.463979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612731904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776070.464011:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776070.464015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776070.464017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776070.464021:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12042 00000100:00080000:1.0:1775776070.464024:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776070.464027:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776070.464036:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776070.464051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612732032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776070.464067:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776070.464070:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:2.0:1775776070.464071:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612731904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776070.464072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776070.464079:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12042 00000100:00080000:1.0:1775776070.464083:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776070.464086:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776070.464091:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776070.464102:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612732160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776070.464117:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776070.464121:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776070.464123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776070.464127:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12042 00000100:00080000:1.0:1775776070.464131:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776070.464137:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:2.0:1775776070.464138:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775776070.464145:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776070.464158:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612732288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776070.464167:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776070.464171:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1775776070.464174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776070/real 1775776070] req@ffff8de1c2e15500 x1862023612731904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776070.464175:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776070.464182:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12042 00000100:00080000:1.0:1775776070.464189:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776070.464195:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776070.464200:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776070.464203:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612731904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776070.464213:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612732416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776070.464215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776070.464223:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776070.464230:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612731904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776070.464267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776070.464289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776070.464299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776070/real 1775776070] req@ffff8de1c2e17b80 x1862023612732032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776070.464309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612732032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776070.464316:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776070.464319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776070.464321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776070.464326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776070.464343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776070.464358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776070/real 1775776070] req@ffff8de1c2e16680 x1862023612732160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776070.464368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612732160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776070.464379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776070.464382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776070.464384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776070.464389:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776070.464407:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776070.464416:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776070/real 1775776070] req@ffff8de1c2e14380 x1862023612732288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776070.464426:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612732288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776070.464448:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776070.464452:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776070.464455:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776070.464461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776070.464487:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776070.464496:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776070/real 1775776070] req@ffff8de1c2e17100 x1862023612732416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776070.464506:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612732416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776070.464513:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776070.464516:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776070.464520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776071.423914:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776072.447824:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776073.471904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776074.495859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776075.519889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776075.583831:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776075.583841:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776075.583846:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776075.583854:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12047 00000100:00080000:1.0:1775776075.583867:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776075.583874:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776075.583906:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612732544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776075.583934:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776075.583938:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776075.583940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776075.583943:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12047 00000100:00080000:1.0:1775776075.583947:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776075.583958:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776075.583967:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776075.583982:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612732544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776075.583983:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612732672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776075.583999:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776075.584002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776075.584004:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776075.584008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12047 00000100:00080000:1.0:1775776075.584012:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776075.584016:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776075.584022:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776075.584033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612732800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775776075.584041:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776075.584046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776075.584050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776075.584052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776075.584056:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12047 00000100:00080000:1.0:1775776075.584060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776075.584064:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776075.584074:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776075.584088:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612732928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776075.584097:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776075.584100:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776075.584102:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776075.584107:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12047 00000100:00100000:2.0:1775776075.584108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776075/real 1775776075] req@ffff8de1c2e16a00 x1862023612732544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776075.584112:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776075.584119:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776075.584127:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776075.584139:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612733056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776075.584144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612732544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776075.584159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776075.584164:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776075.584168:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612732544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776075.584194:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776075.584210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776075.584218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776075/real 1775776075] req@ffff8de1c2e17100 x1862023612732672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776075.584225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612732672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776075.584230:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776075.584232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776075.584234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776075.584237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776075.584246:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776075.584251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776075/real 1775776075] req@ffff8de1c2e14380 x1862023612732800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776075.584257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612732800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776075.584261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776075.584263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776075.584264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776075.584267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776075.584276:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776075.584280:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776075/real 1775776075] req@ffff8de1c2e16680 x1862023612732928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776075.584286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612732928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776075.584291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776075.584292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776075.584294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612732928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776075.584296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776075.584304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776075.584308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776075/real 1775776075] req@ffff8de1c2e17b80 x1862023612733056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776075.584313:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612733056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776075.584318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776075.584320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776075.584321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776076.543866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776077.567898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776078.591862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776079.615886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776080.639874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776080.703841:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776080.703848:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776080.703851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776080.703860:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12052 00000100:00080000:2.0:1775776080.703869:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776080.703875:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776080.703914:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612733184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776080.703940:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776080.703944:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776080.703946:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776080.703950:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12052 00000100:00080000:2.0:1775776080.703953:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776080.703957:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776080.703967:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776080.703979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612733312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776080.703988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612733184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776080.703991:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776080.703996:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776080.703999:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776080.704003:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12052 00000100:00080000:2.0:1775776080.704007:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776080.704011:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776080.704016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776080.704029:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612733440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776080.704047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775776080.704050:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776080.704053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776080.704056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776080.704061:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12052 00000100:00080000:2.0:1775776080.704065:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776080.704069:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776080.704075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776080.704085:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776080/real 1775776080] req@ffff8de1d0f2f100 x1862023612733184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776080.704096:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612733568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776080.704109:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776080.704114:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612733184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776080.704114:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776080.704119:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776080.704127:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12052 00000100:00080000:2.0:1775776080.704133:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776080.704140:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775776080.704142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:2.0:1775776080.704145:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775776080.704148:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776080.704153:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612733184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776080.704161:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612733696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776080.704178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776080.704199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776080.704210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776080/real 1775776080] req@ffff8de1d0f2c700 x1862023612733312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776080.704220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612733312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776080.704227:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776080.704230:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776080.704232:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776080.704237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776080.704252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776080.704260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776080/real 1775776080] req@ffff8de1d0f2df80 x1862023612733440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776080.704270:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612733440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776080.704277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776080.704279:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776080.704282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776080.704287:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776080.704303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776080.704311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776080/real 1775776080] req@ffff8de1d0f2e300 x1862023612733568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776080.704321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612733568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776080.704327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776080.704330:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776080.704332:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776080.704337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776080.704354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776080.704364:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776080/real 1775776080] req@ffff8de1d0f2e680 x1862023612733696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776080.704374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612733696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776080.704382:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776080.704385:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776080.704388:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776081.663903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776082.687900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776083.711926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776084.735910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776085.759913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776085.823844:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776085.823853:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776085.823858:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776085.823868:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12057 00000100:00080000:1.0:1775776085.823879:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776085.823886:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776085.823925:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612733824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776085.823948:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776085.823951:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776085.823953:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776085.823956:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12057 00000100:00080000:1.0:1775776085.823958:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776085.823961:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776085.823969:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776085.823978:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612733824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776085.823985:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612733952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776085.823993:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776085.823995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776085.823996:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776085.823999:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12057 00000100:00080000:1.0:1775776085.824001:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776085.824003:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776085.824006:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776085.824014:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612734080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776085.824024:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776085.824026:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776085.824027:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776085.824029:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12057 00000100:00080000:1.0:1775776085.824037:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776085.824040:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776085.824043:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775776085.824048:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776085.824051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612734208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776085.824057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776085.824060:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776085.824062:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776085.824064:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12057 00000100:00080000:1.0:1775776085.824069:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776085.824071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776085.824073:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776085.824079:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612734336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776085.824093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776085/real 1775776085] req@ffff8de1c2e15500 x1862023612733824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776085.824116:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612733824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776085.824127:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776085.824132:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776085.824135:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612733824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776085.824159:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776085.824179:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776085.824189:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776085/real 1775776085] req@ffff8de1c2e17480 x1862023612733952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776085.824200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612733952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776085.824205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776085.824207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776085.824209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612733952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776085.824212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776085.824225:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776085.824231:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776085/real 1775776085] req@ffff8de1c2e14700 x1862023612734080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776085.824238:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612734080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776085.824243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776085.824245:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776085.824247:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776085.824250:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776085.824262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776085.824267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776085/real 1775776085] req@ffff8de1c2e14e00 x1862023612734208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776085.824275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612734208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776085.824280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776085.824283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776085.824286:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776085.824291:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776085.824305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776085.824312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776085/real 1775776085] req@ffff8de1c2e17800 x1862023612734336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776085.824323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612734336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776085.824328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776085.824329:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776085.824331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776086.783914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776087.807893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776088.831909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776089.855897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776090.879897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776090.943837:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776090.943850:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776090.943855:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776090.943867:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12062 00000100:00080000:1.0:1775776090.943879:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776090.943886:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776090.943925:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612734464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776090.943958:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776090.943962:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776090.943964:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776090.943968:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12062 00000100:00080000:1.0:1775776090.943972:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776090.943976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776090.943992:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776090.944002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612734464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776090.944007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612734592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776090.944016:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776090.944018:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776090.944019:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776090.944023:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12062 00000100:00080000:1.0:1775776090.944026:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776090.944028:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776090.944032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776090.944040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612734720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776090.944046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776090.944050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776090.944051:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776090.944053:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12062 00000100:00080000:1.0:1775776090.944056:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776090.944058:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776090.944061:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776090.944068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612734848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776090.944076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776090.944079:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776090.944081:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775776090.944083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776090.944086:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12062 00000100:00080000:1.0:1775776090.944088:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776090.944090:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776090.944094:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776090.944101:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612734976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776090.944136:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776090/real 1775776090] req@ffff8de1c2e14a80 x1862023612734464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776090.944151:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612734464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776090.944159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776090.944162:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776090.944169:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612734464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776090.944189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776090.944206:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776090.944214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776090/real 1775776090] req@ffff8de1c2e17800 x1862023612734592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776090.944227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612734592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776090.944237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776090.944239:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776090.944241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776090.944245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776090.944256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776090.944261:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776090/real 1775776090] req@ffff8de1c2e14e00 x1862023612734720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776090.944268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612734720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776090.944273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776090.944275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776090.944276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776090.944280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776090.944289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776090.944293:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776090/real 1775776090] req@ffff8de1c2e14700 x1862023612734848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776090.944299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612734848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776090.944303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776090.944305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776090.944307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776090.944311:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776090.944320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776090.944324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776090/real 1775776090] req@ffff8de1c2e17480 x1862023612734976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776090.944330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612734976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776090.944334:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776090.944336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776090.944338:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612734976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776091.903900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776092.927917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776093.951887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776094.975948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776095.999996:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776096.063870:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776096.063880:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776096.063892:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776096.063901:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12067 00000100:00080000:2.0:1775776096.063914:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776096.063920:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776096.063962:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612735104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776096.063987:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776096.063989:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776096.063990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776096.063993:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12067 00000100:00080000:2.0:1775776096.063995:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776096.064000:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776096.064010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776096.064019:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612735104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776096.064020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612735232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776096.064032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776096.064034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776096.064034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776096.064037:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12067 00000100:00080000:2.0:1775776096.064038:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776096.064040:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776096.064043:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776096.064050:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612735360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776096.064061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776096.064063:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776096.064065:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776096.064067:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12067 00000100:00080000:2.0:1775776096.064070:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776096.064072:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776096.064075:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776096.064081:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612735488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776096.064087:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776096.064089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776096.064090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776096.064093:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12067 00000100:00080000:2.0:1775776096.064095:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776096.064097:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776096.064101:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776096.064105:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776096.064112:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612735616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776096.064138:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776096/real 1775776096] req@ffff8de1d0f2ca80 x1862023612735104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776096.064154:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612735104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776096.064171:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776096.064175:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776096.064178:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612735104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776096.064198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776096.064213:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776096.064221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776096/real 1775776096] req@ffff8de1d0f2d500 x1862023612735232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776096.064228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612735232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776096.064233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776096.064235:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776096.064237:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776096.064240:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776096.064249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776096.064254:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776096/real 1775776096] req@ffff8de1d0f2e680 x1862023612735360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776096.064260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612735360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776096.064264:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776096.064266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776096.064267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776096.064273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776096.064290:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776096.064299:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776096/real 1775776096] req@ffff8de1d0f2e300 x1862023612735488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776096.064339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612735488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776096.064344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776096.064346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776096.064348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776096.064352:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776096.064366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776096.064372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776096/real 1775776096] req@ffff8de1d0f2df80 x1862023612735616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776096.064378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612735616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776096.064383:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776096.064385:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776096.064386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776097.023942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776098.047886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776099.071914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776100.095865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776101.119898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776101.183850:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776101.183860:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776101.183864:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776101.183874:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12072 00000100:00080000:2.0:1775776101.183884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776101.183891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776101.183927:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612735744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776101.183955:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776101.183959:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776101.183961:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776101.183965:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12072 00000100:00080000:2.0:1775776101.183968:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776101.183970:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776101.183978:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776101.183990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612735872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776101.184000:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776101.184003:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776101.184005:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776101.184008:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12072 00000100:00080000:2.0:1775776101.184012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776101.184016:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776101.184020:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612735744:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775776101.184022:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776101.184039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612736000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776101.184049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776101.184052:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776101.184054:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776101.184058:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12072 00000100:00080000:2.0:1775776101.184062:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776101.184065:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776101.184070:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776101.184080:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612736128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776101.184088:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776101.184092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:1.0:1775776101.184096:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776101.184096:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776101.184102:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12072 00000100:00080000:2.0:1775776101.184106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776101.184110:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776101.184114:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776101.184124:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612736256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776101.184135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776101/real 1775776101] req@ffff8de1d0f2c700 x1862023612735744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776101.184155:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612735744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776101.184165:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776101.184170:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776101.184173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612735744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776101.184180:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776101.184199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776101.184240:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776101/real 1775776101] req@ffff8de1d0f2f100 x1862023612735872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776101.184253:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612735872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776101.184260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776101.184263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776101.184265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612735872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776101.184289:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776101.184308:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776101.184317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776101/real 1775776101] req@ffff8de1d0f2df80 x1862023612736000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776101.184326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612736000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776101.184337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776101.184340:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776101.184342:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776101.184347:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776101.184361:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776101.184369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776101/real 1775776101] req@ffff8de1d0f2e300 x1862023612736128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776101.184379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612736128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776101.184385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776101.184388:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776101.184390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776101.184396:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776101.184411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776101.184419:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776101/real 1775776101] req@ffff8de1d0f2e680 x1862023612736256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776101.184429:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612736256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776101.184435:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776101.184438:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776101.184441:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776102.143861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776103.167868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776104.191843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776105.215914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776106.239843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776106.303774:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776106.303781:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776106.303784:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776106.303791:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12078 00000100:00080000:2.0:1775776106.303800:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776106.303804:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776106.303835:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612736384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776106.303855:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776106.303857:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776106.303858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776106.303861:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12078 00000100:00080000:2.0:1775776106.303863:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776106.303865:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776106.303872:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776106.303879:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612736512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776106.303886:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776106.303889:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776106.303890:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776106.303893:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12078 00000100:00080000:2.0:1775776106.303894:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776106.303896:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776106.303899:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776106.303901:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612736384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776106.303908:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612736640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776106.303914:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776106.303916:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776106.303917:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776106.303919:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12078 00000100:00080000:2.0:1775776106.303921:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776106.303923:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776106.303927:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776106.303933:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612736768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776106.303938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776106.303940:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776106.303941:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776106.303944:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12078 00000100:00080000:2.0:1775776106.303946:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776106.303948:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776106.303951:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776106.303956:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776106.303959:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612736896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776106.303993:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776106/real 1775776106] req@ffff8de1d0f2d500 x1862023612736384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776106.304007:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612736384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776106.304013:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776106.304015:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776106.304018:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612736384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776106.304024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776106.304046:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776106.304057:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776106/real 1775776106] req@ffff8de1d0f2ca80 x1862023612736512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776106.304068:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612736512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776106.304076:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776106.304078:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776106.304080:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776106.304105:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776106.304120:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776106.304139:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776106/real 1775776106] req@ffff8de1d0f2e680 x1862023612736640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776106.304147:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612736640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776106.304152:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776106.304153:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776106.304155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776106.304159:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776106.304170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776106.304176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776106/real 1775776106] req@ffff8de1d0f2e300 x1862023612736768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776106.304186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612736768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776106.304192:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776106.304195:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776106.304198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776106.304203:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776106.304220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776106.304229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776106/real 1775776106] req@ffff8de1d0f2df80 x1862023612736896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776106.304240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612736896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776106.304245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776106.304247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776106.304249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612736896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776107.263921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776108.287911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776109.311918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776110.335957:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776111.359896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776111.423888:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776111.423901:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776111.423906:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776111.423918:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12083 00000100:00080000:3.0:1775776111.423931:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776111.423938:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776111.423978:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612737024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776111.424006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776111.424010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776111.424011:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776111.424016:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12083 00000100:00080000:3.0:1775776111.424019:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776111.424023:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776111.424061:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776111.424075:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612737024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776111.424076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612737152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776111.424095:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776111.424098:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776111.424099:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776111.424102:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12083 00000100:00080000:3.0:1775776111.424105:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776111.424108:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776111.424112:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776111.424122:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612737280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776111.424129:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776111.424131:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776111.424132:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776111.424134:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12083 00000100:00080000:3.0:1775776111.424138:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776111.424141:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776111.424144:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776111.424153:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612737408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776111.424156:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776111.424162:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776111.424165:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776111.424166:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776111.424169:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12083 00000100:00080000:3.0:1775776111.424170:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776111.424173:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776111.424175:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776111.424181:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612737536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776111.424207:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776111/real 1775776111] req@ffff8de1c7af4380 x1862023612737024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776111.424228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612737024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776111.424236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776111.424240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776111.424242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612737024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776111.424265:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776111.424286:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776111.424297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776111/real 1775776111] req@ffff8de1c7af5180 x1862023612737152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776111.424309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612737152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776111.424317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776111.424320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776111.424323:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776111.424330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776111.424348:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776111.424358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776111/real 1775776111] req@ffff8de1c7af7800 x1862023612737280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776111.424371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612737280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776111.424379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776111.424382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776111.424385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776111.424390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776111.424421:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776111.424431:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776111/real 1775776111] req@ffff8de1c7af7100 x1862023612737408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776111.424450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612737408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776111.424456:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776111.424458:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776111.424460:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776111.424464:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776111.424478:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776111.424484:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776111/real 1775776111] req@ffff8de1c7af5f80 x1862023612737536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776111.424492:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612737536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776111.424496:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776111.424498:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776111.424500:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776112.383989:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776113.407905:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776114.431962:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776115.455879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776116.479890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776116.543875:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776116.543884:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776116.543889:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776116.543899:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12088 00000100:00080000:1.0:1775776116.543910:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776116.543917:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776116.543985:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612737664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776116.544021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776116.544025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776116.544026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776116.544030:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12088 00000100:00080000:1.0:1775776116.544033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776116.544038:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776116.544047:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776116.544062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612737792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776116.544078:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612737664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776116.544085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776116.544090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776116.544092:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776116.544098:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12088 00000100:00080000:1.0:1775776116.544102:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776116.544106:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776116.544112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776116.544126:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612737920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776116.544137:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776116.544139:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776116.544141:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776116.544143:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12088 00000100:00080000:1.0:1775776116.544147:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775776116.544151:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776116.544155:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776116.544161:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776116.544172:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612738048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776116.544182:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776116.544185:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776116.544187:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776116.544191:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12088 00000100:00080000:1.0:1775776116.544196:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775776116.544201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776116/real 1775776116] req@ffff8de1c2e15500 x1862023612737664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776116.544202:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776116.544211:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776116.544230:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612738176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776116.544236:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612737664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776116.544252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776116.544260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776116.544268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612737664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776116.544297:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776116.544329:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776116.544343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776116/real 1775776116] req@ffff8de1c2e17b80 x1862023612737792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776116.544357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612737792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776116.544367:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776116.544370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776116.544374:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776116.544386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776116.544404:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776116.544412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776116/real 1775776116] req@ffff8de1c2e16680 x1862023612737920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776116.544420:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612737920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776116.544425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776116.544427:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776116.544429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612737920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776116.544444:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776116.544463:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776116.544474:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776116/real 1775776116] req@ffff8de1c2e14380 x1862023612738048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776116.544487:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612738048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776116.544495:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776116.544499:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776116.544502:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776116.544507:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776116.544523:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776116.544530:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776116/real 1775776116] req@ffff8de1c2e17100 x1862023612738176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776116.544543:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612738176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776116.544548:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776116.544551:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776116.544554:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776117.503921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776118.527950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776119.551854:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776120.575907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776121.599900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776121.663906:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776121.663912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776121.663916:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776121.663924:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12093 00000100:00080000:2.0:1775776121.663935:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776121.663941:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776121.663970:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612738304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776121.663993:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776121.663996:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776121.663998:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776121.664005:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12093 00000100:00080000:2.0:1775776121.664009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776121.664013:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776121.664022:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776121.664037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612738432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776121.664052:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612738304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776121.664055:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776121.664061:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776121.664063:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776121.664068:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12093 00000100:00080000:2.0:1775776121.664072:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776121.664076:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776121.664082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776121.664098:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612738560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776121.664110:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776121.664114:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776121.664116:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776121.664122:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12093 00000800:00000100:1.0:1775776121.664123:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776121.664130:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776121.664135:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776121.664141:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776121.664150:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612738688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776121.664156:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776121.664158:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776121.664160:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776121.664161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776121/real 1775776121] req@ffff8de1d0f2f100 x1862023612738304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776121.664164:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12093 00000100:00080000:2.0:1775776121.664169:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776121.664175:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776121.664181:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776121.664188:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612738816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776121.664194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612738304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776121.664205:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776121.664210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776121.664215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612738304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776121.664241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776121.664266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776121.664283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776121/real 1775776121] req@ffff8de1d0f2c700 x1862023612738432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776121.664298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612738432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776121.664306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776121.664311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776121.664316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776121.664323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776121.664346:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776121.664363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776121/real 1775776121] req@ffff8de1d0f2df80 x1862023612738560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776121.664375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612738560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776121.664384:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776121.664387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776121.664391:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776121.664401:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776121.664423:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776121.664434:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776121/real 1775776121] req@ffff8de1d0f2e300 x1862023612738688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776121.664448:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612738688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776121.664456:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776121.664460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776121.664463:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776121.664471:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776121.664504:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776121.664516:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776121/real 1775776121] req@ffff8de1d0f2e680 x1862023612738816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776121.664527:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612738816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776121.664534:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776121.664536:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776121.664539:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612738816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776122.623936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776123.647912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776124.671938:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776125.695935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776126.719964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776126.783849:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776126.783856:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776126.783860:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776126.783873:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12098 00000100:00080000:2.0:1775776126.783885:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776126.783890:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776126.783923:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612738944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776126.783943:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776126.783946:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776126.783948:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776126.783951:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12098 00000100:00080000:2.0:1775776126.783953:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776126.783957:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776126.783968:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776126.783980:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612739072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776126.783991:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776126.783998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776126.783999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612738944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776126.784000:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776126.784014:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12098 00000100:00080000:2.0:1775776126.784018:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776126.784022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776126.784026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776126.784039:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612739200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776126.784045:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776126.784047:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776126.784048:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776126.784051:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12098 00000100:00080000:2.0:1775776126.784054:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776126.784056:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776126.784059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776126.784074:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612739328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776126.784079:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776126.784081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776126.784083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776126.784085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12098 00000100:00080000:2.0:1775776126.784088:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776126.784090:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776126.784094:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776126.784105:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612739456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776126.784107:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776126.784166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776126/real 1775776126] req@ffff8de1d0f2ca80 x1862023612738944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776126.784191:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612738944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776126.784200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776126.784205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776126.784209:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612738944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776126.784241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776126.784266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776126.784278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776126/real 1775776126] req@ffff8de1d0f2d500 x1862023612739072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776126.784290:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612739072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776126.784304:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776126.784308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776126.784311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776126.784317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776126.784332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776126.784339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776126/real 1775776126] req@ffff8de1d0f2e680 x1862023612739200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776126.784350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612739200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776126.784357:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776126.784360:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776126.784362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776126.784368:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776126.784383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776126.784390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776126/real 1775776126] req@ffff8de1d0f2e300 x1862023612739328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776126.784399:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612739328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776126.784406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776126.784409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776126.784412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776126.784418:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776126.784436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776126.784446:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776126/real 1775776126] req@ffff8de1d0f2df80 x1862023612739456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776126.784457:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612739456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776126.784465:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776126.784468:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776126.784471:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776127.743954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776128.767922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776129.791871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776130.815854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776131.839956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776131.903784:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776131.903791:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776131.903794:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776131.903801:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12103 00000100:00080000:2.0:1775776131.903810:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776131.903814:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776131.903843:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612739584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776131.903867:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776131.903869:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776131.903870:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776131.903873:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12103 00000100:00080000:2.0:1775776131.903874:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776131.903876:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776131.903883:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776131.903889:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612739712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776131.903894:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776131.903897:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776131.903898:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776131.903900:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12103 00000100:00080000:2.0:1775776131.903902:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776131.903905:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776131.903908:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776131.903915:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612739840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776131.903920:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776131.903923:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776131.903924:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776131.903928:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12103 00000100:00100000:1.0:1775776131.903930:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612739584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776131.903930:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776131.903934:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776131.903939:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776131.903944:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612739968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776131.903949:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776131.903951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776131.903952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776131.903954:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12103 00000100:00080000:2.0:1775776131.903956:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776131.903958:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776131.903960:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776131.903966:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612740096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776131.904024:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776131.904062:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776131.904103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776131.904128:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776132.863860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776133.887860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776134.911884:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1775776134.976175:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:1.0:1775776134.976243:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1775776134.976269:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776134.976326:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776134.976337:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776134.976346:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:1.0:1775776134.976355:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775776134.976513:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776131/real 1775776134] req@ffff8de1d0f2df80 x1862023612739840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776134.976554:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612739840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776134.976564:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776134.976569:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776134.976573:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776134.976581:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776131/real 1775776134] req@ffff8de1d0f2e300 x1862023612739968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776134.976592:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612739968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776134.976597:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776134.976601:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776134.976603:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776134.976609:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776131/real 1775776134] req@ffff8de1d0f2e680 x1862023612740096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776134.976619:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612740096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776134.976638:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776134.976641:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776134.976645:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740096:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776134.976651:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776131/real 1775776134] req@ffff8de1d0f2c700 x1862023612739584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776134.976663:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612739584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776134.976670:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776134.976673:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776134.976676:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612739584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776134.976683:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776131/real 1775776134] req@ffff8de1d0f2f100 x1862023612739712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776134.976694:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612739712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776134.976700:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776134.976702:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776134.976705:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612739712:192.168.201.137@tcp:38:kworker.0 00010000:00010000:0.0:1775776135.935894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776136.959876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776137.023842:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776137.023849:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776137.023853:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776137.023861:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12108 00000100:00080000:3.0:1775776137.023870:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776137.023874:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776137.023900:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612740224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776137.023916:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776137.023919:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776137.023921:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776137.023924:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12108 00000100:00080000:3.0:1775776137.023926:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776137.023928:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776137.023935:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776137.023937:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612740224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776137.023944:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612740352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776137.023957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776137.023961:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776137.023963:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776137.023967:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12108 00000100:00080000:3.0:1775776137.023980:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776137.023987:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776137.023993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:2.0:1775776137.023997:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776137.024007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612740480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776137.024015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776137.024018:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776137.024019:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776137.024021:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12108 00000100:00080000:3.0:1775776137.024024:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776137.024027:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776137.024031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776137.024036:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776137/real 1775776137] req@ffff8de1c7af4a80 x1862023612740224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776137.024039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612740608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776137.024054:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776137.024069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776137.024070:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775776137.024074:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612740224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776137.024077:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12108 00000100:00080000:3.0:1775776137.024084:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776137.024090:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776137.024098:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775776137.024111:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775776137.024114:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612740736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776137.024119:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776137.024127:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612740224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776137.024154:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776137.024180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776137.024193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776137/real 1775776137] req@ffff8de1c7af5880 x1862023612740352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776137.024204:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612740352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776137.024211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776137.024214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776137.024217:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776137.024222:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776137.024241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776137.024251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776137/real 1775776137] req@ffff8de1c7af5500 x1862023612740480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776137.024262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612740480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776137.024285:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776137.024288:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776137.024290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776137.024296:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776137.024315:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776137.024324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776137/real 1775776137] req@ffff8de1c7af4e00 x1862023612740608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776137.024333:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612740608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776137.024340:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776137.024343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776137.024346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776137.024351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776137.024367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776137.024377:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776137/real 1775776137] req@ffff8de1c7af6d80 x1862023612740736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776137.024388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612740736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776137.024394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776137.024397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776137.024400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776137.983827:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776139.007846:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776140.031903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776141.055911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776142.079915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776142.143881:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776142.143889:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776142.143893:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776142.143902:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12113 00000100:00080000:2.0:1775776142.143912:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776142.143918:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776142.143950:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612740864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776142.143985:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776142.143988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776142.143990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776142.143994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12113 00000100:00080000:2.0:1775776142.143998:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776142.144001:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776142.144010:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776142.144023:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612740992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776142.144039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776142.144043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776142.144045:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776142.144051:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12113 00000100:00080000:2.0:1775776142.144058:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776142.144059:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612740864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776142.144068:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776142.144074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776142.144089:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612741120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776142.144105:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776142.144108:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776142.144110:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776142.144113:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12113 00000100:00080000:2.0:1775776142.144117:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776142.144121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776142.144126:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776142.144137:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612741248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776142.144144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776142.144154:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776142.144157:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776142.144159:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776142.144165:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12113 00000100:00080000:2.0:1775776142.144169:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776142.144173:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776142.144180:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776142.144187:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776142/real 1775776142] req@ffff8de1d0f2f100 x1862023612740864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776142.144194:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612741376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776142.144225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612740864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776142.144245:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776142.144257:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776142.144263:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612740864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776142.144273:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776142.144298:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776142.144317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776142/real 1775776142] req@ffff8de1d0f2c700 x1862023612740992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776142.144329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612740992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776142.144337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776142.144341:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776142.144344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612740992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776142.144381:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776142.144402:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776142.144414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776142/real 1775776142] req@ffff8de1d0f2e680 x1862023612741120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776142.144423:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612741120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776142.144428:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776142.144430:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776142.144432:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776142.144436:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776142.144449:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776142.144455:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776142/real 1775776142] req@ffff8de1d0f2e300 x1862023612741248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776142.144462:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612741248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776142.144466:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776142.144468:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776142.144470:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776142.144482:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776142.144493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776142.144515:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776142/real 1775776142] req@ffff8de1d0f2df80 x1862023612741376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776142.144527:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612741376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776142.144535:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776142.144539:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776142.144542:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776143.103926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776144.127917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776145.151882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776146.175912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776147.199888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776147.263844:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776147.263857:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776147.263862:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776147.263874:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12119 00000100:00080000:3.0:1775776147.263888:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776147.263896:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776147.263943:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612741504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776147.263975:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776147.263979:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776147.263981:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776147.263985:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12119 00000100:00080000:3.0:1775776147.263990:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776147.263993:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776147.264005:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776147.264018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612741632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776147.264029:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776147.264035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776147.264037:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612741504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776147.264037:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776147.264045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12119 00000100:00080000:3.0:1775776147.264050:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776147.264053:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776147.264058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776147.264069:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612741760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776147.264078:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776147.264082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776147.264084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776147.264097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12119 00000100:00080000:3.0:1775776147.264101:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776147.264105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776147.264111:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776147.264123:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776147.264125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612741888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776147.264141:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776147.264144:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776147.264146:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776147.264150:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12119 00000100:00080000:3.0:1775776147.264154:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776147.264158:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776147.264166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776147/real 1775776147] req@ffff8de1c7af5c00 x1862023612741504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775776147.264172:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776147.264188:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612742016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776147.264192:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612741504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776147.264213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776147.264218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776147.264222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612741504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776147.264247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776147.264274:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776147.264289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776147/real 1775776147] req@ffff8de1c7af7b80 x1862023612741632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776147.264341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612741632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776147.264350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776147.264354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776147.264358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776147.264366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776147.264390:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776147.264402:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776147/real 1775776147] req@ffff8de1c7af7480 x1862023612741760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776147.264432:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612741760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776147.264440:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776147.264444:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776147.264447:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776147.264455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776147.264477:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776147.264489:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776147/real 1775776147] req@ffff8de1c7af6680 x1862023612741888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776147.264501:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612741888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776147.264509:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776147.264513:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776147.264517:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612741888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776147.264524:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776147.264545:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776147.264553:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776147/real 1775776147] req@ffff8de1c7af6300 x1862023612742016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776147.264565:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612742016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776147.264572:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776147.264575:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776147.264578:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776148.223919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776149.247925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776150.271912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776151.295935:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776152.319862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776152.383875:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776152.383887:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776152.383892:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776152.383905:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12124 00000100:00080000:3.0:1775776152.383918:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776152.383927:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776152.383971:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612742144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776152.384000:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776152.384002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776152.384004:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776152.384007:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12124 00000100:00080000:3.0:1775776152.384010:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776152.384013:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776152.384029:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776152.384032:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612742144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776152.384041:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612742272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776152.384048:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776152.384051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776152.384052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776152.384055:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12124 00000100:00080000:3.0:1775776152.384057:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776152.384063:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776152.384066:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776152.384075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612742400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776152.384083:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776152.384087:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776152.384089:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776152.384092:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12124 00000800:00000100:1.0:1775776152.384097:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776152.384097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776152.384104:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776152.384110:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776152.384124:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612742528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776152.384131:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776152/real 1775776152] req@ffff8de1c7af6a00 x1862023612742144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776152.384134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776152.384141:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776152.384143:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776152.384149:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12124 00000100:00080000:3.0:1775776152.384152:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776152.384155:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776152.384157:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612742144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775776152.384161:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775776152.384167:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776152.384171:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776152.384173:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612742656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776152.384176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612742144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776152.384201:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776152.384216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776152.384223:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776152/real 1775776152] req@ffff8de1c7af4000 x1862023612742272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776152.384230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612742272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776152.384239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776152.384242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776152.384243:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776152.384246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776152.384255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776152.384259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776152/real 1775776152] req@ffff8de1c7af4700 x1862023612742400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776152.384265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612742400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776152.384270:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776152.384271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776152.384273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776152.384276:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776152.384285:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776152.384290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776152/real 1775776152] req@ffff8de1c7af6300 x1862023612742528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776152.384300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612742528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776152.384307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776152.384310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776152.384313:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776152.384318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776152.384350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776152.384360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776152/real 1775776152] req@ffff8de1c7af6680 x1862023612742656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776152.384367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612742656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776152.384371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776152.384373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776152.384375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776153.343945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776154.367899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776155.391933:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776156.415924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776157.439915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776157.503880:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776157.503893:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776157.503898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776157.503910:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12129 00000100:00080000:0.0:1775776157.503921:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776157.503935:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776157.503977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612742784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776157.504015:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776157.504019:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776157.504021:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776157.504026:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12129 00000100:00080000:0.0:1775776157.504031:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776157.504035:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776157.504046:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776157.504061:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612742912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776157.504068:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612742784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776157.504078:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776157.504082:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776157.504085:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776157.504089:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12129 00000100:00080000:0.0:1775776157.504094:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776157.504098:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776157.504104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776157.504115:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612743040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776157.504124:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776157.504128:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776157.504130:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776157.504135:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12129 00000100:00080000:0.0:1775776157.504139:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776157.504142:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776157.504148:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776157.504151:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776157.504161:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612743168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776157.504171:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776157.504174:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776157.504176:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776157.504180:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12129 00000100:00080000:0.0:1775776157.504185:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776157.504187:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776157/real 1775776157] req@ffff8de1c5681880 x1862023612742784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776157.504193:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776157.504201:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776157.504210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612742784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776157.504215:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612743296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776157.504221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776157.504274:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776157.504281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612742784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776157.504303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776157.504320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776157.504329:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776157/real 1775776157] req@ffff8de1c5681500 x1862023612742912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776157.504338:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612742912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776157.504344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776157.504346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776157.504348:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612742912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776157.504352:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776157.504363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776157.504368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776157/real 1775776157] req@ffff8de1c5683800 x1862023612743040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776157.504375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612743040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776157.504380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776157.504383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776157.504385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776157.504388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776157.504399:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776157.504404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776157/real 1775776157] req@ffff8de1c5683480 x1862023612743168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776157.504412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612743168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776157.504417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776157.504420:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776157.504422:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776157.504425:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776157.504443:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776157.504454:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776157/real 1775776157] req@ffff8de1c5680e00 x1862023612743296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776157.504467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612743296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776157.504476:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776157.504480:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776157.504484:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776158.463887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776159.487918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776160.511934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776161.535928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776162.559926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776162.623857:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776162.623868:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776162.623873:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776162.623885:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12134 00000100:00080000:3.0:1775776162.623899:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776162.623907:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776162.623954:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612743424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776162.623984:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776162.623987:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776162.623990:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776162.623994:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12134 00000100:00080000:3.0:1775776162.623998:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776162.624002:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776162.624013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776162.624020:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612743424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776162.624028:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612743552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776162.624044:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776162.624053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776162.624054:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776162.624064:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12134 00000100:00080000:3.0:1775776162.624068:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776162.624072:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776162.624078:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:1.0:1775776162.624086:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776162.624093:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612743680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776162.624102:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776162.624106:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776162.624108:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776162.624112:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12134 00000100:00080000:3.0:1775776162.624116:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776162.624120:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776162.624125:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776162.624136:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612743808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776162.624140:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776162/real 1775776162] req@ffff8de1c7af7480 x1862023612743424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776162.624173:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776162.624178:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612743424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776162.624179:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776162.624183:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776162.624192:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12134 00000100:00080000:1.0:1775776162.624197:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776162.624198:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776162.624205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:3.0:1775776162.624206:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776162.624213:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612743424:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775776162.624214:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776162.624233:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612743936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776162.624249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776162.624273:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776162.624287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776162/real 1775776162] req@ffff8de1c7af7b80 x1862023612743552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776162.624300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612743552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776162.624307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776162.624311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776162.624314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776162.624319:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776162.624334:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776162.624341:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776162/real 1775776162] req@ffff8de1c7af5c00 x1862023612743680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776162.624352:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612743680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776162.624359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776162.624362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776162.624365:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776162.624370:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776162.624384:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776162.624390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776162/real 1775776162] req@ffff8de1c7af6d80 x1862023612743808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776162.624397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612743808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776162.624402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776162.624403:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776162.624405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776162.624408:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776162.624416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776162.624420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776162/real 1775776162] req@ffff8de1c7af4e00 x1862023612743936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776162.624427:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612743936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776162.624431:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776162.624432:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776162.624434:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612743936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776163.583950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776164.607956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776165.631949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776166.655941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776167.679905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776167.743904:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776167.743921:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776167.743927:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776167.743938:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12139 00000100:00080000:0.0:1775776167.743951:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776167.743957:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776167.743998:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612744064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776167.744026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776167.744029:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776167.744030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776167.744033:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12139 00000100:00080000:0.0:1775776167.744036:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776167.744039:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776167.744048:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776167.744068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612744192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776167.744076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776167.744079:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776167.744080:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776167.744082:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12139 00000100:00080000:0.0:1775776167.744085:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776167.744089:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776167.744090:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612744064:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775776167.744093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776167.744103:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612744320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776167.744109:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776167.744112:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776167.744113:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776167.744115:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12139 00000100:00080000:0.0:1775776167.744117:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776167.744119:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776167.744122:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776167.744128:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612744448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776167.744134:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776167.744137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776167.744138:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776167.744140:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12139 00000100:00080000:0.0:1775776167.744155:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776167.744157:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776167.744160:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776167.744167:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776167.744169:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612744576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776167.744205:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776167/real 1775776167] req@ffff8de1c5680000 x1862023612744064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776167.744220:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612744064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776167.744236:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776167.744241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776167.744246:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612744064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776167.744253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776167.744275:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776167.744287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776167/real 1775776167] req@ffff8de1c5680380 x1862023612744192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776167.744298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612744192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776167.744303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776167.744305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776167.744307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776167.744330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776167.744342:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776167.744348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776167/real 1775776167] req@ffff8de1c5682a00 x1862023612744320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776167.744354:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612744320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776167.744359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776167.744361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776167.744362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776167.744366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776167.744375:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776167.744380:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776167/real 1775776167] req@ffff8de1c5681f80 x1862023612744448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776167.744386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612744448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776167.744391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776167.744393:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776167.744395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776167.744398:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776167.744406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776167.744410:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776167/real 1775776167] req@ffff8de1c5681c00 x1862023612744576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776167.744416:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612744576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776167.744420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776167.744422:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776167.744423:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776168.703909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776169.727881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776170.751960:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776171.775912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776172.799997:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776172.863905:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776172.863919:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776172.863925:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776172.863939:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12144 00000100:00080000:2.0:1775776172.863957:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776172.863983:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776172.864034:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612744704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776172.864069:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776172.864084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776172.864086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776172.864096:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12144 00000100:00080000:2.0:1775776172.864101:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776172.864106:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776172.864119:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776172.864129:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612744704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776172.864137:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612744832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776172.864152:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776172.864156:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776172.864159:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776172.864164:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12144 00000100:00080000:2.0:1775776172.864168:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776172.864173:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776172.864179:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776172.864193:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612744960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776172.864203:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776172.864208:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776172.864210:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776172.864214:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12144 00000100:00080000:2.0:1775776172.864220:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776172.864221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776172.864229:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776172.864236:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776172.864249:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612745088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776172.864261:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776172.864265:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776172.864269:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776172.864270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776172/real 1775776172] req@ffff8de1d0f2d500 x1862023612744704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776172.864279:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12144 00000100:00080000:2.0:1775776172.864287:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776172.864294:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776172.864300:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776172.864309:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612744704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776172.864316:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612745216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776172.864327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776172.864335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776172.864340:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612744704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776172.864372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776172.864401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776172.864413:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776172/real 1775776172] req@ffff8de1d0f2ca80 x1862023612744832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776172.864422:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612744832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776172.864428:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776172.864431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776172.864433:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776172.864437:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776172.864461:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776172.864467:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776172/real 1775776172] req@ffff8de1d0f2df80 x1862023612744960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776172.864476:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612744960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776172.864486:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776172.864489:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776172.864491:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612744960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776172.864494:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776172.864506:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776172.864512:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776172/real 1775776172] req@ffff8de1d0f2e300 x1862023612745088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776172.864519:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612745088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776172.864524:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776172.864526:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776172.864528:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776172.864531:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776172.864541:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776172.864546:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776172/real 1775776172] req@ffff8de1d0f2e680 x1862023612745216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776172.864554:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612745216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776172.864558:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776172.864560:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776172.864563:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776173.823889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776174.847986:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776175.871830:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776176.895927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776177.919895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776177.983885:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776177.983899:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776177.983904:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776177.983916:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12149 00000100:00080000:2.0:1775776177.983933:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776177.983942:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776177.983992:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612745344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776177.984026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776177.984030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776177.984032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776177.984036:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12149 00000100:00080000:2.0:1775776177.984050:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776177.984055:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776177.984068:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776177.984084:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612745472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776177.984098:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612745344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776177.984098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776177.984105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776177.984109:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776177.984115:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12149 00000100:00080000:2.0:1775776177.984120:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776177.984124:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776177.984131:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776177.984146:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612745600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776177.984157:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776177.984160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776177.984162:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776177.984166:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12149 00000100:00080000:2.0:1775776177.984172:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776177.984176:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776177.984182:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776177.984187:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776177.984197:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612745728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776177.984209:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776177.984213:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776177.984215:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776177.984219:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12149 00000100:00080000:2.0:1775776177.984223:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776177.984227:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776177.984232:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776177.984239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776177/real 1775776177] req@ffff8de1d0f2c700 x1862023612745344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776177.984245:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612745856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776177.984278:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612745344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776177.984292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776177.984297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776177.984302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612745344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776177.984330:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776177.984367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776177.984383:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776177/real 1775776177] req@ffff8de1d0f2f100 x1862023612745472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776177.984398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612745472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776177.984406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776177.984410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776177.984413:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776177.984420:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776177.984442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776177.984453:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776177/real 1775776177] req@ffff8de1d0f2e680 x1862023612745600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776177.984466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612745600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776177.984474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776177.984477:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776177.984481:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776177.984488:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776177.984509:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776177.984520:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776177/real 1775776177] req@ffff8de1d0f2e300 x1862023612745728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776177.984534:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612745728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776177.984553:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776177.984557:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776177.984561:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776177.984567:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776177.984588:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776177.984599:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776177/real 1775776177] req@ffff8de1d0f2df80 x1862023612745856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776177.984612:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612745856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776177.984622:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776177.984625:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776177.984629:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612745856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776178.943933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776179.967944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776180.991930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776182.015967:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776183.039949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776183.103907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776183.103921:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776183.103926:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776183.103935:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12154 00000100:00080000:3.0:1775776183.103948:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776183.103956:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776183.104012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612745984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776183.104040:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776183.104044:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776183.104046:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776183.104050:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12154 00000100:00080000:3.0:1775776183.104054:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776183.104058:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776183.104068:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776183.104082:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612746112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776183.104091:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612745984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776183.104098:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776183.104103:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776183.104104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776183.104109:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12154 00000100:00080000:3.0:1775776183.104113:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776183.104117:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776183.104121:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776183.104134:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612746240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776183.104143:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776183.104146:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776183.104148:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776183.104152:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12154 00000100:00080000:3.0:1775776183.104156:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776183.104160:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776183.104165:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776183.104167:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776183.104179:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612746368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776183.104189:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776183.104192:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776183.104193:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776183.104196:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12154 00000100:00080000:3.0:1775776183.104198:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776183.104201:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776183.104206:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776183.104215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776183/real 1775776183] req@ffff8de1c7af5500 x1862023612745984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776183.104219:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612746496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776183.104250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612745984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776183.104263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776183.104267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776183.104272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612745984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776183.104301:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776183.104323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776183.104334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776183/real 1775776183] req@ffff8de1c7af5880 x1862023612746112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776183.104344:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612746112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776183.104351:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776183.104354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776183.104357:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776183.104362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776183.104377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776183.104385:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776183/real 1775776183] req@ffff8de1c7af4a80 x1862023612746240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776183.104395:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612746240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776183.104402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776183.104405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776183.104408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776183.104413:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776183.104428:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776183.104436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776183/real 1775776183] req@ffff8de1c7af5f80 x1862023612746368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776183.104446:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612746368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776183.104452:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776183.104455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776183.104458:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776183.104463:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776183.104477:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776183.104486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776183/real 1775776183] req@ffff8de1c7af7100 x1862023612746496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776183.104497:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612746496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776183.104503:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776183.104506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776183.104509:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776184.063961:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776185.087956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776186.111959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776187.135946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776188.159875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776188.223813:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776188.223819:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776188.223823:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776188.223836:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12159 00000100:00080000:0.0:1775776188.223848:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776188.223854:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776188.223894:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612746624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776188.223920:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776188.223923:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776188.223925:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776188.223929:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12159 00000100:00080000:0.0:1775776188.223933:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776188.223936:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776188.223946:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776188.223960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612746752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776188.223965:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612746624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776188.223975:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776188.223979:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776188.223980:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776188.223985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12159 00000100:00080000:0.0:1775776188.223989:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776188.223992:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776188.223998:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776188.224010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612746880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776188.224020:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776188.224024:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776188.224027:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775776188.224028:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776188.224033:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12159 00000100:00080000:0.0:1775776188.224037:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776188.224041:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776188.224046:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776188.224056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612747008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776188.224064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776188.224067:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776188/real 1775776188] req@ffff8de1c5683b80 x1862023612746624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776188.224069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776188.224071:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776188.224075:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12159 00000100:00080000:0.0:1775776188.224079:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776188.224084:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776188.224092:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776188.224107:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612747136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776188.224110:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612746624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776188.224130:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776188.224134:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776188.224137:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612746624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776188.224155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776188.224171:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776188.224179:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776188/real 1775776188] req@ffff8de1c5680700 x1862023612746752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776188.224186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612746752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776188.224194:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776188.224196:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776188.224198:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776188.224201:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776188.224210:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776188.224215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776188/real 1775776188] req@ffff8de1c5682d80 x1862023612746880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776188.224221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612746880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776188.224225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776188.224227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776188.224228:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612746880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776188.224239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776188.224252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776188.224257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776188/real 1775776188] req@ffff8de1c5682300 x1862023612747008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776188.224264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612747008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776188.224268:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776188.224270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776188.224272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776188.224275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776188.224284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776188.224288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776188/real 1775776188] req@ffff8de1c5682680 x1862023612747136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776188.224294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612747136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776188.224299:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776188.224300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776188.224302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776189.183870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776190.207918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776191.231943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776192.255874:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776193.279885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776193.343840:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776193.343847:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776193.343851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776193.343858:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12165 00000100:00080000:0.0:1775776193.343867:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776193.343872:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776193.343899:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612747264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776193.343920:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776193.343923:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776193.343924:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776193.343927:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12165 00000100:00080000:0.0:1775776193.343929:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776193.343932:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776193.343941:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776193.343954:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612747392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776193.343964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776193.343968:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776193.343971:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776193.343971:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612747264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776193.343977:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12165 00000100:00080000:0.0:1775776193.343982:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776193.343986:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776193.343990:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776193.344000:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612747520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776193.344006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776193.344008:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776193.344009:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776193.344011:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12165 00000800:00000100:1.0:1775776193.344037:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776193.344125:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776193.344130:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776193.344135:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776193.344145:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612747648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776193.344151:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776193.344154:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775776193.344155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776193/real 1775776193] req@ffff8de1c5682680 x1862023612747264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776193.344156:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776193.344162:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12165 00000100:00080000:0.0:1775776193.344166:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776193.344171:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776193.344174:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776193.344182:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612747776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776193.344182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612747264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776193.344209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776193.344214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776193.344220:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612747264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776193.344244:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776193.344270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776193.344287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776193/real 1775776193] req@ffff8de1c5682300 x1862023612747392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776193.344302:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612747392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776193.344312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776193.344317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776193.344321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776193.344327:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776193.344347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776193.344359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776193/real 1775776193] req@ffff8de1c5682d80 x1862023612747520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776193.344371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612747520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776193.344381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776193.344384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776193.344387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776193.344393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776193.344411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776193.344422:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776193/real 1775776193] req@ffff8de1c5680700 x1862023612747648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776193.344435:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612747648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776193.344443:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776193.344447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776193.344450:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776193.344455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776193.344470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776193.344479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776193/real 1775776193] req@ffff8de1c5683b80 x1862023612747776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776193.344490:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612747776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776193.344498:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776193.344501:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776193.344505:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612747776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776194.303850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776195.327869:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776196.352250:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776197.375889:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776198.399878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776198.463832:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776198.463841:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776198.463846:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776198.463856:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12170 00000100:00080000:0.0:1775776198.463868:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776198.463875:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776198.463906:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612747904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776198.463940:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776198.463943:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776198.463945:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776198.463949:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12170 00000100:00080000:0.0:1775776198.463953:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776198.463956:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776198.463966:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776198.463979:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612748032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776198.463981:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612747904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776198.463995:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776198.463998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776198.463999:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776198.464004:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12170 00000100:00080000:0.0:1775776198.464007:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776198.464011:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776198.464016:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776198.464026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612748160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776198.464035:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776198.464038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776198.464039:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776198.464042:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12170 00000100:00080000:0.0:1775776198.464046:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776198.464049:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776198.464054:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776198.464063:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612748288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776198.464071:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776198.464075:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776198.464077:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776198.464081:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748032:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775776198.464084:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12170 00000100:00080000:0.0:1775776198.464089:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776198.464093:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776198.464098:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776198.464109:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612748416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776198.464126:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776198.464151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776198.464177:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776199.423893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776200.447915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776201.471896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776201.536028:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776201.536085:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776201.536106:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776201.536156:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776201.536167:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776201.536175:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776201.536183:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775776201.536288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776198/real 1775776201] req@ffff8de1c5680000 x1862023612748416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776201.536325:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612748416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776201.536337:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776201.536342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776201.536346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748416:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776201.536354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776198/real 1775776201] req@ffff8de1c5681f80 x1862023612748032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776201.536366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612748032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776201.536373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776201.536377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776201.536379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776201.536386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776198/real 1775776201] req@ffff8de1c5682a00 x1862023612748160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776201.536397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612748160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776201.536404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776201.536408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776201.536411:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776201.536418:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776198/real 1775776201] req@ffff8de1c5680380 x1862023612748288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776201.536428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612748288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776201.536434:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776201.536437:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776201.536440:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776201.536447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776198/real 1775776201] req@ffff8de1c5681c00 x1862023612747904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776201.536492:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612747904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776201.536500:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776201.536504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776201.536507:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612747904:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775776202.495871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776203.519882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776203.583874:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776203.583886:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776203.583891:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776203.583903:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12175 00000100:00080000:3.0:1775776203.583918:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776203.583925:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776203.583966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612748544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776203.584003:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776203.584007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776203.584009:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776203.584014:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12175 00000100:00080000:3.0:1775776203.584018:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776203.584022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776203.584041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776203.584054:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612748672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776203.584063:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776203.584066:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776203.584068:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776203.584071:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12175 00000100:00080000:3.0:1775776203.584076:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776203.584079:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776203.584083:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776203.584092:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612748800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776203.584100:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776203.584113:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776203.584116:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776203.584119:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12175 00000100:00080000:3.0:1775776203.584123:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776203.584126:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776203.584132:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776203.584141:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612748928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776203.584149:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776203.584152:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776203.584154:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776203.584157:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12175 00000100:00080000:3.0:1775776203.584160:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776203.584163:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776203.584167:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776203.584175:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612749056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776203.584292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612748544:192.168.201.137@tcp:250:kworker.0 00000800:00000100:1.0:1775776203.584369:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776203.584407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776203/real 1775776203] req@ffff8de1c7af7800 x1862023612748544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776203.584453:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612748544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776203.584464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776203.584469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776203.584473:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612748544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776203.584481:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776203.584501:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776203.584513:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776203/real 1775776203] req@ffff8de1c7af5180 x1862023612748672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776203.584523:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612748672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776203.584530:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776203.584533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776203.584537:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776203.584542:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776203.584559:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776203.584567:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776203/real 1775776203] req@ffff8de1c7af4380 x1862023612748800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776203.584582:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612748800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776203.584590:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776203.584593:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776203.584595:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776203.584605:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776203.584621:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776203.584630:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776203/real 1775776203] req@ffff8de1c7af7100 x1862023612748928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776203.584641:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612748928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776203.584648:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776203.584651:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776203.584654:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612748928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776203.584659:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776203.584675:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776203.584683:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776203/real 1775776203] req@ffff8de1c7af5f80 x1862023612749056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776203.584693:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612749056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776203.584700:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776203.584703:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776203.584706:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776204.543923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776205.567888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776206.591909:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776207.615961:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776208.639851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776208.703904:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776208.703916:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776208.703921:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776208.703934:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12180 00000100:00080000:2.0:1775776208.703949:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776208.703957:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776208.704001:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612749184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776208.704031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776208.704035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776208.704037:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776208.704041:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12180 00000100:00080000:2.0:1775776208.704045:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776208.704049:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776208.704060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776208.704086:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612749312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776208.704099:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776208.704100:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612749184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776208.704105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776208.704109:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776208.704114:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12180 00000100:00080000:2.0:1775776208.704118:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776208.704122:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776208.704127:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776208.704143:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612749440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776208.704160:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776208.704163:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776208.704165:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776208.704169:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12180 00000100:00080000:2.0:1775776208.704172:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776208.704176:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776208.704181:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776208.704192:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612749568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776208.704199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776208.704205:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776208.704209:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776208.704211:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776208.704215:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12180 00000100:00080000:2.0:1775776208.704218:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776208.704221:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776208.704226:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776208.704236:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612749696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776208.704262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776208/real 1775776208] req@ffff8de1d0f2ca80 x1862023612749184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776208.704279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612749184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776208.704291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776208.704295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776208.704299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612749184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776208.704324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776208.704359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776208.704370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776208/real 1775776208] req@ffff8de1d0f2d500 x1862023612749312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776208.704378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612749312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776208.704387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776208.704389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776208.704391:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776208.704395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776208.704407:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776208.704412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776208/real 1775776208] req@ffff8de1d0f2df80 x1862023612749440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776208.704419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612749440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776208.704423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776208.704425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776208.704427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776208.704431:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776208.704440:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776208.704447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776208/real 1775776208] req@ffff8de1d0f2e300 x1862023612749568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776208.704458:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612749568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776208.704466:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776208.704469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776208.704472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776208.704477:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776208.704496:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776208.704506:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776208/real 1775776208] req@ffff8de1d0f2e680 x1862023612749696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776208.704517:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612749696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776208.704524:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776208.704527:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776208.704530:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776209.663931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776210.687893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776211.711933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776212.735904:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776213.759913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776213.823873:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776213.823882:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776213.823887:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776213.823896:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12185 00000100:00080000:2.0:1775776213.823909:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776213.823915:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776213.823956:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612749824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776213.823980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776213.823983:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776213.823984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776213.823987:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12185 00000100:00080000:2.0:1775776213.823989:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776213.823991:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776213.824000:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776213.824008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612749952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776213.824015:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776213.824017:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776213.824018:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776213.824021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12185 00000100:00080000:2.0:1775776213.824023:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776213.824028:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776213.824029:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612749824:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775776213.824033:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776213.824047:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612750080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776213.824057:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776213.824061:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776213.824063:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776213.824067:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12185 00000100:00080000:2.0:1775776213.824071:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776213.824075:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776213.824080:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776213.824090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612750208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776213.824096:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776213.824100:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:1.0:1775776213.824102:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776213.824102:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776213.824107:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12185 00000100:00080000:2.0:1775776213.824109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776213.824111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776213.824114:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776213.824120:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612750336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776213.824155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776213/real 1775776213] req@ffff8de1d0f2f100 x1862023612749824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776213.824172:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612749824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776213.824181:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776213.824184:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776213.824186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612749824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776213.824192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776213.824208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776213.824215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776213/real 1775776213] req@ffff8de1d0f2c700 x1862023612749952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776213.824225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612749952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776213.824232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776213.824235:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776213.824238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612749952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776213.824380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776213.824396:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776213.824404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776213/real 1775776213] req@ffff8de1d0f2e680 x1862023612750080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776213.824412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612750080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776213.824421:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776213.824423:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776213.824426:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776213.824429:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776213.824438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776213.824443:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776213/real 1775776213] req@ffff8de1d0f2e300 x1862023612750208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776213.824450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612750208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776213.824454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776213.824455:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776213.824457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776213.824459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776213.824469:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776213.824473:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776213/real 1775776213] req@ffff8de1d0f2df80 x1862023612750336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776213.824479:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612750336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776213.824483:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776213.824485:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776213.824487:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776214.783865:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776215.807926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776216.831936:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776217.855967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776218.879937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776218.943899:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776218.943912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776218.943917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776218.943931:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12190 00000100:00080000:0.0:1775776218.943951:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776218.943960:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776218.944013:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612750464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776218.944047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776218.944051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776218.944053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776218.944058:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12190 00000100:00080000:0.0:1775776218.944061:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776218.944065:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776218.944077:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776218.944089:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612750592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776218.944101:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776218.944104:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776218.944106:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776218.944110:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612750464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776218.944113:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12190 00000100:00080000:0.0:1775776218.944120:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776218.944124:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776218.944129:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776218.944142:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612750720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776218.944151:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776218.944155:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776218.944157:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776218.944188:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12190 00000100:00080000:0.0:1775776218.944200:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776218.944204:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776218.944211:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776218.944212:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776218.944226:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612750848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776218.944237:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776218.944241:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776218.944243:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776218.944247:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12190 00000100:00080000:0.0:1775776218.944251:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776218.944255:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776218.944260:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776218.944267:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776218/real 1775776218] req@ffff8de1c5680e00 x1862023612750464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776218.944273:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612750976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776218.944305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612750464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776218.944317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776218.944322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776218.944327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612750464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776218.944355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776218.944389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776218.944403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776218/real 1775776218] req@ffff8de1c5683480 x1862023612750592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776218.944415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612750592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776218.944423:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776218.944426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776218.944429:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776218.944435:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776218.944454:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776218.944464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776218/real 1775776218] req@ffff8de1c5683800 x1862023612750720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776218.944475:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612750720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776218.944482:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776218.944484:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776218.944487:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776218.944493:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776218.944509:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776218.944517:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776218/real 1775776218] req@ffff8de1c5681500 x1862023612750848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776218.944528:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612750848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776218.944534:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776218.944537:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776218.944540:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776218.944545:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776218.944569:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776218.944578:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776218/real 1775776218] req@ffff8de1c5681880 x1862023612750976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776218.944587:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612750976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776218.944595:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776218.944597:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776218.944600:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612750976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776219.903943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776220.927912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776221.951876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776222.975956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776223.999916:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776224.063862:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776224.063871:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776224.063876:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776224.063886:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12195 00000100:00080000:0.0:1775776224.063898:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776224.063905:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776224.063953:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612751104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776224.063977:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776224.063980:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776224.063982:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776224.063985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12195 00000100:00080000:0.0:1775776224.063987:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776224.063989:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776224.064000:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776224.064012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612751232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776224.064022:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776224.064025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776224.064026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776224.064029:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12195 00000100:00080000:0.0:1775776224.064032:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776224.064035:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776224.064038:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776224.064049:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612751104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776224.064053:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612751360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776224.064062:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776224.064065:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776224.064066:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776224.064068:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12195 00000100:00080000:0.0:1775776224.064082:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776224.064086:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776224.064090:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776224.064098:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612751488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776224.064104:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776224.064107:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776224.064108:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776224.064111:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12195 00000100:00080000:0.0:1775776224.064128:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776224.064131:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776224.064134:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776224.064142:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612751616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776224.064144:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776224.064191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776224/real 1775776224] req@ffff8de1c5681880 x1862023612751104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776224.064211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612751104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776224.064222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776224.064226:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776224.064230:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612751104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776224.064238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776224.064263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776224.064274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776224/real 1775776224] req@ffff8de1c5681500 x1862023612751232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776224.064286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612751232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776224.064294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776224.064297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776224.064300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776224.064331:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776224.064351:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776224.064362:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776224/real 1775776224] req@ffff8de1c5683800 x1862023612751360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776224.064373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612751360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776224.064381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776224.064384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776224.064387:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776224.064393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776224.064411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776224.064420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776224/real 1775776224] req@ffff8de1c5683480 x1862023612751488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776224.064431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612751488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776224.064439:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776224.064442:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776224.064445:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776224.064450:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776224.064469:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776224.064479:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776224/real 1775776224] req@ffff8de1c5680e00 x1862023612751616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776224.064490:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612751616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776224.064497:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776224.064500:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776224.064502:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776225.023978:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776226.047885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776227.071970:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776228.095946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776229.119922:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776229.183870:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776229.183883:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776229.183888:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776229.183902:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12200 00000100:00080000:1.0:1775776229.183916:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776229.183922:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776229.183965:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612751744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776229.184011:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776229.184014:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776229.184015:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776229.184019:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12200 00000100:00080000:1.0:1775776229.184021:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776229.184024:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776229.184033:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776229.184046:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612751872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776229.184056:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612751744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776229.184060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776229.184063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776229.184064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776229.184068:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12200 00000100:00080000:1.0:1775776229.184070:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776229.184072:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776229.184075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776229.184083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612752000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776229.184095:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776229.184098:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776229.184099:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776229.184102:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12200 00000100:00080000:1.0:1775776229.184105:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776229.184107:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776229.184110:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776229.184117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612752128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776229.184123:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776229.184125:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776229.184126:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776229.184130:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12200 00000800:00000100:2.0:1775776229.184130:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776229.184135:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776229.184138:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776229.184140:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776229.184148:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612752256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776229.184176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776229/real 1775776229] req@ffff8de1c2e16a00 x1862023612751744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776229.184195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612751744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776229.184208:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776229.184212:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776229.184215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612751744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776229.184239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776229.184266:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776229.184279:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776229/real 1775776229] req@ffff8de1c2e17100 x1862023612751872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776229.184289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612751872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776229.184296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776229.184298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776229.184301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612751872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776229.184305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776229.184321:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776229.184327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776229/real 1775776229] req@ffff8de1c2e14380 x1862023612752000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776229.184335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612752000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776229.184341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776229.184343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776229.184345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776229.184351:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776229.184363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776229.184372:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776229/real 1775776229] req@ffff8de1c2e16680 x1862023612752128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776229.184380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612752128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776229.184385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776229.184387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776229.184390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776229.184395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776229.184412:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776229.184424:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776229/real 1775776229] req@ffff8de1c2e17b80 x1862023612752256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776229.184436:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612752256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776229.184445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776229.184450:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776229.184452:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776230.143940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776231.167930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776232.191901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776233.215961:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776234.239903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776234.303823:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776234.303833:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776234.303837:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776234.303847:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12206 00000100:00080000:3.0:1775776234.303860:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776234.303866:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776234.303921:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612752384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776234.303947:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776234.303951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776234.303952:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776234.303956:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12206 00000100:00080000:3.0:1775776234.303960:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776234.303964:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776234.303976:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776234.303991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612752512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776234.304001:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776234.304005:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776234.304007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776234.304011:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12206 00000100:00080000:3.0:1775776234.304015:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776234.304019:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776234.304026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776234.304038:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612752384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776234.304039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612752640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776234.304062:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776234.304066:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776234.304068:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776234.304074:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12206 00000100:00080000:3.0:1775776234.304080:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776234.304085:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776234.304091:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776234.304104:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612752768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776234.304114:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776234.304118:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776234.304120:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776234.304125:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12206 00000100:00080000:3.0:1775776234.304130:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775776234.304136:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776234.304141:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776234.304148:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776234.304164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612752896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776234.304180:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776234/real 1775776234] req@ffff8de1c7af4a80 x1862023612752384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776234.304198:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612752384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776234.304207:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776234.304211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776234.304214:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612752384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776234.304220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776234.304239:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776234.304247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776234/real 1775776234] req@ffff8de1c7af5880 x1862023612752512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776234.304255:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612752512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776234.304260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776234.304263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776234.304265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776234.304284:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776234.304294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776234.304300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776234/real 1775776234] req@ffff8de1c7af5500 x1862023612752640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776234.304307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612752640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776234.304317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776234.304319:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776234.304321:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776234.304325:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776234.304335:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776234.304340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776234/real 1775776234] req@ffff8de1c7af4e00 x1862023612752768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776234.304347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612752768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776234.304352:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776234.304354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776234.304355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776234.304359:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776234.304369:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776234.304375:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776234/real 1775776234] req@ffff8de1c7af6d80 x1862023612752896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776234.304382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612752896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776234.304386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776234.304388:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776234.304390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612752896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776235.263940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776236.287900:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776237.311905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776238.335926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776239.359917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776239.423901:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776239.423912:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776239.423917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776239.423928:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12211 00000100:00080000:1.0:1775776239.423939:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776239.423946:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776239.423984:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612753024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776239.424018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776239.424022:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776239.424024:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776239.424029:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12211 00000100:00080000:1.0:1775776239.424033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776239.424037:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776239.424048:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776239.424063:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612753152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776239.424072:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612753024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776239.424080:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776239.424085:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776239.424087:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776239.424093:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12211 00000100:00080000:1.0:1775776239.424097:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776239.424102:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776239.424108:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776239.424121:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612753280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776239.424132:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776239.424138:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:2.0:1775776239.424139:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776239.424141:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776239.424148:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12211 00000100:00080000:1.0:1775776239.424153:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776239.424158:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776239.424164:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776239.424177:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612753408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776239.424180:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776239/real 1775776239] req@ffff8de1c2e15500 x1862023612753024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776239.424204:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776239.424209:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776239.424211:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1775776239.424214:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612753024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776239.424219:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12211 00000100:00080000:1.0:1775776239.424227:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776239.424232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776239.424234:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776239.424242:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:2.0:1775776239.424242:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776239.424249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612753024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776239.424258:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612753536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776239.424277:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776239.424304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776239.424316:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776239/real 1775776239] req@ffff8de1c2e17480 x1862023612753152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776239.424328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612753152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776239.424335:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776239.424338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776239.424341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776239.424347:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776239.424364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776239.424374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776239/real 1775776239] req@ffff8de1c2e14700 x1862023612753280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776239.424395:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612753280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776239.424406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776239.424409:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776239.424412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776239.424417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776239.424436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776239.424447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776239/real 1775776239] req@ffff8de1c2e14e00 x1862023612753408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776239.424458:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612753408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776239.424465:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776239.424468:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776239.424471:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776239.424476:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776239.424494:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776239.424504:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776239/real 1775776239] req@ffff8de1c2e17800 x1862023612753536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776239.424515:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612753536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776239.424522:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776239.424525:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776239.424529:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776240.383954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776241.407938:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776242.431959:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776243.455946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776244.479980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776244.543837:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776244.543846:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776244.543851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776244.543860:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12216 00000100:00080000:0.0:1775776244.543878:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776244.543885:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776244.543926:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612753664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776244.543953:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776244.543957:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776244.543958:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776244.543963:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12216 00000100:00080000:0.0:1775776244.543967:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776244.543971:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776244.543983:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776244.543984:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612753664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776244.544001:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612753792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776244.544013:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776244.544017:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776244.544019:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776244.544023:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12216 00000100:00080000:0.0:1775776244.544027:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776244.544032:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776244.544037:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776244.544050:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612753920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775776244.544054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776244.544063:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776244.544067:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776244.544069:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776244.544074:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12216 00000100:00080000:0.0:1775776244.544078:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776244.544083:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776244.544088:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776244.544098:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776244/real 1775776244] req@ffff8de1c5681c00 x1862023612753664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776244.544101:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612754048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776244.544119:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776244.544124:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1775776244.544125:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612753664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776244.544128:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776244.544136:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12216 00000100:00080000:0.0:1775776244.544142:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776244.544143:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776244.544148:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:2.0:1775776244.544150:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:0.0:1775776244.544155:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776244.544156:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612753664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776244.544171:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612754176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776244.544187:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776244.544216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776244.544225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776244/real 1775776244] req@ffff8de1c5680380 x1862023612753792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776244.544239:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612753792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776244.544246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776244.544250:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776244.544254:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776244.544260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776244.544278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776244.544286:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776244/real 1775776244] req@ffff8de1c5682a00 x1862023612753920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776244.544293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612753920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776244.544298:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776244.544300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776244.544302:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612753920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776244.544306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776244.544317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776244.544321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776244/real 1775776244] req@ffff8de1c5681f80 x1862023612754048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776244.544328:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612754048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776244.544332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776244.544333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776244.544335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776244.544338:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776244.544347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776244.544352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776244/real 1775776244] req@ffff8de1c5680000 x1862023612754176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776244.544358:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612754176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776244.544362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776244.544363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776244.544364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776245.503882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776246.527928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776247.551948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776248.575980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776249.599923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776249.663886:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776249.663898:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776249.663904:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776249.663923:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12221 00000100:00080000:0.0:1775776249.663942:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776249.663951:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776249.664001:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612754304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776249.664042:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776249.664046:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776249.664048:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776249.664052:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12221 00000100:00080000:0.0:1775776249.664056:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776249.664059:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776249.664071:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776249.664085:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612754432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776249.664096:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776249.664110:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776249.664112:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776249.664118:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12221 00000100:00080000:0.0:1775776249.664122:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776249.664129:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776249.664134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612754304:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775776249.664137:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776249.664155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612754560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776249.664168:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776249.664172:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776249.664174:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776249.664178:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12221 00000100:00080000:0.0:1775776249.664182:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776249.664189:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776249.664196:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776249.664208:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612754688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776249.664218:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:2.0:1775776249.664226:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776249.664228:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776249.664230:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776249.664235:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12221 00000100:00080000:0.0:1775776249.664245:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776249.664249:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776249.664256:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776249.664269:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612754816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776249.664280:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776249/real 1775776249] req@ffff8de1c5683b80 x1862023612754304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776249.664295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612754304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776249.664303:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776249.664306:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776249.664309:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612754304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776249.664314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776249.664332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776249.664339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776249/real 1775776249] req@ffff8de1c5680700 x1862023612754432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776249.664350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612754432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776249.664355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776249.664356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776249.664358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776249.664375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776249.664385:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776249.664391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776249/real 1775776249] req@ffff8de1c5682d80 x1862023612754560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776249.664404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612754560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776249.664408:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776249.664410:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776249.664412:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776249.664415:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776249.664426:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776249.664431:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776249/real 1775776249] req@ffff8de1c5682300 x1862023612754688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776249.664442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612754688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776249.664454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776249.664457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776249.664461:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776249.664466:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776249.664483:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776249.664492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776249/real 1775776249] req@ffff8de1c5682680 x1862023612754816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776249.664502:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612754816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776249.664507:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776249.664509:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776249.664511:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612754816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776250.623970:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776251.647852:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776252.671927:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776253.695851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776254.719859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776254.783863:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776254.783872:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776254.783878:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776254.783888:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12226 00000100:00080000:3.0:1775776254.783901:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776254.783908:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776254.783948:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612754944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776254.783974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776254.783977:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776254.783978:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776254.783981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12226 00000100:00080000:3.0:1775776254.783983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776254.783985:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776254.783993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776254.784002:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612755072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776254.784008:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776254.784011:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776254.784012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776254.784014:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12226 00000100:00080000:3.0:1775776254.784016:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776254.784020:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776254.784021:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612754944:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775776254.784022:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776254.784031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612755200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776254.784042:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776254.784046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776254.784047:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776254.784051:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12226 00000100:00080000:3.0:1775776254.784054:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776254.784057:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776254.784062:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776254.784073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612755328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776254.784082:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776254.784085:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776254.784087:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776254.784091:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12226 00000100:00080000:3.0:1775776254.784095:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776254.784097:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776254.784102:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775776254.784106:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776254.784114:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612755456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776254.784144:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776254/real 1775776254] req@ffff8de1c7af5c00 x1862023612754944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776254.784158:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612754944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776254.784169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776254.784173:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776254.784176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612754944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776254.784181:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776254.784195:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776254.784202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776254/real 1775776254] req@ffff8de1c7af7b80 x1862023612755072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776254.784210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612755072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776254.784214:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776254.784216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776254.784218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776254.784237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776254.784246:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776254.784251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776254/real 1775776254] req@ffff8de1c7af7480 x1862023612755200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776254.784257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612755200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776254.784262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776254.784263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776254.784265:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776254.784269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776254.784278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776254.784282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776254/real 1775776254] req@ffff8de1c7af6680 x1862023612755328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776254.784289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612755328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776254.784293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776254.784295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776254.784296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776254.784299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776254.784307:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776254.784312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776254/real 1775776254] req@ffff8de1c7af6300 x1862023612755456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776254.784317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612755456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776254.784321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776254.784323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776254.784324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776255.743928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776256.767937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776257.791906:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776258.815877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776259.839954:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776259.903840:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776259.903850:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776259.903856:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776259.903867:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12231 00000100:00080000:3.0:1775776259.903882:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776259.903891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776259.903935:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612755584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776259.903962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776259.903965:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776259.903967:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776259.903970:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12231 00000100:00080000:3.0:1775776259.903973:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776259.903975:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776259.903984:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776259.903993:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612755712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776259.904002:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776259.904005:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776259.904007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776259.904011:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12231 00000100:00080000:3.0:1775776259.904014:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776259.904016:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776259.904021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776259.904022:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612755584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776259.904039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612755840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776259.904050:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776259.904055:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776259.904057:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776259.904061:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12231 00000100:00080000:3.0:1775776259.904066:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776259.904070:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776259.904076:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776259.904090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612755968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776259.904099:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776259.904102:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776259.904104:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776259.904120:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12231 00000800:00000100:2.0:1775776259.904125:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776259.904127:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776259.904133:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776259.904139:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776259.904152:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612756096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776259.904174:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776259/real 1775776259] req@ffff8de1c7af4700 x1862023612755584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776259.904192:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612755584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776259.904201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776259.904204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776259.904208:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612755584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776259.904215:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776259.904239:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776259.904250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776259/real 1775776259] req@ffff8de1c7af4000 x1862023612755712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776259.904263:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612755712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776259.904269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776259.904272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776259.904274:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776259.904303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776259.904317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776259.904324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776259/real 1775776259] req@ffff8de1c7af6a00 x1862023612755840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776259.904336:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612755840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776259.904341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776259.904343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776259.904344:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776259.904348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776259.904356:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776259.904361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776259/real 1775776259] req@ffff8de1c7af6300 x1862023612755968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776259.904367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612755968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776259.904371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776259.904373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776259.904375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612755968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776259.904377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776259.904386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776259.904390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776259/real 1775776259] req@ffff8de1c7af6680 x1862023612756096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776259.904396:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612756096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776259.904405:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776259.904407:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776259.904408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776260.863892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776261.887907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776262.911846:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776263.935892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776264.959933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776265.023866:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776265.023878:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776265.023884:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776265.023897:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12236 00000100:00080000:3.0:1775776265.023912:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776265.023921:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776265.023965:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612756224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776265.023996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776265.024000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776265.024003:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776265.024008:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12236 00000100:00080000:3.0:1775776265.024013:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776265.024017:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776265.024029:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776265.024037:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612756224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776265.024045:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612756352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776265.024058:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776265.024062:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776265.024063:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776265.024068:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12236 00000100:00080000:3.0:1775776265.024073:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776265.024077:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776265.024083:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776265.024097:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612756480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776265.024107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776265.024111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776265.024113:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776265.024117:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12236 00000100:00080000:3.0:1775776265.024122:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776265.024127:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776265.024133:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776265.024144:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612756608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776265.024155:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776265.024159:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776265.024161:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776265.024165:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12236 00000100:00080000:3.0:1775776265.024170:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775776265.024172:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756352:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775776265.024177:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776265.024210:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776265.024244:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756608:192.168.201.137@tcp:8:kworker.0 00000008:00100000:3.0:1775776265.024279:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776265.024295:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612756736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776265.024334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776265.983950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776267.007868:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776268.031864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1775776268.096045:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:0.0:1775776268.096107:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1775776268.096129:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775776268.096183:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775776268.096193:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775776268.096201:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:0.0:1775776268.096209:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:2.0:1775776268.096245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776265/real 1775776268] req@ffff8de1c7af4e00 x1862023612756736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776268.096276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612756736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776268.096289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776268.096295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776268.096300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756736:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776268.096336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776265/real 1775776268] req@ffff8de1c7af7b80 x1862023612756352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776268.096351:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612756352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776268.096359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776268.096363:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776268.096366:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776268.096375:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776265/real 1775776268] req@ffff8de1c7af5c00 x1862023612756480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776268.096387:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612756480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776268.096394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776268.096398:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776268.096401:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776268.096407:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776265/real 1775776268] req@ffff8de1c7af6d80 x1862023612756608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776268.096418:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612756608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776268.096425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776268.096429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776268.096432:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776268.096438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776265/real 1775776268] req@ffff8de1c7af7480 x1862023612756224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776268.096452:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612756224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776268.096461:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776268.096465:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776268.096467:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612756224:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775776269.055851:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776270.079880:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776270.143862:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776270.143872:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776270.143877:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776270.143887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12241 00000100:00080000:1.0:1775776270.143900:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776270.143907:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776270.143946:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612756864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776270.143981:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776270.143985:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776270.143987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776270.143992:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12241 00000100:00080000:1.0:1775776270.143997:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776270.144001:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776270.144012:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776270.144027:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612756992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776270.144038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776270.144041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776270.144043:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776270.144047:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12241 00000100:00080000:1.0:1775776270.144059:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776270.144063:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776270.144067:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776270.144077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612757120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776270.144085:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776270.144088:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776270.144090:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776270.144094:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12241 00000100:00080000:1.0:1775776270.144097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776270.144101:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776270.144106:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776270.144117:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612757248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776270.144125:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776270.144128:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776270.144130:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776270.144134:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12241 00000100:00080000:1.0:1775776270.144138:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776270.144142:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776270.144147:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776270.144158:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612757376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776270.144167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612756864:192.168.201.137@tcp:250:kworker.0 00000800:00000100:2.0:1775776270.144258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776270.144339:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776270/real 1775776270] req@ffff8de1c2e14a80 x1862023612756864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776270.144360:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612756864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776270.144372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776270.144377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776270.144382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612756864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776270.144390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776270.144413:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776270.144424:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776270/real 1775776270] req@ffff8de1c2e17800 x1862023612756992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776270.144435:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612756992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776270.144450:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776270.144453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776270.144457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612756992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776270.144463:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776270.144482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776270.144493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776270/real 1775776270] req@ffff8de1c2e14e00 x1862023612757120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776270.144504:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612757120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776270.144511:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776270.144515:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776270.144518:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776270.144524:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776270.144543:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776270.144553:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776270/real 1775776270] req@ffff8de1c2e14700 x1862023612757248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776270.144571:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612757248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776270.144578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776270.144581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776270.144586:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776270.144630:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776270.144650:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776270.144660:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776270/real 1775776270] req@ffff8de1c2e17480 x1862023612757376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776270.144671:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612757376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776270.144679:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776270.144682:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776270.144686:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776271.103837:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776272.127881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776273.151852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776274.175908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776275.199937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776275.263856:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776275.263864:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776275.263868:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776275.263876:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12247 00000100:00080000:0.0:1775776275.263886:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776275.263891:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776275.263925:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612757504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776275.263954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776275.263957:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776275.263959:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776275.263962:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12247 00000100:00080000:0.0:1775776275.263964:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776275.263967:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776275.263975:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776275.263984:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612757632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776275.263992:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776275.263995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776275.263996:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776275.264001:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12247 00000100:00100000:2.0:1775776275.264001:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612757504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776275.264005:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776275.264008:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776275.264011:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776275.264020:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612757760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776275.264025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776275.264028:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776275.264029:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776275.264032:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12247 00000100:00080000:0.0:1775776275.264035:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776275.264038:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776275.264041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776275.264048:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612757888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776275.264054:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776275.264057:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776275.264058:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:2.0:1775776275.264062:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776275.264065:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12247 00000100:00080000:0.0:1775776275.264069:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776275.264071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776275.264075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776275.264083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612758016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776275.264102:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776275/real 1775776275] req@ffff8de1c5682680 x1862023612757504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776275.264116:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612757504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776275.264124:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776275.264127:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776275.264129:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612757504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776275.264149:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776275.264164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776275.264172:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776275/real 1775776275] req@ffff8de1c5682300 x1862023612757632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776275.264206:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612757632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776275.264212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776275.264214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776275.264216:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776275.264220:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776275.264235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776275.264241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776275/real 1775776275] req@ffff8de1c5682d80 x1862023612757760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776275.264248:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612757760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776275.264253:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776275.264255:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776275.264257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776275.264260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776275.264270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776275.264275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776275/real 1775776275] req@ffff8de1c5680700 x1862023612757888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776275.264284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612757888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776275.264292:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776275.264295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776275.264299:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612757888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776275.264305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776275.264325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776275.264336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776275/real 1775776275] req@ffff8de1c5683b80 x1862023612758016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776275.264348:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612758016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776275.264356:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776275.264359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776275.264362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776276.223957:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776277.247934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776278.271920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776279.295954:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776280.319944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776280.383897:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776280.383911:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776280.383917:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776280.383930:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12252 00000100:00080000:1.0:1775776280.383945:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776280.383953:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776280.384008:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612758144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776280.384036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776280.384039:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776280.384040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776280.384044:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12252 00000100:00080000:1.0:1775776280.384047:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776280.384050:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776280.384060:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776280.384070:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612758272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776280.384080:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776280.384082:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776280.384083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776280.384099:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12252 00000100:00100000:2.0:1775776280.384103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612758144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776280.384104:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776280.384111:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776280.384118:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776280.384132:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612758400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776280.384142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776280.384146:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776280.384148:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776280.384152:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12252 00000100:00080000:1.0:1775776280.384157:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776280.384160:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776280.384165:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776280.384172:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612758528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776280.384178:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776280.384181:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776280.384182:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776280.384184:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12252 00000100:00080000:1.0:1775776280.384186:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776280.384188:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776280.384191:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775776280.384198:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776280.384202:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612758656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776280.384247:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776280/real 1775776280] req@ffff8de1c2e15500 x1862023612758144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776280.384267:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612758144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776280.384279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776280.384283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776280.384287:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612758144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776280.384314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776280.384336:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776280.384347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776280/real 1775776280] req@ffff8de1c2e17b80 x1862023612758272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776280.384359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612758272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776280.384366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776280.384369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776280.384372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776280.384377:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776280.384395:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776280.384403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776280/real 1775776280] req@ffff8de1c2e16680 x1862023612758400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776280.384413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612758400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776280.384420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776280.384433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776280.384436:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776280.384442:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776280.384460:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776280.384471:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776280/real 1775776280] req@ffff8de1c2e14380 x1862023612758528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776280.384481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612758528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776280.384488:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776280.384491:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776280.384494:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776280.384499:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776280.384515:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776280.384524:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776280/real 1775776280] req@ffff8de1c2e17100 x1862023612758656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776280.384535:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612758656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776280.384542:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776280.384545:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776280.384547:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776281.343946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776282.367947:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776283.391979:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776284.415949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776285.439955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776285.503876:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776285.503890:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776285.503897:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776285.503909:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12257 00000100:00080000:1.0:1775776285.503925:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776285.503933:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776285.503984:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612758784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776285.504047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776285.504051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776285.504053:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776285.504058:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12257 00000100:00080000:1.0:1775776285.504062:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776285.504066:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776285.504078:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776285.504095:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612758912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776285.504106:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776285.504110:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776285.504112:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776285.504117:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12257 00000100:00080000:1.0:1775776285.504122:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776285.504126:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776285.504132:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776285.504139:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612758784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776285.504151:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612759040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776285.504170:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776285.504175:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776285.504177:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776285.504182:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12257 00000100:00080000:1.0:1775776285.504189:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776285.504194:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776285.504200:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:2.0:1775776285.504209:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776285.504216:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612759168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776285.504228:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776285.504233:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776285.504235:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776285.504241:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12257 00000100:00080000:1.0:1775776285.504246:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1775776285.504248:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776285/real 1775776285] req@ffff8de1c2e16a00 x1862023612758784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776285.504255:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776285.504269:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776285.504296:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612759296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776285.504297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612758784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776285.504338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776285.504346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776285.504351:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612758784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776285.504358:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776285.504378:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776285.504390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776285/real 1775776285] req@ffff8de1c2e17100 x1862023612758912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776285.504398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612758912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776285.504404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776285.504406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776285.504408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612758912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776285.504428:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776285.504438:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776285.504447:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776285/real 1775776285] req@ffff8de1c2e14380 x1862023612759040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776285.504466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612759040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776285.504473:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776285.504476:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776285.504479:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776285.504485:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776285.504504:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776285.504514:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776285/real 1775776285] req@ffff8de1c2e16680 x1862023612759168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776285.504525:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612759168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776285.504533:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776285.504537:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776285.504540:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776285.504546:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776285.504565:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776285.504575:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776285/real 1775776285] req@ffff8de1c2e17b80 x1862023612759296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776285.504586:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612759296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776285.504598:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776285.504601:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776285.504604:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776286.463937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776287.488214:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776288.511873:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776289.535888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776290.559887:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776290.623858:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776290.623868:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776290.623872:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776290.623883:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12262 00000100:00080000:0.0:1775776290.623897:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776290.623906:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776290.623967:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612759424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776290.624007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776290.624010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776290.624012:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776290.624016:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12262 00000100:00080000:0.0:1775776290.624019:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776290.624022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776290.624032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776290.624043:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612759552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776290.624050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776290.624053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776290.624056:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776290.624058:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12262 00000100:00080000:0.0:1775776290.624061:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776290.624064:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776290.624068:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776290.624077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612759680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776290.624086:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776290.624090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776290.624092:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776290.624101:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12262 00000100:00100000:2.0:1775776290.624101:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612759424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776290.624111:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776290.624121:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776290.624126:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776290.624136:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612759808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776290.624142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776290.624145:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776290.624146:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776290.624149:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12262 00000100:00080000:0.0:1775776290.624152:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776290.624155:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776290.624157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776290.624164:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612759936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775776290.624194:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776290.624239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776290/real 1775776290] req@ffff8de1c5680000 x1862023612759424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776290.624261:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612759424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776290.624272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776290.624278:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776290.624283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612759424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776290.624292:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776290.624320:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776290.624334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776290/real 1775776290] req@ffff8de1c5681f80 x1862023612759552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776290.624349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612759552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776290.624364:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776290.624369:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776290.624372:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776290.624400:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776290.624425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776290.624437:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776290/real 1775776290] req@ffff8de1c5682a00 x1862023612759680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776290.624450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612759680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776290.624458:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776290.624462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776290.624466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776290.624473:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776290.624496:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776290.624508:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776290/real 1775776290] req@ffff8de1c5680380 x1862023612759808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776290.624521:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612759808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776290.624530:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776290.624534:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776290.624538:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776290.624545:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776290.624566:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776290.624578:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776290/real 1775776290] req@ffff8de1c5681c00 x1862023612759936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776290.624591:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612759936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776290.624599:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776290.624603:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776290.624606:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612759936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776291.583909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776292.607910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776293.631899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776294.655971:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776295.679926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776295.743917:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776295.743927:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776295.743932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776295.743942:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12267 00000100:00080000:1.0:1775776295.743956:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776295.743963:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776295.744007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612760064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776295.744033:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776295.744036:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776295.744037:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776295.744040:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12267 00000100:00080000:1.0:1775776295.744042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776295.744045:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776295.744055:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776295.744062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612760192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776295.744069:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776295.744072:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776295.744073:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776295.744076:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12267 00000100:00080000:1.0:1775776295.744077:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776295.744081:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776295.744081:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612760064:192.168.201.137@tcp:250:kworker.0 00000008:00100000:1.0:1775776295.744087:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776295.744096:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612760320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776295.744103:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776295.744106:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776295.744107:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776295.744111:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12267 00000100:00080000:1.0:1775776295.744115:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776295.744119:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776295.744124:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776295.744135:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612760448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776295.744145:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776295.744149:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776295.744151:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776295.744154:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12267 00000100:00080000:1.0:1775776295.744159:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:2.0:1775776295.744159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776295.744166:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776295.744171:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776295.744180:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612760576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776295.744201:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776295/real 1775776295] req@ffff8de1c2e15500 x1862023612760064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776295.744216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612760064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776295.744224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776295.744227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776295.744235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612760064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776295.744241:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776295.744258:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776295.744266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776295/real 1775776295] req@ffff8de1c2e17480 x1862023612760192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776295.744273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612760192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776295.744278:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776295.744280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776295.744282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776295.744303:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776295.744312:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776295.744317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776295/real 1775776295] req@ffff8de1c2e14700 x1862023612760320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776295.744326:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612760320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776295.744333:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776295.744337:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776295.744339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776295.744345:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776295.744362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776295.744373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776295/real 1775776295] req@ffff8de1c2e14e00 x1862023612760448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776295.744384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612760448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776295.744389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776295.744391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776295.744393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776295.744404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776295.744417:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776295.744423:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776295/real 1775776295] req@ffff8de1c2e17800 x1862023612760576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776295.744433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612760576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776295.744440:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776295.744443:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776295.744446:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776296.703943:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776297.727933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776298.751965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776299.775898:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776300.799965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776300.863844:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776300.863856:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776300.863861:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776300.863883:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12272 00000100:00080000:1.0:1775776300.863900:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776300.863910:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776300.863957:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612760704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776300.863991:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776300.863995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776300.863997:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776300.864003:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12272 00000100:00080000:1.0:1775776300.864009:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776300.864014:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776300.864026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776300.864041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612760704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776300.864042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612760832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776300.864072:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776300.864074:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776300.864076:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776300.864080:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12272 00000100:00080000:1.0:1775776300.864085:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776300.864087:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776300.864091:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776300.864108:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612760960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776300.864117:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776300.864120:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776300.864122:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776300.864125:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12272 00000100:00080000:1.0:1775776300.864131:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776300.864136:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776300.864140:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775776300.864143:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776300.864155:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612761088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776300.864163:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776300.864166:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776300.864167:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776300.864170:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12272 00000100:00080000:1.0:1775776300.864174:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776300.864177:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776300.864182:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776300.864194:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612761216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776300.864195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776300/real 1775776300] req@ffff8de1c2e14a80 x1862023612760704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776300.864251:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612760704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776300.864265:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776300.864271:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776300.864275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612760704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776300.864306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776300.864333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776300.864344:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776300/real 1775776300] req@ffff8de1c2e17800 x1862023612760832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776300.864369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612760832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776300.864377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776300.864381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776300.864384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776300.864391:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776300.864411:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776300.864421:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776300/real 1775776300] req@ffff8de1c2e14e00 x1862023612760960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776300.864433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612760960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776300.864441:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776300.864445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776300.864448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612760960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776300.864455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776300.864477:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776300.864488:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776300/real 1775776300] req@ffff8de1c2e14700 x1862023612761088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776300.864513:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612761088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776300.864521:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776300.864529:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776300.864535:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776300.864541:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776300.864565:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776300.864594:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776300/real 1775776300] req@ffff8de1c2e17480 x1862023612761216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776300.864615:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612761216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776300.864624:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776300.864628:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776300.864631:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776301.823937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776302.847939:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776303.871948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776304.895929:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776305.919855:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776305.983871:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776305.983882:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776305.983887:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776305.983899:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12277 00000100:00080000:3.0:1775776305.983912:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776305.983920:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776305.983966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612761344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776305.983997:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776305.984001:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776305.984003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776305.984008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12277 00000100:00080000:3.0:1775776305.984011:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776305.984015:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776305.984026:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776305.984037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612761472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776305.984048:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776305.984051:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776305.984058:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776305.984061:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12277 00000100:00080000:3.0:1775776305.984065:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775776305.984069:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612761344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776305.984071:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776305.984077:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776305.984091:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612761600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776305.984102:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776305.984105:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776305.984108:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776305.984111:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12277 00000100:00080000:3.0:1775776305.984115:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776305.984118:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776305.984124:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776305.984133:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612761728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776305.984142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776305.984146:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776305.984148:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776305.984151:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12277 00000100:00080000:3.0:1775776305.984154:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775776305.984160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776305.984160:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776305.984166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776305.984177:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612761856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776305.984211:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776305/real 1775776305] req@ffff8de1c7af5500 x1862023612761344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776305.984237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612761344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776305.984255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776305.984260:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776305.984264:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612761344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776305.984272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776305.984294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776305.984305:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776305/real 1775776305] req@ffff8de1c7af5880 x1862023612761472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776305.984317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612761472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776305.984324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776305.984327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776305.984331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776305.984362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776305.984387:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776305.984397:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776305/real 1775776305] req@ffff8de1c7af4a80 x1862023612761600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776305.984409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612761600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776305.984417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776305.984420:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776305.984424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776305.984430:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776305.984447:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776305.984456:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776305/real 1775776305] req@ffff8de1c7af5f80 x1862023612761728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776305.984467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612761728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776305.984474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776305.984478:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776305.984481:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776305.984488:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776305.984514:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776305.984523:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776305/real 1775776305] req@ffff8de1c7af7100 x1862023612761856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776305.984534:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612761856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776305.984541:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776305.984544:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776305.984547:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612761856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776306.943944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776307.967899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776308.991931:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776310.016114:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776311.039998:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776311.103950:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776311.103963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776311.103969:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776311.103980:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12282 00000100:00080000:1.0:1775776311.103995:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776311.104003:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776311.104051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612761984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776311.104086:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776311.104092:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776311.104094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776311.104098:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12282 00000100:00080000:1.0:1775776311.104102:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776311.104106:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776311.104118:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776311.104144:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612762112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776311.104165:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775776311.104167:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612761984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776311.104172:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776311.104175:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776311.104180:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12282 00000100:00080000:1.0:1775776311.104184:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776311.104188:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776311.104193:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776311.104207:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612762240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776311.104216:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776311.104220:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776311.104222:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776311.104225:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12282 00000100:00080000:1.0:1775776311.104231:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776311.104236:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:0.0:1775776311.104242:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:1.0:1775776311.104242:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776311.104255:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612762368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776311.104265:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776311.104268:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776311.104270:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776311.104274:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12282 00000100:00080000:1.0:1775776311.104279:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775776311.104283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776311/real 1775776311] req@ffff8de1c2e15500 x1862023612761984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776311.104286:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776311.104296:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776311.104305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612761984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776311.104312:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612762496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776311.104315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776311.104322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776311.104327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612761984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776311.104349:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776311.104363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776311.104370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776311/real 1775776311] req@ffff8de1c2e17b80 x1862023612762112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776311.104377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612762112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776311.104381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776311.104383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776311.104385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776311.104388:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776311.104397:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776311.104401:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776311/real 1775776311] req@ffff8de1c2e16680 x1862023612762240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776311.104408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612762240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776311.104416:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776311.104418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776311.104420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776311.104422:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776311.104432:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776311.104436:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776311/real 1775776311] req@ffff8de1c2e14380 x1862023612762368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776311.104442:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612762368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776311.104446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776311.104447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776311.104449:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776311.104452:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776311.104460:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776311.104464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776311/real 1775776311] req@ffff8de1c2e17100 x1862023612762496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776311.104469:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612762496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776311.104473:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776311.104475:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776311.104477:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776312.063943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776313.087912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776314.111929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776315.136083:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776316.159899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776316.223894:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776316.223906:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776316.223911:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776316.223925:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12287 00000100:00080000:3.0:1775776316.223940:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776316.223948:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776316.224004:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612762624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776316.224034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776316.224039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776316.224041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776316.224045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12287 00000100:00080000:3.0:1775776316.224050:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776316.224054:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776316.224066:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776316.224086:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612762624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776316.224113:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612762752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776316.224125:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776316.224129:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776316.224131:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776316.224135:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12287 00000100:00080000:3.0:1775776316.224139:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776316.224143:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776316.224147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776316.224157:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612762880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776316.224166:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776316.224169:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776316.224171:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775776316.224175:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776316.224178:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12287 00000100:00080000:3.0:1775776316.224183:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776316.224187:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776316.224193:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776316.224210:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612763008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776316.224225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776316/real 1775776316] req@ffff8de1c7af4380 x1862023612762624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776316.224227:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776316.224233:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776316.224237:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776316.224243:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12287 00000100:00080000:3.0:1775776316.224246:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776316.224250:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776316.224255:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776316.224257:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612762624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776316.224268:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612763136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776316.224274:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776316.224281:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776316.224285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612762624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776316.224334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776316.224359:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776316.224371:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776316/real 1775776316] req@ffff8de1c7af5180 x1862023612762752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776316.224383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612762752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776316.224391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776316.224395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776316.224399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776316.224405:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776316.224424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776316.224432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776316/real 1775776316] req@ffff8de1c7af7800 x1862023612762880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776316.224439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612762880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776316.224445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776316.224447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776316.224449:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612762880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776316.224452:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776316.224488:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776316.224499:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776316/real 1775776316] req@ffff8de1c7af7100 x1862023612763008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776316.224511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612763008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776316.224518:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776316.224521:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776316.224525:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776316.224530:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776316.224548:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776316.224554:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776316/real 1775776316] req@ffff8de1c7af5f80 x1862023612763136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776316.224562:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612763136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776316.224567:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776316.224569:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776316.224571:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776317.183892:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776318.207938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776319.231959:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776320.255938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776321.279918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776321.343840:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776321.343849:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776321.343852:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776321.343861:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12293 00000100:00080000:2.0:1775776321.343869:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776321.343875:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776321.343902:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612763264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776321.343924:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776321.343927:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776321.343928:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776321.343931:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12293 00000100:00080000:2.0:1775776321.343934:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776321.343936:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776321.343943:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776321.343951:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612763392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776321.343957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776321.343960:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776321.343962:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776321.343966:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12293 00000100:00080000:2.0:1775776321.343969:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776321.343972:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776321.343977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776321.343989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612763264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776321.343991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612763520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776321.344005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776321.344007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776321.344009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776321.344012:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12293 00000100:00080000:2.0:1775776321.344015:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776321.344018:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776321.344022:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776321.344030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612763648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776321.344039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776321.344043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:0.0:1775776321.344044:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776321.344045:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776321.344049:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12293 00000100:00080000:2.0:1775776321.344052:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776321.344054:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776321.344057:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776321.344064:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612763776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776321.344073:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776321/real 1775776321] req@ffff8de1d0f2d500 x1862023612763264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776321.344087:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612763264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776321.344093:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776321.344096:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776321.344100:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612763264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776321.344106:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776321.344124:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776321.344136:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776321/real 1775776321] req@ffff8de1d0f2ca80 x1862023612763392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776321.344148:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612763392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776321.344155:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776321.344157:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776321.344159:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776321.344178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776321.344191:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776321.344198:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776321/real 1775776321] req@ffff8de1d0f2df80 x1862023612763520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776321.344204:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612763520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776321.344209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776321.344211:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776321.344213:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776321.344216:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776321.344224:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776321.344228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776321/real 1775776321] req@ffff8de1d0f2e300 x1862023612763648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776321.344237:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612763648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776321.344244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776321.344247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776321.344249:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776321.344255:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776321.344272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776321.344281:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776321/real 1775776321] req@ffff8de1d0f2e680 x1862023612763776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776321.344293:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612763776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776321.344300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776321.344302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776321.344305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612763776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776322.303930:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776323.327897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776324.351878:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776325.375867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776326.399847:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776326.463843:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776326.463850:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776326.463853:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776326.463860:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12298 00000100:00080000:3.0:1775776326.463869:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776326.463875:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776326.463907:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612763904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776326.463932:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776326.463934:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776326.463936:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776326.463938:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12298 00000100:00080000:3.0:1775776326.463940:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776326.463943:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776326.463951:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776326.463962:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612764032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776326.463972:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776326.463975:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776326.463977:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776326.463981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12298 00000100:00080000:3.0:1775776326.463985:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775776326.463988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612763904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776326.463990:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776326.463998:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776326.464010:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612764160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776326.464019:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776326.464023:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776326.464025:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776326.464028:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12298 00000100:00080000:3.0:1775776326.464032:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776326.464035:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776326.464040:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776326.464051:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612764288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775776326.464053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776326.464063:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776326.464073:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776326.464076:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776326.464081:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12298 00000100:00080000:3.0:1775776326.464086:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775776326.464090:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776326/real 1775776326] req@ffff8de1c7af4a80 x1862023612763904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776326.464091:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776326.464098:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776326.464113:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612764416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776326.464117:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612763904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776326.464136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776326.464140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776326.464144:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612763904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776326.464151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776326.464173:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776326.464184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776326/real 1775776326] req@ffff8de1c7af5880 x1862023612764032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776326.464195:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612764032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776326.464209:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776326.464212:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776326.464215:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776326.464238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776326.464256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776326.464266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776326/real 1775776326] req@ffff8de1c7af5500 x1862023612764160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776326.464277:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612764160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776326.464300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776326.464305:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776326.464308:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776326.464314:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776326.464332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776326.464342:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776326/real 1775776326] req@ffff8de1c7af7480 x1862023612764288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776326.464353:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612764288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776326.464361:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776326.464364:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776326.464367:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776326.464372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776326.464389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776326.464399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776326/real 1775776326] req@ffff8de1c7af6d80 x1862023612764416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776326.464411:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612764416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776326.464418:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776326.464421:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776326.464424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776327.423869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776328.447895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776329.471927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776330.495917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776331.519918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776331.583867:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776331.583875:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776331.583879:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776331.583887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12303 00000100:00080000:1.0:1775776331.583897:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776331.583902:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776331.583933:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612764544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776331.583961:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776331.583965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776331.583967:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776331.583972:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12303 00000100:00080000:1.0:1775776331.583976:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776331.583980:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776331.583990:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776331.584008:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612764544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776331.584009:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612764672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776331.584026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776331.584030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776331.584032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776331.584037:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12303 00000100:00080000:1.0:1775776331.584042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776331.584046:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776331.584051:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776331.584066:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612764800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776331.584077:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776331.584080:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776331.584083:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776331.584087:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12303 00000100:00080000:1.0:1775776331.584092:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776331.584096:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776331.584103:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776331.584105:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776331.584120:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612764928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776331.584138:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764800:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775776331.584140:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776331.584146:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776331.584149:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776331.584154:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12303 00000100:00080000:1.0:1775776331.584160:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776331.584164:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776331.584169:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764928:192.168.201.137@tcp:8:kworker.0 00000008:00100000:1.0:1775776331.584172:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776331.584190:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612765056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776331.584238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776332.543938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776333.567888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776334.591918:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776334.656057:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776334.656105:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776334.656124:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775776334.656364:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776331/real 1775776334] req@ffff8de1c2e16a00 x1862023612764544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776356 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776334.656412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612764544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776356 ref 2 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776334.656426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776334.656434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776334.656439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612764544:192.168.201.137@tcp:250:kworker.0 00000800:00000100:2.0:1775776334.656861:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775776334.657258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776331/real 1775776334] req@ffff8de1c2e17100 x1862023612764672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776356 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776334.657281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612764672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776356 ref 2 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776334.657294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776334.657300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776334.657305:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776334.657370:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775776334.657472:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776331/real 1775776334] req@ffff8de1c2e14380 x1862023612764800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000100:2.0:1775776334.657472:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776334.657483:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:0.0:1775776334.657489:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612764800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776334.657498:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776334.657502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776334.657507:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776334.657524:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776331/real 1775776334] req@ffff8de1c2e17b80 x1862023612765056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776334.657536:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612765056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776334.657558:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776334.657563:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776334.657566:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765056:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776334.657575:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776331/real 1775776334] req@ffff8de1c2e16680 x1862023612764928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776334.657591:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612764928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776334.657600:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776334.657603:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776334.657607:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612764928:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776335.615940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776336.639907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776336.703887:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776336.703902:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776336.703908:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776336.703923:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12308 00000100:00080000:3.0:1775776336.703940:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776336.703948:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776336.703990:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612765184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776336.704030:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776336.704034:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776336.704036:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776336.704040:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12308 00000100:00080000:3.0:1775776336.704044:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776336.704047:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776336.704059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776336.704071:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612765312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776336.704100:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776336.704104:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776336.704137:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776336.704144:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12308 00000100:00080000:3.0:1775776336.704149:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776336.704153:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776336.704159:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776336.704176:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612765440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776336.704188:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776336.704191:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776336.704193:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776336.704197:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12308 00000100:00080000:3.0:1775776336.704201:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776336.704205:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776336.704211:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776336.704240:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612765568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776336.704254:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776336.704262:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776336.704265:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776336.704271:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12308 00000100:00100000:1.0:1775776336.704274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612765184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776336.704276:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776336.704286:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776336.704296:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776336.704315:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612765696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776336.704370:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776336.704404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776336/real 1775776336] req@ffff8de1c7af5c00 x1862023612765184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776336.704433:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612765184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776336.704445:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776336.704450:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776336.704454:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612765184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776336.704463:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776336.704491:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776336.704505:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776336/real 1775776336] req@ffff8de1c7af7b80 x1862023612765312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776336.704518:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612765312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776336.704527:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776336.704531:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776336.704534:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776336.704541:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776336.704565:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776336.704577:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776336/real 1775776336] req@ffff8de1c7af4e00 x1862023612765440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776336.704591:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612765440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776336.704600:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776336.704604:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776336.704608:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776336.704638:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776336.704662:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776336.704675:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776336/real 1775776336] req@ffff8de1c7af6680 x1862023612765568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776336.704689:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612765568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776336.704703:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776336.704707:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776336.704710:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776336.706219:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776336.706282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776336.706304:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776336/real 1775776336] req@ffff8de1c7af6300 x1862023612765696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776336.706320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612765696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776336.706330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776336.706335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776336.706339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776337.663899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776338.687931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776339.711962:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776340.735978:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776341.759942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776341.823870:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776341.823880:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776341.823885:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776341.823896:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12313 00000100:00080000:1.0:1775776341.823909:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776341.823916:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776341.823960:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612765824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776341.823989:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776341.823993:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776341.823995:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776341.823998:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12313 00000100:00080000:1.0:1775776341.824001:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776341.824003:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776341.824013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776341.824045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612765952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776341.824048:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612765824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776341.824067:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776341.824071:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776341.824073:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776341.824079:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12313 00000100:00080000:1.0:1775776341.824085:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776341.824089:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776341.824096:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776341.824111:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612766080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775776341.824123:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776341.824123:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776341.824130:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776341.824133:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776341.824148:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12313 00000100:00080000:1.0:1775776341.824154:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776341.824159:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776341.824165:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776341/real 1775776341] req@ffff8de1c2e15500 x1862023612765824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:1.0:1775776341.824165:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776341.824182:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612766208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776341.824187:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612765824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776341.824197:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776341.824202:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776341.824204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776341.824205:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776341.824210:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:1.0:1775776341.824214:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12313 00000100:00100000:0.0:1775776341.824218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612765824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776341.824221:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776341.824228:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776341.824234:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776341.824248:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612766336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776341.824249:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776341.824283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776341.824302:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776341/real 1775776341] req@ffff8de1c2e17480 x1862023612765952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776341.824318:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612765952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776341.824327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776341.824331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776341.824335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612765952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776341.824341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776341.824363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776341.824374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776341/real 1775776341] req@ffff8de1c2e14700 x1862023612766080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776341.824382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612766080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776341.824388:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776341.824391:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776341.824393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776341.824397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776341.824410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776341.824416:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776341/real 1775776341] req@ffff8de1c2e14e00 x1862023612766208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776341.824423:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612766208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776341.824435:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776341.824439:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776341.824442:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776341.824461:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776341.824482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776341.824493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776341/real 1775776341] req@ffff8de1c2e17800 x1862023612766336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776341.824507:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612766336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776341.824515:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776341.824519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776341.824523:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776342.783922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776343.807977:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776344.831909:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776345.855940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776346.880080:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776346.943864:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776346.943876:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776346.943881:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776346.943891:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12318 00000100:00080000:2.0:1775776346.943905:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776346.943913:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776346.943979:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612766464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776346.944002:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776346.944006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776346.944007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776346.944010:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12318 00000100:00080000:2.0:1775776346.944014:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776346.944018:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776346.944028:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776346.944032:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612766464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776346.944039:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612766592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776346.944046:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776346.944049:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776346.944049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776346.944052:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12318 00000100:00080000:2.0:1775776346.944054:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776346.944056:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776346.944059:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776346.944067:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612766720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776346.944073:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776346.944076:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776346.944077:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776346.944079:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12318 00000100:00080000:2.0:1775776346.944081:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776346.944083:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776346.944086:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776346.944091:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612766848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776346.944097:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776346.944100:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776346.944101:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776346.944103:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12318 00000100:00080000:2.0:1775776346.944106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:0.0:1775776346.944112:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776346.944112:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776346.944119:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776346.944129:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612766976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776346.944153:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776346/real 1775776346] req@ffff8de1d0f2c700 x1862023612766464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776346.944168:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612766464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776346.944175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776346.944178:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776346.944181:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612766464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776346.944205:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776346.944220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776346.944227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776346/real 1775776346] req@ffff8de1d0f2f100 x1862023612766592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776346.944234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612766592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776346.944239:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776346.944240:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776346.944242:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776346.944246:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776346.944255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776346.944260:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776346/real 1775776346] req@ffff8de1d0f2e680 x1862023612766720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776346.944266:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612766720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776346.944281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776346.944283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776346.944285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776346.944289:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776346.944300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776346.944305:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776346/real 1775776346] req@ffff8de1d0f2e300 x1862023612766848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776346.944312:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612766848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776346.944317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776346.944318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776346.944320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776346.944323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776346.944332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776346.944336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776346/real 1775776346] req@ffff8de1d0f2df80 x1862023612766976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776346.944343:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612766976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776346.944347:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776346.944349:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776346.944350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612766976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776347.903905:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776348.927948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776349.951956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776350.975939:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776351.999836:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776352.063903:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776352.063917:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776352.063923:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776352.063935:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12323 00000100:00080000:3.0:1775776352.063950:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776352.063958:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776352.064007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612767104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776352.064039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776352.064043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776352.064044:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776352.064049:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12323 00000100:00080000:3.0:1775776352.064052:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776352.064056:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776352.064067:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776352.064089:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612767232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776352.064100:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775776352.064103:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612767104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776352.064105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776352.064108:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776352.064114:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12323 00000100:00080000:3.0:1775776352.064117:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776352.064120:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776352.064125:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776352.064144:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612767360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776352.064153:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776352.064157:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776352.064158:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776352.064162:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12323 00000100:00080000:3.0:1775776352.064165:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776352.064169:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776352.064175:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775776352.064185:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776352.064187:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612767488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776352.064196:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776352.064199:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776352.064201:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776352.064206:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12323 00000100:00080000:3.0:1775776352.064210:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776352.064222:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776352.064227:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776352.064233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776352/real 1775776352] req@ffff8de1c7af6a00 x1862023612767104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776352.064239:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612767616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776352.064265:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612767104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776352.064284:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776352.064290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776352.064295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612767104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776352.064324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776352.064347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776352.064360:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776352/real 1775776352] req@ffff8de1c7af4000 x1862023612767232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776352.064371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612767232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776352.064378:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776352.064382:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776352.064385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776352.064390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776352.064407:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776352.064416:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776352/real 1775776352] req@ffff8de1c7af4700 x1862023612767360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776352.064427:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612767360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776352.064434:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776352.064437:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776352.064440:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776352.064446:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776352.064463:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776352.064473:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776352/real 1775776352] req@ffff8de1c7af6300 x1862023612767488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776352.064484:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612767488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776352.064491:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776352.064494:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776352.064496:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776352.064502:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776352.064521:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776352.064528:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776352/real 1775776352] req@ffff8de1c7af6680 x1862023612767616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776352.064535:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612767616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776352.064540:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776352.064542:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776352.064544:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776353.024042:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776354.047951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776355.071945:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776356.095958:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776357.119952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776357.183832:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776357.183844:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776357.183850:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776357.183862:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12328 00000100:00080000:3.0:1775776357.183876:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776357.183884:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776357.183930:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612767744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776357.183961:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776357.183965:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776357.183966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776357.183971:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12328 00000100:00080000:3.0:1775776357.183973:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776357.183976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776357.183987:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776357.183997:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612767872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776357.184007:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776357.184010:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776357.184012:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776357.184015:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12328 00000100:00080000:3.0:1775776357.184019:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775776357.184023:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612767744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776357.184025:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776357.184032:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776357.184041:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612768000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776357.184057:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776357.184060:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776357.184062:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776357.184066:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12328 00000100:00080000:3.0:1775776357.184069:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776357.184073:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776357.184077:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776357.184086:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612768128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776357.184095:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776357.184098:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776357.184100:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776357.184104:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12328 00000800:00000100:0.0:1775776357.184108:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776357.184109:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776357.184115:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776357.184119:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776357.184128:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612768256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776357.184156:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776357/real 1775776357] req@ffff8de1c7af4e00 x1862023612767744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776357.184189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612767744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776357.184200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776357.184206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776357.184210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612767744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776357.184225:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776357.184249:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776357.184263:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776357/real 1775776357] req@ffff8de1c7af7b80 x1862023612767872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776357.184275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612767872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776357.184282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776357.184286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776357.184289:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612767872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776357.184318:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776357.184338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776357.184348:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776357/real 1775776357] req@ffff8de1c7af5c00 x1862023612768000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776357.184359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612768000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776357.184373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776357.184377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776357.184380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776357.184386:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776357.184404:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776357.184414:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776357/real 1775776357] req@ffff8de1c7af6d80 x1862023612768128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776357.184425:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612768128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776357.184442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776357.184445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776357.184448:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776357.184453:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776357.184471:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776357.184481:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776357/real 1775776357] req@ffff8de1c7af7480 x1862023612768256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776357.184491:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612768256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776357.184499:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776357.184501:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776357.184505:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776358.143951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776359.168080:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776360.191966:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776361.215933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776362.239927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776362.303805:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776362.303817:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776362.303822:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776362.303832:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12334 00000100:00080000:3.0:1775776362.303844:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776362.303850:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776362.303889:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612768384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776362.303918:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776362.303921:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776362.303922:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776362.303925:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12334 00000100:00080000:3.0:1775776362.303927:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776362.303929:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776362.303939:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776362.303947:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612768512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776362.303954:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776362.303956:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776362.303957:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776362.303960:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12334 00000100:00080000:3.0:1775776362.303962:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776362.303965:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776362.303966:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612768384:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775776362.303970:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776362.303977:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612768640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776362.303983:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776362.303986:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776362.303987:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776362.303989:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12334 00000100:00080000:3.0:1775776362.303990:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776362.303992:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776362.303995:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776362.304003:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612768768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776362.304008:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776362.304010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776362.304011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776362.304014:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12334 00000100:00080000:3.0:1775776362.304022:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776362.304024:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776362.304027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776362.304033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612768896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775776362.304039:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776362.304083:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776362/real 1775776362] req@ffff8de1c7af5500 x1862023612768384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776362.304108:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612768384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776362.304118:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776362.304122:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776362.304127:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612768384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776362.304134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776362.304160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776362.304169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776362/real 1775776362] req@ffff8de1c7af5880 x1862023612768512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776362.304177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612768512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776362.304182:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776362.304184:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776362.304186:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776362.304206:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776362.304216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776362.304222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776362/real 1775776362] req@ffff8de1c7af4a80 x1862023612768640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776362.304228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612768640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776362.304235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776362.304238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776362.304241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776362.304247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776362.304265:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776362.304274:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776362/real 1775776362] req@ffff8de1c7af5f80 x1862023612768768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776362.304281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612768768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776362.304289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776362.304292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776362.304294:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776362.304299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776362.304316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776362.304323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776362/real 1775776362] req@ffff8de1c7af7100 x1862023612768896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776362.304330:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612768896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776362.304342:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776362.304344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776362.304346:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612768896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776363.263938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776364.287885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776365.311938:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776366.335878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776367.359914:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776367.423898:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776367.423908:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776367.423913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776367.423923:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12339 00000100:00080000:3.0:1775776367.423936:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776367.423944:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776367.424001:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612769024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776367.424034:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776367.424037:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776367.424039:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776367.424042:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12339 00000100:00080000:3.0:1775776367.424045:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776367.424054:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776367.424065:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776367.424081:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612769152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776367.424093:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775776367.424097:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612769024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776367.424098:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776367.424100:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776367.424108:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12339 00000100:00080000:3.0:1775776367.424112:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776367.424114:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776367.424118:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776367.424128:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612769280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776367.424142:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776367.424145:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776367.424147:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776367.424152:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12339 00000100:00080000:3.0:1775776367.424155:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776367.424159:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776367.424165:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775776367.424181:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776367.424188:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612769408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776367.424197:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776367.424201:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776367.424203:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776367.424207:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12339 00000100:00080000:3.0:1775776367.424211:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776367.424215:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776367.424220:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776367.424230:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612769536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776367.424235:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776367/real 1775776367] req@ffff8de1c7af7800 x1862023612769024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776367.424273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612769024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776367.424283:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776367.424288:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776367.424292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612769024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776367.424321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776367.424345:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776367.424357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776367/real 1775776367] req@ffff8de1c7af5180 x1862023612769152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776367.424369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612769152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776367.424377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776367.424380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776367.424384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776367.424391:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776367.424410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776367.424420:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776367/real 1775776367] req@ffff8de1c7af4380 x1862023612769280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776367.424428:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612769280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776367.424432:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776367.424434:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776367.424436:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776367.424440:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776367.424455:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776367.424464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776367/real 1775776367] req@ffff8de1c7af7100 x1862023612769408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776367.424474:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612769408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776367.424482:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776367.424485:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776367.424488:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776367.424494:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776367.424513:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776367.424523:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776367/real 1775776367] req@ffff8de1c7af5f80 x1862023612769536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776367.424534:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612769536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776367.424541:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776367.424543:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776367.424546:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776368.383908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776369.407859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776370.431951:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776371.455912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776372.479907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776372.543855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776372.543862:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776372.543866:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776372.543873:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12344 00000100:00080000:1.0:1775776372.543883:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776372.543888:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776372.543916:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612769664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776372.543939:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776372.543942:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776372.543943:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776372.543947:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12344 00000100:00080000:1.0:1775776372.543950:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776372.543954:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776372.543962:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776372.543976:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612769792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776372.543990:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612769664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776372.543998:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776372.544002:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776372.544003:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776372.544008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12344 00000100:00080000:1.0:1775776372.544012:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776372.544017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776372.544022:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776372.544034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612769920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775776372.544044:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776372.544044:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776372.544048:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776372.544050:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776372.544055:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12344 00000100:00080000:1.0:1775776372.544060:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1775776372.544074:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776372/real 1775776372] req@ffff8de1c2e14a80 x1862023612769664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776372.544074:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776372.544081:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776372.544096:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612770048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776372.544099:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612769664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776372.544126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776372.544128:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776372.544132:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:1.0:1775776372.544133:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776372.544136:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775776372.544139:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612769664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776372.544142:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12344 00000100:00080000:1.0:1775776372.544145:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776372.544148:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776372.544152:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776372.544161:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612770176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776372.544176:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776372.544206:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776372.544218:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776372/real 1775776372] req@ffff8de1c2e17800 x1862023612769792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776372.544230:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612769792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776372.544244:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776372.544247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776372.544251:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776372.544258:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776372.544279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776372.544288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776372/real 1775776372] req@ffff8de1c2e14e00 x1862023612769920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776372.544300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612769920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776372.544308:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776372.544311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776372.544314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612769920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776372.544321:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776372.544340:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776372.544350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776372/real 1775776372] req@ffff8de1c2e14700 x1862023612770048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776372.544363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612770048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776372.544373:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776372.544377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776372.544382:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776372.544409:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776372.544434:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776372.544448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776372/real 1775776372] req@ffff8de1c2e17480 x1862023612770176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776372.544459:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612770176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776372.544466:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776372.544469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776372.544472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776373.503901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776374.527927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776375.551885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776376.575882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776377.599923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776377.663881:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776377.663893:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776377.663898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776377.663910:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12349 00000100:00080000:3.0:1775776377.663924:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776377.663932:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776377.663975:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612770304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776377.664006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776377.664009:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776377.664011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776377.664015:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12349 00000100:00080000:3.0:1775776377.664019:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776377.664022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776377.664034:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776377.664045:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612770432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776377.664055:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775776377.664057:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612770304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776377.664060:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776377.664064:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776377.664070:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12349 00000100:00080000:3.0:1775776377.664073:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776377.664076:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776377.664082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776377.664093:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612770560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776377.664101:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776377.664106:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776377.664108:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776377.664121:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12349 00000100:00080000:3.0:1775776377.664125:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776377.664130:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776377.664135:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775776377.664142:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776377.664149:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612770688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776377.664159:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776377.664163:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776377.664165:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776377.664169:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12349 00000100:00080000:3.0:1775776377.664173:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776377.664177:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776377.664183:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776377.664186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776377/real 1775776377] req@ffff8de1c7af4a80 x1862023612770304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776377.664198:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612770816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776377.664212:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612770304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776377.664225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776377.664230:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776377.664235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612770304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776377.664266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776377.664289:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776377.664300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776377/real 1775776377] req@ffff8de1c7af5880 x1862023612770432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776377.664308:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612770432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776377.664314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776377.664316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776377.664318:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776377.664322:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776377.664333:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776377.664338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776377/real 1775776377] req@ffff8de1c7af5500 x1862023612770560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776377.664345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612770560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776377.664349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776377.664350:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776377.664352:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776377.664355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776377.664363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776377.664368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776377/real 1775776377] req@ffff8de1c7af7480 x1862023612770688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776377.664374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612770688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776377.664379:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776377.664381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776377.664383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776377.664385:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776377.664409:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776377.664419:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776377/real 1775776377] req@ffff8de1c7af6d80 x1862023612770816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776377.664429:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612770816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776377.664436:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776377.664439:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776377.664442:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612770816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776378.623999:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776379.647892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776380.671917:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776381.695903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776382.719938:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776382.783845:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776382.783855:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776382.783859:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776382.783869:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12354 00000100:00080000:3.0:1775776382.783881:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776382.783888:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776382.783933:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612770944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776382.783968:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776382.783971:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776382.783973:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776382.783978:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12354 00000100:00080000:3.0:1775776382.783982:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776382.783986:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776382.783999:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776382.784014:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612771072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776382.784025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776382.784029:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776382.784031:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776382.784039:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12354 00000100:00100000:0.0:1775776382.784043:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612770944:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776382.784046:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776382.784057:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776382.784063:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776382.784080:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612771200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776382.784092:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776382.784096:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776382.784097:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776382.784101:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12354 00000100:00080000:3.0:1775776382.784106:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776382.784112:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776382.784122:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:0.0:1775776382.784123:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776382.784140:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612771328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776382.784150:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776382.784153:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776382.784155:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776382.784160:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12354 00000100:00100000:0.0:1775776382.784166:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776382/real 1775776382] req@ffff8de1c7af5c00 x1862023612770944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776382.784168:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776382.784180:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776382.784188:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776382.784194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612770944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776382.784204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775776382.784209:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612771456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776382.784213:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776382.784221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612770944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776382.784238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776382.784261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776382.784275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776382/real 1775776382] req@ffff8de1c7af7b80 x1862023612771072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776382.784283:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612771072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776382.784289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776382.784292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776382.784295:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776382.784327:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776382.784341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776382.784347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776382/real 1775776382] req@ffff8de1c7af4e00 x1862023612771200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776382.784354:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612771200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776382.784359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776382.784362:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776382.784364:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776382.784367:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776382.784377:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776382.784382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776382/real 1775776382] req@ffff8de1c7af6680 x1862023612771328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776382.784389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612771328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776382.784393:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776382.784395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776382.784396:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776382.784399:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776382.784408:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776382.784413:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776382/real 1775776382] req@ffff8de1c7af6300 x1862023612771456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776382.784419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612771456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776382.784424:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776382.784425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776382.784427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776383.743879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776384.767868:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776385.791948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776386.815944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776387.839944:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776387.903854:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776387.903866:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776387.903871:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776387.903882:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12359 00000100:00080000:0.0:1775776387.903897:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776387.903904:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776387.903949:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612771584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776387.903992:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776387.903996:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776387.903998:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776387.904002:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12359 00000100:00080000:0.0:1775776387.904005:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776387.904009:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776387.904021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776387.904033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612771712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776387.904050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776387.904054:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776387.904054:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612771584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776387.904057:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776387.904064:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12359 00000100:00080000:0.0:1775776387.904067:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776387.904070:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776387.904075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776387.904086:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612771840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776387.904095:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776387.904099:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776387.904101:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776387.904105:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12359 00000100:00080000:0.0:1775776387.904124:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776387.904128:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776387.904133:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776387.904138:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776387.904145:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612771968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776387.904155:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776387.904158:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776387.904160:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776387.904165:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12359 00000100:00080000:0.0:1775776387.904169:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776387.904172:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776387.904177:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776387.904184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776387/real 1775776387] req@ffff8de1c5680e00 x1862023612771584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776387.904188:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612772096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776387.904250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612771584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776387.904263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776387.904267:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776387.904272:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612771584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776387.904299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776387.904322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776387.904335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776387/real 1775776387] req@ffff8de1c5683480 x1862023612771712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776387.904348:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612771712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776387.904355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776387.904359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776387.904362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776387.904368:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776387.904386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776387.904395:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776387/real 1775776387] req@ffff8de1c5683800 x1862023612771840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776387.904406:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612771840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776387.904412:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776387.904415:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776387.904418:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776387.904424:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776387.904440:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776387.904448:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776387/real 1775776387] req@ffff8de1c5681500 x1862023612771968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776387.904459:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612771968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776387.904473:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776387.904477:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776387.904480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612771968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776387.904485:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776387.904499:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776387.904505:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776387/real 1775776387] req@ffff8de1c5681880 x1862023612772096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776387.904516:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612772096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776387.904522:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776387.904524:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776387.904526:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776388.863928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776389.887915:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776390.911924:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776391.935870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776392.959843:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776393.023842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776393.023848:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776393.023851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776393.023859:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12364 00000100:00080000:3.0:1775776393.023868:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776393.023873:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776393.023905:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612772224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776393.023931:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776393.023938:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776393.023940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776393.023944:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12364 00000100:00080000:3.0:1775776393.023947:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776393.023952:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776393.023961:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776393.023972:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612772224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776393.023978:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612772352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776393.023989:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776393.023991:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776393.023992:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776393.023994:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12364 00000100:00080000:3.0:1775776393.023997:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776393.024000:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776393.024004:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776393.024012:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612772480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776393.024018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776393.024020:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776393.024021:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776393.024023:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12364 00000100:00080000:3.0:1775776393.024025:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776393.024029:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775776393.024030:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775776393.024032:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776393.024040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612772608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776393.024047:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776393.024049:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776393.024050:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776393.024051:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12364 00000100:00080000:3.0:1775776393.024053:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776393.024056:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776393.024059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776393.024064:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612772736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776393.024070:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776393/real 1775776393] req@ffff8de1c7af4700 x1862023612772224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776393.024091:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612772224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776393.024110:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776393.024115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776393.024119:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612772224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776393.024155:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776393.024180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776393.024192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776393/real 1775776393] req@ffff8de1c7af4000 x1862023612772352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776393.024204:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612772352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776393.024211:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776393.024214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776393.024218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776393.024223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776393.024241:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776393.024251:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776393/real 1775776393] req@ffff8de1c7af6a00 x1862023612772480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776393.024262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612772480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776393.024269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776393.024272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776393.024275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776393.024280:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776393.024297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776393.024306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776393/real 1775776393] req@ffff8de1c7af6300 x1862023612772608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776393.024317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612772608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776393.024323:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776393.024326:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776393.024329:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776393.024347:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776393.024364:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776393.024373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776393/real 1775776393] req@ffff8de1c7af6680 x1862023612772736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776393.024385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612772736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776393.024392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776393.024395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776393.024398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776393.983823:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776395.007889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776396.031890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776397.055869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776398.079882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776398.143865:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776398.143875:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776398.143879:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776398.143887:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12369 00000100:00080000:0.0:1775776398.143897:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776398.143903:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776398.143933:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612772864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776398.143957:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776398.143961:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776398.143963:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776398.143966:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12369 00000100:00080000:0.0:1775776398.143970:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776398.143973:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776398.143982:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776398.143993:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612772992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776398.143999:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612772864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776398.144006:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776398.144010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776398.144011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776398.144016:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12369 00000100:00080000:0.0:1775776398.144019:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776398.144022:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776398.144027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776398.144060:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612773120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776398.144070:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776398.144074:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776398.144075:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776398.144079:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12369 00000100:00080000:0.0:1775776398.144083:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776398.144087:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776398.144092:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772992:192.168.201.137@tcp:38:kworker.0 00000008:00100000:0.0:1775776398.144093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776398.144106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612773248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776398.144117:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776398.144118:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773120:192.168.201.137@tcp:38:kworker.0 00000100:00080000:0.0:1775776398.144123:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776398.144125:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776398.144130:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12369 00000100:00080000:0.0:1775776398.144135:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776398.144138:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776398.144140:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773248:192.168.201.137@tcp:8:kworker.0 00000008:00100000:0.0:1775776398.144145:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776398.144157:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612773376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776398.144178:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776399.103861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776400.127862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776401.151854:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776401.216016:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776401.216055:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776401.216072:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776401.216110:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776401.216124:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776401.216138:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776401.216147:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775776401.216225:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776398/real 1775776401] req@ffff8de1c5680e00 x1862023612773376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776401.216249:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612773376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776401.216261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776401.216266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776401.216270:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773376:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776401.216287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776398/real 1775776401] req@ffff8de1c5683480 x1862023612773248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776401.216298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612773248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776401.216305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776401.216308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776401.216311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776401.216317:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776398/real 1775776401] req@ffff8de1c5681500 x1862023612772992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776401.216329:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612772992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776401.216335:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776401.216338:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776401.216341:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612772992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776401.216347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776398/real 1775776401] req@ffff8de1c5683800 x1862023612773120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776401.216357:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612773120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776401.216364:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776401.216368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776401.216370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776401.216376:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776398/real 1775776401] req@ffff8de1c5681880 x1862023612772864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776401.216387:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612772864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776401.216394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776401.216397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776401.216399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612772864:192.168.201.137@tcp:250:kworker.0 00010000:00010000:2.0:1775776402.175848:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776403.199895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776403.263858:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776403.263866:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776403.263870:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776403.263877:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12375 00000100:00080000:3.0:1775776403.263888:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776403.263894:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776403.263943:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612773504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776403.263985:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776403.263989:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776403.263990:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776403.263994:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12375 00000100:00080000:3.0:1775776403.263999:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776403.264002:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776403.264013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776403.264026:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612773632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776403.264037:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776403.264040:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776403.264041:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612773504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776403.264042:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776403.264049:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12375 00000100:00080000:3.0:1775776403.264052:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776403.264055:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776403.264060:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776403.264083:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612773760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776403.264092:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776403.264095:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776403.264097:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776403.264100:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12375 00000100:00080000:3.0:1775776403.264104:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776403.264108:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776403.264111:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776403.264116:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776403.264125:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612773888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776403.264140:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776403.264143:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776403.264145:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776403.264149:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12375 00000100:00100000:1.0:1775776403.264152:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776403/real 1775776403] req@ffff8de1c7af4e00 x1862023612773504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776403.264153:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776403.264160:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776403.264168:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776403.264180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612773504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776403.264180:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612774016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776403.264212:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776403.264219:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776403.264223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612773504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776403.264260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776403.264281:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776403.264293:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776403/real 1775776403] req@ffff8de1c7af7b80 x1862023612773632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776403.264305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612773632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776403.264312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776403.264315:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776403.264317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776403.264324:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776403.264341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776403.264352:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776403/real 1775776403] req@ffff8de1c7af5c00 x1862023612773760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776403.264363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612773760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776403.264371:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776403.264374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776403.264377:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776403.264383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776403.264401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776403.264410:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776403/real 1775776403] req@ffff8de1c7af6d80 x1862023612773888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776403.264421:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612773888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776403.264428:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776403.264431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776403.264433:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612773888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776403.264439:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776403.264454:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776403.264462:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776403/real 1775776403] req@ffff8de1c7af7480 x1862023612774016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776403.264471:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612774016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776403.264478:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776403.264481:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776403.264483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776404.223907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776405.247866:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776406.271929:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776407.295927:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776408.319883:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776408.383815:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776408.383825:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776408.383830:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776408.383841:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12380 00000100:00080000:3.0:1775776408.383854:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776408.383874:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776408.383921:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612774144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776408.383958:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776408.383962:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776408.383965:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776408.383972:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12380 00000100:00080000:3.0:1775776408.383977:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776408.383982:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776408.383991:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612774144:192.168.201.137@tcp:250:kworker.0 00000008:00100000:3.0:1775776408.383996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776408.384023:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612774272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776408.384036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776408.384039:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776408.384040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776408.384043:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12380 00000100:00080000:3.0:1775776408.384047:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776408.384050:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776408.384056:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000800:00000100:0.0:1775776408.384065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776408.384068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612774400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776408.384076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776408.384079:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776408.384081:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776408.384085:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12380 00000100:00080000:3.0:1775776408.384087:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776408.384089:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776408.384094:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776408.384105:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612774528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776408.384113:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776408/real 1775776408] req@ffff8de1c7af5500 x1862023612774144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776408.384113:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1775776408.384141:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612774144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776408.384153:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776408.384158:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776408.384164:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612774144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776408.384180:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776408.384183:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776408.384187:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12380 00000100:00080000:3.0:1775776408.384190:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776408.384193:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776408.384197:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776408.384199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776408.384209:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612774656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775776408.384234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776408.384257:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776408/real 1775776408] req@ffff8de1c7af5880 x1862023612774272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776408.384272:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612774272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776408.384280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776408.384284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776408.384288:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776408.384295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776408.384316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776408.384328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776408/real 1775776408] req@ffff8de1c7af4a80 x1862023612774400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776408.384341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612774400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776408.384350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776408.384354:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776408.384358:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776408.384365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776408.384389:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776408.384403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776408/real 1775776408] req@ffff8de1c7af5f80 x1862023612774528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776408.384420:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612774528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776408.384430:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776408.384435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776408.384439:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776408.384459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776408.384482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776408.384495:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776408/real 1775776408] req@ffff8de1c7af7100 x1862023612774656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776408.384511:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612774656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776408.384521:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776408.384526:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776408.384531:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776409.343997:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776410.367894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776411.391956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776412.415880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776413.439969:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776413.503854:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776413.503869:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776413.503875:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776413.503888:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12385 00000100:00080000:0.0:1775776413.503904:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776413.503913:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776413.503966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612774784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776413.504005:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776413.504010:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776413.504011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776413.504016:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12385 00000100:00080000:0.0:1775776413.504020:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776413.504024:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776413.504039:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776413.504055:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612774912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776413.504061:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612774784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776413.504076:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776413.504080:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776413.504082:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776413.504088:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12385 00000100:00080000:0.0:1775776413.504093:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776413.504098:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776413.504104:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776413.504118:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612775040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776413.504129:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776413.504134:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776413.504137:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776413.504142:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12385 00000100:00080000:0.0:1775776413.504147:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776413.504152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776413.504154:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776413.504162:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776413.504175:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612775168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776413.504186:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776413.504190:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776413.504192:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776413.504197:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12385 00000100:00080000:0.0:1775776413.504202:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776413.504207:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776413.504208:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776413/real 1775776413] req@ffff8de1c5681c00 x1862023612774784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775776413.504215:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776413.504241:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612775296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776413.504252:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612774784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776413.504271:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776413.504277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776413.504282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612774784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776413.504315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776413.504341:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776413.504355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776413/real 1775776413] req@ffff8de1c5680380 x1862023612774912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776413.504368:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612774912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776413.504376:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776413.504380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776413.504383:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612774912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776413.504389:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776413.504410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776413.504421:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776413/real 1775776413] req@ffff8de1c5682a00 x1862023612775040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776413.504434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612775040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776413.504449:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776413.504452:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776413.504455:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776413.504462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776413.504482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776413.504493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776413/real 1775776413] req@ffff8de1c5681f80 x1862023612775168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776413.504505:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612775168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776413.504513:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776413.504517:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776413.504520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776413.504527:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776413.504547:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776413.504558:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776413/real 1775776413] req@ffff8de1c5680000 x1862023612775296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776413.504570:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612775296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776413.504578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776413.504581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776413.504585:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776414.463948:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776415.487952:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776416.511985:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776417.535938:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776418.559922:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776418.623857:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776418.623867:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776418.623872:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776418.623882:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12390 00000100:00080000:3.0:1775776418.623895:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776418.623902:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776418.623949:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612775424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776418.623986:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776418.623989:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776418.623990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776418.623994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12390 00000100:00080000:3.0:1775776418.623997:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776418.624000:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776418.624011:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776418.624025:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612775552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776418.624028:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612775424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776418.624043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776418.624047:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776418.624048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776418.624053:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12390 00000100:00080000:3.0:1775776418.624056:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776418.624060:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776418.624065:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776418.624085:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612775680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776418.624095:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776418.624098:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776418.624100:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776418.624102:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12390 00000100:00080000:3.0:1775776418.624106:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776418.624111:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776418.624111:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776418.624118:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776418.624127:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612775808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776418.624134:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776418.624137:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776418.624138:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776418.624140:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12390 00000100:00080000:3.0:1775776418.624143:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776418.624151:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776418.624154:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776418.624156:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776418/real 1775776418] req@ffff8de1c7af4380 x1862023612775424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776418.624164:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612775936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776418.624189:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612775424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776418.624201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776418.624206:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776418.624210:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612775424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776418.624238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776418.624261:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776418.624273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776418/real 1775776418] req@ffff8de1c7af5180 x1862023612775552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776418.624285:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612775552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776418.624293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776418.624296:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776418.624300:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776418.624305:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776418.624322:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776418.624331:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776418/real 1775776418] req@ffff8de1c7af7800 x1862023612775680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776418.624342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612775680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776418.624350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776418.624353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776418.624356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776418.624361:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776418.624374:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776418.624381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776418/real 1775776418] req@ffff8de1c7af7100 x1862023612775808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776418.624391:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612775808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776418.624398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776418.624401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776418.624403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776418.624417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776418.624433:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776418.624441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776418/real 1775776418] req@ffff8de1c7af5f80 x1862023612775936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776418.624451:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612775936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776418.624459:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776418.624462:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776418.624465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612775936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776419.583999:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776420.607894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776421.631956:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776422.655907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776423.679894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776423.743854:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776423.743861:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776423.743865:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776423.743873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12395 00000100:00080000:2.0:1775776423.743882:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776423.743888:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776423.743917:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612776064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776423.743939:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776423.743943:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776423.743944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776423.743948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12395 00000100:00080000:2.0:1775776423.743955:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776423.743959:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776423.743968:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776423.743980:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612776192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776423.743989:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612776064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776423.743992:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776423.743998:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776423.744000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776423.744004:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12395 00000100:00080000:2.0:1775776423.744008:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776423.744012:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776423.744017:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776423.744027:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612776320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776423.744032:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776423.744035:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776423.744036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776423.744038:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12395 00000100:00080000:2.0:1775776423.744041:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776423.744043:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776423.744047:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776423.744048:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776423.744055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612776448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776423.744061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776423.744064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776423.744065:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776423.744067:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12395 00000100:00080000:2.0:1775776423.744069:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776423.744071:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776423.744073:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776423.744079:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612776576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776423.744086:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776423/real 1775776423] req@ffff8de1d0f2ca80 x1862023612776064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776423.744105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612776064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776423.744115:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776423.744119:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776423.744123:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612776064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776423.744144:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776423.744164:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776423.744175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776423/real 1775776423] req@ffff8de1d0f2d500 x1862023612776192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776423.744187:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612776192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776423.744201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776423.744204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776423.744207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776423.744214:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776423.744233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776423.744242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776423/real 1775776423] req@ffff8de1d0f2df80 x1862023612776320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776423.744254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612776320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776423.744262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776423.744265:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776423.744268:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776423.744274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776423.744293:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776423.744303:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776423/real 1775776423] req@ffff8de1d0f2e300 x1862023612776448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776423.744314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612776448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776423.744321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776423.744324:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776423.744327:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776423.744332:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776423.744347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776423.744357:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776423/real 1775776423] req@ffff8de1d0f2e680 x1862023612776576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776423.744367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612776576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776423.744374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776423.744376:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776423.744379:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776424.703887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776425.727876:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776426.751871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776427.775851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776428.799880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776428.863808:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776428.863818:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776428.863822:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776428.863831:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12400 00000100:00080000:3.0:1775776428.863840:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776428.863846:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776428.863887:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612776704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776428.863907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776428.863910:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776428.863911:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776428.863913:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12400 00000100:00080000:3.0:1775776428.863916:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776428.863918:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776428.863926:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776428.863938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612776832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776428.863948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776428.863950:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612776704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776428.863956:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776428.863959:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776428.863964:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12400 00000100:00080000:3.0:1775776428.863968:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776428.863971:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776428.863977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776428.863989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612776960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776428.863999:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776428.864002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:1.0:1775776428.864005:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776428.864005:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776428.864012:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12400 00000100:00080000:3.0:1775776428.864016:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776428.864020:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776428.864026:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776428.864037:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776428/real 1775776428] req@ffff8de1c7af4a80 x1862023612776704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776428.864037:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612777088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776428.864065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776428.864068:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776428.864069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776428.864073:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12400 00000100:00100000:1.0:1775776428.864074:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612776704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776428.864078:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776428.864084:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776428.864089:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775776428.864091:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776428.864096:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776428.864099:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612776704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776428.864102:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612777216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776428.864126:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776428.864149:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776428.864161:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776428/real 1775776428] req@ffff8de1c7af5880 x1862023612776832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776428.864169:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612776832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776428.864187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776428.864189:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776428.864191:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776428.864195:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776428.864208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776428.864214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776428/real 1775776428] req@ffff8de1c7af5500 x1862023612776960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776428.864221:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612776960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776428.864225:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776428.864227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776428.864229:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612776960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776428.864232:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776428.864247:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776428.864252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776428/real 1775776428] req@ffff8de1c7af7480 x1862023612777088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776428.864258:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612777088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776428.864263:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776428.864264:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776428.864267:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776428.864270:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776428.864279:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776428.864284:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776428/real 1775776428] req@ffff8de1c7af6d80 x1862023612777216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776428.864289:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612777216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776428.864294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776428.864295:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776428.864297:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776429.823861:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776430.847880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776431.871848:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776432.895899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776433.919915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776433.983839:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776433.983847:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776433.983852:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776433.983860:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12405 00000100:00080000:2.0:1775776433.983870:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776433.983876:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776433.983907:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612777344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776433.983938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776433.983942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776433.983944:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776433.983948:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12405 00000100:00080000:2.0:1775776433.983950:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776433.983953:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776433.983963:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776433.983973:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612777472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776433.983983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776433.983988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612777344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776433.983988:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776433.983990:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776433.983999:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12405 00000100:00080000:2.0:1775776433.984002:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776433.984005:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776433.984009:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776433.984020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612777600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776433.984028:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776433.984031:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776433.984033:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776433.984037:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12405 00000100:00080000:2.0:1775776433.984040:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776433.984044:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775776433.984049:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:2.0:1775776433.984050:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776433.984061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612777728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776433.984070:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776433.984073:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776433.984075:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776433.984078:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12405 00000100:00080000:2.0:1775776433.984081:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776433.984083:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776433/real 1775776433] req@ffff8de1d0f2f100 x1862023612777344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776433.984086:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776433.984090:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776433.984098:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612777856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776433.984122:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612777344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776433.984139:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776433.984143:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776433.984147:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612777344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776433.984168:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776433.984189:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776433.984200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776433/real 1775776433] req@ffff8de1d0f2c700 x1862023612777472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776433.984211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612777472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776433.984219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776433.984221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776433.984225:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776433.984230:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776433.984256:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776433.984266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776433/real 1775776433] req@ffff8de1d0f2e680 x1862023612777600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776433.984278:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612777600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776433.984286:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776433.984289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776433.984292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776433.984298:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776433.984314:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776433.984323:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776433/real 1775776433] req@ffff8de1d0f2e300 x1862023612777728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776433.984334:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612777728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776433.984341:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776433.984345:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776433.984347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776433.984352:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776433.984370:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776433.984379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776433/real 1775776433] req@ffff8de1d0f2df80 x1862023612777856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776433.984390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612777856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776433.984398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776433.984401:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776433.984404:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612777856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776434.943876:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776435.967888:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776436.991849:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776438.015850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776439.039955:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776439.103891:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776439.103904:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776439.103909:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776439.103921:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12410 00000100:00080000:3.0:1775776439.103936:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776439.103945:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776439.103991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612777984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776439.104026:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776439.104030:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776439.104032:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776439.104036:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12410 00000100:00080000:3.0:1775776439.104041:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776439.104045:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776439.104056:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776439.104068:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612778112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776439.104079:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776439.104085:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776439.104086:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612777984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776439.104087:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776439.104106:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12410 00000100:00080000:3.0:1775776439.104110:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776439.104114:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776439.104120:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776439.104132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612778240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776439.104142:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776439.104145:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776439.104147:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776439.104151:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12410 00000100:00080000:3.0:1775776439.104155:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776439.104158:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776439.104164:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776439.104171:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776439.104176:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612778368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776439.104186:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776439.104189:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776439.104191:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776439.104195:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12410 00000100:00080000:3.0:1775776439.104199:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776439.104203:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776439.104208:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776439.104219:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612778496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776439.104224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776439/real 1775776439] req@ffff8de1c7af5c00 x1862023612777984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776439.104260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612777984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776439.104272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776439.104277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776439.104282:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612777984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776439.104310:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776439.104356:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776439.104370:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776439/real 1775776439] req@ffff8de1c7af7b80 x1862023612778112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776439.104383:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612778112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776439.104391:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776439.104394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776439.104397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776439.104404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776439.104424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776439.104434:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776439/real 1775776439] req@ffff8de1c7af4e00 x1862023612778240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776439.104445:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612778240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776439.104452:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776439.104454:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776439.104456:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776439.104460:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776439.104475:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776439.104481:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776439/real 1775776439] req@ffff8de1c7af6680 x1862023612778368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776439.104488:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612778368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776439.104493:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776439.104494:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776439.104496:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776439.104499:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776439.104508:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776439.104516:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776439/real 1775776439] req@ffff8de1c7af6300 x1862023612778496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776439.104527:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612778496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776439.104533:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776439.104542:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776439.104546:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776440.063911:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776441.087977:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776442.111908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776443.135974:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776444.159895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776444.223844:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776444.223854:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776444.223858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776444.223868:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12415 00000100:00080000:2.0:1775776444.223878:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776444.223885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776444.223919:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612778624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776444.223962:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776444.223966:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776444.223968:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776444.223972:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12415 00000100:00080000:2.0:1775776444.223977:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776444.223981:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776444.223991:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776444.224003:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612778624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776444.224010:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612778752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776444.224022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776444.224026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776444.224028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776444.224032:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12415 00000100:00080000:2.0:1775776444.224036:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776444.224040:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776444.224045:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776444.224060:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612778880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776444.224069:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776444.224074:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776444.224078:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776444.224080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776444.224085:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12415 00000100:00080000:2.0:1775776444.224090:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776444.224095:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776444.224100:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776444.224111:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612779008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776444.224121:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776444.224125:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776444.224128:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776444.224132:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12415 00000100:00080000:2.0:1775776444.224135:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776444.224140:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776444.224145:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776444.224159:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612779136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776444.224186:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776444/real 1775776444] req@ffff8de1d0f2d500 x1862023612778624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776444.224319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612778624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776444.224330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776444.224334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776444.224337:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612778624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776444.224407:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776444.224432:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776444.224444:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776444/real 1775776444] req@ffff8de1d0f2ca80 x1862023612778752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776444.224466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612778752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776444.224475:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776444.224477:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776444.224479:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776444.224484:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776444.224498:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776444.224505:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776444/real 1775776444] req@ffff8de1d0f2df80 x1862023612778880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776444.224512:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612778880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776444.224517:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776444.224519:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776444.224520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612778880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776444.224523:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776444.224532:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776444.224537:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776444/real 1775776444] req@ffff8de1d0f2e300 x1862023612779008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776444.224543:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612779008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776444.224547:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776444.224549:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776444.224550:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776444.224553:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776444.224560:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776444.224565:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776444/real 1775776444] req@ffff8de1d0f2e680 x1862023612779136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776444.224570:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612779136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776444.224574:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776444.224576:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776444.224578:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776445.183884:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776446.207879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776447.231829:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776448.255870:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776449.279910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776449.343851:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776449.343859:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776449.343863:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776449.343873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12421 00000100:00080000:2.0:1775776449.343884:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776449.343891:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776449.343934:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612779264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776449.343961:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776449.343965:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776449.343966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776449.343977:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12421 00000100:00080000:2.0:1775776449.343981:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776449.343985:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776449.343996:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776449.344005:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612779264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776449.344012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612779392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776449.344023:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776449.344026:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776449.344028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776449.344042:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12421 00000100:00080000:2.0:1775776449.344050:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775776449.344054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776449.344058:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776449.344063:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776449.344074:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612779520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776449.344082:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775776449.344082:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776449/real 1775776449] req@ffff8de1d0f2c700 x1862023612779264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776449.344089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776449.344092:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776449.344100:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12421 00000100:00080000:2.0:1775776449.344104:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775776449.344105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612779264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776449.344112:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:3.0:1775776449.344116:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:2.0:1775776449.344119:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775776449.344121:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776449.344126:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612779264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776449.344135:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612779648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776449.344156:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775776449.344157:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779392:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775776449.344162:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776449.344165:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776449.344170:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12421 00000100:00080000:2.0:1775776449.344177:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775776449.344180:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776449.344183:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776449.344187:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776449.344191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776449/real 1775776449] req@ffff8de1d0f2f100 x1862023612779392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776449.344198:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612779776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776449.344202:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612779392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776449.344217:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776449.344220:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776449.344224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776449.344231:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776449.344252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776449.344262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776449/real 1775776449] req@ffff8de1d0f2e680 x1862023612779520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776449.344273:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612779520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776449.344280:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776449.344283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776449.344286:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776449.344300:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776449.344317:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776449.344326:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776449/real 1775776449] req@ffff8de1d0f2e300 x1862023612779648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776449.344337:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612779648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776449.344353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776449.344356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776449.344359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776449.344365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776449.344382:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776449.344392:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776449/real 1775776449] req@ffff8de1d0f2df80 x1862023612779776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776449.344404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612779776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776449.344411:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776449.344414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776449.344417:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612779776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776450.303921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776451.327902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776452.351900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776453.375852:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776454.399862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776454.463814:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776454.463820:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776454.463824:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776454.463832:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12426 00000100:00080000:3.0:1775776454.463842:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776454.463847:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776454.463879:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612779904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776454.463911:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776454.463915:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776454.463917:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776454.463921:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12426 00000100:00080000:3.0:1775776454.463926:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776454.463930:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776454.463940:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776454.463953:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612780032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776454.463967:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612779904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776454.463967:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776454.463974:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776454.463977:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776454.463980:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12426 00000100:00080000:3.0:1775776454.463983:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776454.463986:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776454.463990:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776454.463998:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612780160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776454.464005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776454.464007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776454.464009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776454.464011:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12426 00000100:00080000:3.0:1775776454.464013:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776454.464015:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776454.464019:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776454.464028:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612780288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776454.464031:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776454.464039:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776454.464042:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776454.464043:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776454.464047:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12426 00000100:00080000:3.0:1775776454.464051:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776454.464070:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776454.464075:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776454.464083:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612780416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776454.464095:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776454/real 1775776454] req@ffff8de1c7af6a00 x1862023612779904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776454.464120:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612779904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776454.464137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776454.464140:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776454.464144:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612779904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776454.464164:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776454.464183:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776454.464193:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776454/real 1775776454] req@ffff8de1c7af4000 x1862023612780032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776454.464201:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612780032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776454.464213:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776454.464216:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776454.464218:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776454.464222:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776454.464233:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776454.464239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776454/real 1775776454] req@ffff8de1c7af4700 x1862023612780160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776454.464247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612780160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776454.464252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776454.464254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776454.464256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776454.464260:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776454.464270:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776454.464275:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776454/real 1775776454] req@ffff8de1c7af6300 x1862023612780288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776454.464282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612780288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776454.464287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776454.464289:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776454.464290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776454.464293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776454.464302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776454.464307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776454/real 1775776454] req@ffff8de1c7af6680 x1862023612780416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776454.464316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612780416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776454.464324:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776454.464327:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776454.464330:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776455.423963:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776456.447910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776457.471902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776458.495920:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776459.519888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776459.583848:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776459.583870:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776459.583875:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776459.583885:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12431 00000100:00080000:3.0:1775776459.583895:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776459.583901:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776459.583934:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612780544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776459.583958:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776459.583972:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776459.583974:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776459.583979:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12431 00000100:00080000:3.0:1775776459.583983:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776459.583987:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776459.583997:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776459.584010:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612780672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776459.584020:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612780544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776459.584021:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776459.584025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776459.584026:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776459.584030:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12431 00000100:00080000:3.0:1775776459.584033:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776459.584037:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776459.584041:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776459.584049:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612780800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776459.584057:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776459.584060:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776459.584061:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776459.584064:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12431 00000100:00080000:3.0:1775776459.584067:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776459.584071:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776459.584075:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776459.584076:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776459.584082:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612780928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776459.584090:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776459.584093:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776459.584094:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776459.584097:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12431 00000100:00080000:3.0:1775776459.584100:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776459.584103:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776459.584108:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776459/real 1775776459] req@ffff8de1c7af4e00 x1862023612780544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775776459.584108:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776459.584116:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612781056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776459.584134:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612780544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776459.584145:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776459.584149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776459.584153:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612780544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776459.584175:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776459.584193:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776459.584202:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776459/real 1775776459] req@ffff8de1c7af7b80 x1862023612780672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776459.584210:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612780672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776459.584216:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776459.584218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776459.584220:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776459.584223:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776459.584234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776459.584239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776459/real 1775776459] req@ffff8de1c7af5c00 x1862023612780800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776459.584247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612780800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776459.584256:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776459.584258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776459.584260:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776459.584263:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776459.584272:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776459.584278:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776459/real 1775776459] req@ffff8de1c7af6d80 x1862023612780928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776459.584284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612780928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776459.584289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776459.584290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776459.584292:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612780928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776459.584295:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776459.584304:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776459.584309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776459/real 1775776459] req@ffff8de1c7af7480 x1862023612781056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776459.584316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612781056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776459.584320:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776459.584322:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776459.584324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776460.543889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776461.567871:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776462.591894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776463.615911:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776464.639942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776464.703844:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776464.703854:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776464.703859:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776464.703871:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12436 00000100:00080000:3.0:1775776464.703905:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776464.703922:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776464.703966:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612781184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776464.703994:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776464.703998:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776464.704000:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776464.704008:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12436 00000100:00080000:3.0:1775776464.704013:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776464.704017:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776464.704027:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776464.704042:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612781312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776464.704053:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776464.704057:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776464.704060:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776464.704063:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612781184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776464.704067:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12436 00000100:00080000:3.0:1775776464.704076:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776464.704081:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776464.704086:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776464.704115:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612781440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776464.704126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776464.704129:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776464.704131:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776464.704135:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12436 00000100:00080000:3.0:1775776464.704140:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776464.704144:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776464.704149:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776464.704160:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612781568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776464.704169:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776464.704173:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776464.704174:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776464.704178:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12436 00000100:00080000:3.0:1775776464.704183:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776464.704187:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781312:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775776464.704191:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776464.704199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776464.704213:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612781696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776464.704237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776464.704266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776464.704293:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776465.663896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776466.687907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776467.711881:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776467.775992:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776467.776047:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776467.776070:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776467.776123:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776467.776134:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776467.776142:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776467.776151:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775776467.776237:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776464/real 1775776467] req@ffff8de1c7af7100 x1862023612781696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776467.776275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612781696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776467.776291:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776467.776297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776467.776301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781696:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776467.776310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776464/real 1775776467] req@ffff8de1c7af5880 x1862023612781312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776467.776324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612781312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776467.776332:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776467.776336:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776467.776339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776467.776347:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776464/real 1775776467] req@ffff8de1c7af4a80 x1862023612781440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776467.776359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612781440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776467.776366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776467.776370:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776467.776373:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776467.776379:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776464/real 1775776467] req@ffff8de1c7af5f80 x1862023612781568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776467.776390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612781568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776467.776396:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776467.776399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776467.776401:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776467.776408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776464/real 1775776467] req@ffff8de1c7af5500 x1862023612781184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776467.776419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612781184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776467.776425:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776467.776429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776467.776431:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612781184:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775776468.735871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776469.759862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776469.823860:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776469.823869:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776469.823873:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776469.823882:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12441 00000100:00080000:0.0:1775776469.823894:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776469.823902:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776469.823945:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612781824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776469.823974:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776469.823978:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776469.823980:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776469.823985:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12441 00000100:00080000:0.0:1775776469.823990:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776469.823994:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776469.824004:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776469.824020:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612781952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776469.824032:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612781824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776469.824035:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776469.824042:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776469.824044:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776469.824049:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12441 00000100:00080000:0.0:1775776469.824053:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776469.824057:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776469.824063:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776469.824077:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612782080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776469.824088:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776469.824091:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776469.824093:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776469.824097:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12441 00000100:00080000:0.0:1775776469.824101:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776469.824107:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776469.824109:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776469.824117:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776469.824132:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612782208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776469.824150:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776469/real 1775776469] req@ffff8de1c5683b80 x1862023612781824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776469.824152:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776469.824160:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776469.824164:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776469.824173:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12441 00000100:00080000:0.0:1775776469.824179:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776469.824185:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776469.824186:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612781824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775776469.824189:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776469.824203:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612782336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776469.824204:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776469.824214:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776469.824222:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612781824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776469.824251:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776469.824277:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776469.824290:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776469/real 1775776469] req@ffff8de1c5680700 x1862023612781952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776469.824303:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612781952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776469.824312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776469.824316:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776469.824320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612781952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776469.824326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776469.824347:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776469.824359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776469/real 1775776469] req@ffff8de1c5682d80 x1862023612782080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776469.824373:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612782080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776469.824381:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776469.824385:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776469.824389:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776469.824395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776469.824415:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776469.824426:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776469/real 1775776469] req@ffff8de1c5682300 x1862023612782208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776469.824438:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612782208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776469.824446:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776469.824450:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776469.824453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776469.824459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776469.824479:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776469.824490:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776469/real 1775776469] req@ffff8de1c5682680 x1862023612782336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776469.824503:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612782336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776469.824518:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776469.824521:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776469.824524:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776470.783851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776471.807904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776472.831901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776473.855896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776474.879930:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776474.943914:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776474.943926:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776474.943931:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776474.943944:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12446 00000100:00080000:2.0:1775776474.943958:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776474.943968:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776474.944005:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612782464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776474.944034:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776474.944037:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776474.944039:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776474.944043:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12446 00000100:00080000:2.0:1775776474.944049:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776474.944054:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776474.944065:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776474.944077:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612782464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776474.944079:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612782592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776474.944108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776474.944113:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776474.944115:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776474.944120:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12446 00000100:00080000:2.0:1775776474.944123:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776474.944128:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776474.944134:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776474.944147:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612782720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776474.944157:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776474.944160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776474.944161:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776474.944164:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12446 00000100:00080000:2.0:1775776474.944168:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776474.944176:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776474.944181:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776474.944188:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776474.944200:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612782848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776474.944208:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776474.944210:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776474.944212:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776474.944214:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12446 00000100:00080000:2.0:1775776474.944217:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776474.944219:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776474.944222:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776474.944228:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612782976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776474.944232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776474/real 1775776474] req@ffff8de1d0f2ca80 x1862023612782464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776474.944282:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612782464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776474.944293:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776474.944297:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776474.944301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612782464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776474.944326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776474.944344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776474.944353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776474/real 1775776474] req@ffff8de1d0f2d500 x1862023612782592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776474.944369:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612782592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776474.944377:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776474.944381:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776474.944385:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776474.944392:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776474.944414:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776474.944427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776474/real 1775776474] req@ffff8de1d0f2df80 x1862023612782720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776474.944440:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612782720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776474.944449:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776474.944452:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776474.944456:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776474.944462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776474.944479:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776474.944487:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776474/real 1775776474] req@ffff8de1d0f2e300 x1862023612782848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776474.944494:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612782848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776474.944500:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776474.944502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776474.944504:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776474.944507:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776474.944517:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776474.944523:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776474/real 1775776474] req@ffff8de1d0f2e680 x1862023612782976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776474.944530:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612782976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776474.944535:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776474.944537:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776474.944539:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612782976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776475.904021:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776476.927886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776477.951885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776478.975850:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776479.999904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776480.063851:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776480.063861:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776480.063866:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776480.063876:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12451 00000100:00080000:3.0:1775776480.063888:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776480.063895:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776480.063932:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612783104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776480.063957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776480.063961:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776480.063963:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776480.063967:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12451 00000100:00080000:3.0:1775776480.063971:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776480.063976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776480.063986:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776480.064004:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612783232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776480.064016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776480.064020:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776480.064022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776480.064027:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12451 00000100:00100000:1.0:1775776480.064031:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612783104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776480.064034:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776480.064041:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776480.064050:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776480.064065:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612783360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776480.064076:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776480.064080:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776480.064082:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776480.064086:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12451 00000100:00080000:3.0:1775776480.064090:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776480.064095:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775776480.064099:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775776480.064104:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776480.064120:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612783488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776480.064130:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776480.064135:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776480/real 1775776480] req@ffff8de1c7af7800 x1862023612783104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776480.064150:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612783104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776480.064158:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776480.064163:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776480.064167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612783104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776480.064173:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783232:192.168.201.137@tcp:38:kworker.0 00000100:00080000:3.0:1775776480.064193:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776480.064197:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:1.0:1775776480.064201:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776480.064208:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12451 00000100:00080000:3.0:1775776480.064214:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776480.064215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776480/real 1775776480] req@ffff8de1c7af5180 x1862023612783232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776480.064222:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776480.064234:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776480.064241:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612783232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776480.064256:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612783616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776480.064260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776480.064269:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776480.064273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776480.064304:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776480.064323:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776480.064331:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776480/real 1775776480] req@ffff8de1c7af4380 x1862023612783360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776480.064339:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612783360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776480.064344:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776480.064347:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776480.064349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776480.064354:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776480.064367:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776480.064374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776480/real 1775776480] req@ffff8de1c7af5500 x1862023612783488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776480.064382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612783488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776480.064387:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776480.064389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776480.064392:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776480.064437:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776480.064452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776480.064459:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776480/real 1775776480] req@ffff8de1c7af5f80 x1862023612783616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776480.064467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612783616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776480.064472:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776480.064474:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776480.064476:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776481.023863:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776482.047899:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776483.071841:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776484.095880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776485.119881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776485.183857:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776485.183867:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776485.183874:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776485.183886:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12456 00000100:00080000:3.0:1775776485.183902:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776485.183909:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776485.183954:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612783744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776485.183986:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776485.183990:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776485.183992:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776485.183996:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12456 00000100:00080000:3.0:1775776485.183999:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776485.184002:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776485.184013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776485.184024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612783872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776485.184033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776485.184036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776485.184037:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776485.184044:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12456 00000100:00080000:3.0:1775776485.184050:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776485.184053:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612783744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776485.184053:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776485.184057:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776485.184071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612784000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776485.184088:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776485.184092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776485.184094:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776485.184098:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12456 00000100:00080000:3.0:1775776485.184102:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776485.184107:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776485.184113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776485.184125:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612784128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776485.184133:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776485.184135:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776485.184137:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776485.184143:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12456 00000800:00000100:1.0:1775776485.184146:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776485.184149:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776485.184154:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776485.184158:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776485.184167:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612784256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776485.184197:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776485/real 1775776485] req@ffff8de1c7af4a80 x1862023612783744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776485.184219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612783744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776485.184231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776485.184236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776485.184240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612783744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776485.184264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776485.184283:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776485.184292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776485/real 1775776485] req@ffff8de1c7af5880 x1862023612783872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776485.184300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612783872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776485.184306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776485.184308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776485.184310:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612783872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776485.184315:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776485.184325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776485.184330:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776485/real 1775776485] req@ffff8de1c7af7100 x1862023612784000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776485.184338:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612784000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776485.184343:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776485.184344:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776485.184355:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776485.184359:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776485.184370:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776485.184376:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776485/real 1775776485] req@ffff8de1c7af7480 x1862023612784128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776485.184384:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612784128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776485.184389:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776485.184392:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776485.184394:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776485.184397:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776485.184406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776485.184411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776485/real 1775776485] req@ffff8de1c7af6d80 x1862023612784256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776485.184418:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612784256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776485.184424:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776485.184426:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776485.184427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776486.143880:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776487.167889:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776488.191867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776489.215907:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776490.239887:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776490.303860:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776490.303868:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776490.303872:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776490.303880:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12462 00000100:00080000:2.0:1775776490.303889:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776490.303895:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776490.303928:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612784384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776490.303950:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776490.303953:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776490.303954:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776490.303957:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12462 00000100:00080000:2.0:1775776490.303959:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776490.303963:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776490.303972:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776490.303980:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612784512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776490.303988:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776490.303990:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776490.303991:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776490.303994:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12462 00000100:00080000:2.0:1775776490.303996:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776490.303998:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776490.304001:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776490.304004:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612784384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776490.304011:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612784640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776490.304020:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776490.304023:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776490.304025:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776490.304028:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12462 00000100:00080000:2.0:1775776490.304032:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776490.304036:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776490.304041:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776490.304054:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612784768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776490.304065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776490.304069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000800:00000100:1.0:1775776490.304072:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776490.304073:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776490.304081:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12462 00000100:00080000:2.0:1775776490.304086:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776490.304090:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776490.304095:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776490.304105:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612784896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776490.304116:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776490/real 1775776490] req@ffff8de1d0f2f100 x1862023612784384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776490.304136:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612784384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776490.304147:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776490.304151:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776490.304155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612784384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776490.304163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776490.304184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776490.304195:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776490/real 1775776490] req@ffff8de1d0f2c700 x1862023612784512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776490.304207:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612784512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776490.304215:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776490.304218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776490.304221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776490.304242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776490.304260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776490.304270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776490/real 1775776490] req@ffff8de1d0f2e680 x1862023612784640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776490.304281:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612784640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776490.304289:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776490.304292:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776490.304296:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776490.304302:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776490.304319:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776490.304328:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776490/real 1775776490] req@ffff8de1d0f2e300 x1862023612784768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776490.304341:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612784768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776490.304350:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776490.304353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776490.304356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776490.304363:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776490.304381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776490.304391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776490/real 1775776490] req@ffff8de1d0f2df80 x1862023612784896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776490.304412:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612784896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776490.304421:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776490.304425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776490.304444:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612784896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776491.263897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776492.287956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776493.312031:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776494.335964:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776495.359965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776495.423883:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776495.423896:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776495.423901:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776495.423913:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12467 00000100:00080000:3.0:1775776495.423928:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776495.423935:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776495.423983:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612785024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776495.424016:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776495.424023:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776495.424026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776495.424030:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12467 00000100:00080000:3.0:1775776495.424034:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776495.424038:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776495.424048:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776495.424061:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612785152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776495.424072:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776495.424076:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612785024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776495.424077:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776495.424080:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776495.424087:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12467 00000100:00080000:3.0:1775776495.424091:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776495.424094:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776495.424100:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776495.424112:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612785280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776495.424121:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776495.424125:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776495.424127:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776495.424131:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12467 00000100:00080000:3.0:1775776495.424134:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776495.424138:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776495.424143:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776495.424153:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612785408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776495.424160:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776495.424167:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776495.424171:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776495.424172:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776495.424178:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12467 00000100:00080000:3.0:1775776495.424183:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776495.424186:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776495.424191:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776495.424201:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612785536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776495.424206:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776495/real 1775776495] req@ffff8de1c7af5c00 x1862023612785024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776495.424224:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612785024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776495.424237:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776495.424241:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776495.424245:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612785024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776495.424266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776495.424281:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776495.424288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776495/real 1775776495] req@ffff8de1c7af7b80 x1862023612785152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776495.424295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612785152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776495.424300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776495.424302:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776495.424304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776495.424307:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776495.424316:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776495.424321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776495/real 1775776495] req@ffff8de1c7af4e00 x1862023612785280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776495.424327:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612785280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776495.424331:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776495.424333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776495.424334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776495.424350:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776495.424373:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776495.424382:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776495/real 1775776495] req@ffff8de1c7af6680 x1862023612785408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776495.424393:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612785408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776495.424401:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776495.424404:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776495.424407:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776495.424413:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776495.424431:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776495.424438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776495/real 1775776495] req@ffff8de1c7af6300 x1862023612785536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776495.424445:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612785536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776495.424449:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776495.424451:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776495.424453:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776496.383877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776497.407944:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776498.431858:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776499.455928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776500.479864:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776500.543814:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776500.543824:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776500.543829:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776500.543847:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12472 00000100:00080000:3.0:1775776500.543859:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776500.543867:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776500.543904:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612785664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776500.543941:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776500.543945:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776500.543947:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776500.543952:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12472 00000100:00080000:3.0:1775776500.543956:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776500.543960:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776500.543970:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776500.543994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612785792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776500.544002:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612785664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776500.544010:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776500.544014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776500.544017:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776500.544023:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12472 00000100:00080000:3.0:1775776500.544027:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776500.544031:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776500.544036:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776500.544048:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612785920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776500.544065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776500.544069:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776500.544071:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776500.544075:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12472 00000100:00080000:3.0:1775776500.544080:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776500.544083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776500.544088:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776500.544093:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776500.544106:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612786048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776500.544116:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776500.544120:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776500.544122:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776500.544126:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776500/real 1775776500] req@ffff8de1c7af4700 x1862023612785664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776500.544128:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12472 00000100:00080000:3.0:1775776500.544134:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776500.544142:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776500.544150:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776500.544161:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612785664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776500.544163:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612786176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776500.544200:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776500.544207:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776500.544212:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612785664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776500.544238:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776500.544276:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776500.544291:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776500/real 1775776500] req@ffff8de1c7af4000 x1862023612785792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776500.544305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612785792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776500.544314:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776500.544318:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776500.544322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776500.544329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776500.544350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776500.544361:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776500/real 1775776500] req@ffff8de1c7af6a00 x1862023612785920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776500.544375:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612785920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776500.544390:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776500.544394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776500.544397:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612785920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776500.544404:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776500.544423:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776500.544435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776500/real 1775776500] req@ffff8de1c7af6300 x1862023612786048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776500.544448:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612786048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776500.544457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776500.544460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776500.544464:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776500.544469:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776500.544489:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776500.544499:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776500/real 1775776500] req@ffff8de1c7af6680 x1862023612786176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776500.544523:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612786176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776500.544534:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776500.544544:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776500.544549:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776501.503926:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776502.527912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776503.551869:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776504.575888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776505.599896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776505.663857:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776505.663867:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776505.663872:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776505.663882:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12477 00000100:00080000:2.0:1775776505.663893:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776505.663900:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776505.663938:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612786304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776505.663964:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776505.663968:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776505.663971:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776505.663975:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12477 00000100:00080000:2.0:1775776505.663979:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776505.663984:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776505.663994:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776505.664007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612786432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776505.664014:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612786304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776505.664033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776505.664036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776505.664038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776505.664044:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12477 00000100:00080000:2.0:1775776505.664048:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776505.664052:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776505.664058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776505.664071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612786560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776505.664083:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776505.664084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776505.664089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776505.664091:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776505.664097:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12477 00000100:00080000:2.0:1775776505.664102:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776505.664105:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776505.664111:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776505.664118:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776505/real 1775776505] req@ffff8de1d0f2d500 x1862023612786304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776505.664124:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612786688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776505.664140:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612786304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776505.664153:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776505.664155:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776505.664156:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776505.664173:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776505.664178:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12477 00000100:00080000:1.0:1775776505.664182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775776505.664183:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776505.664192:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612786304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776505.664192:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776505.664200:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776505.664211:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612786816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776505.664226:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776505.664255:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776505.664266:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776505/real 1775776505] req@ffff8de1d0f2ca80 x1862023612786432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776505.664276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612786432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776505.664282:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776505.664284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776505.664286:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776505.664290:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776505.664303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776505.664309:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776505/real 1775776505] req@ffff8de1d0f2df80 x1862023612786560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776505.664316:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612786560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776505.664321:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776505.664323:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776505.664325:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776505.664328:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776505.664338:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776505.664343:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776505/real 1775776505] req@ffff8de1d0f2e300 x1862023612786688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776505.664361:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612786688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776505.664366:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776505.664368:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776505.664370:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776505.664374:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776505.664385:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776505.664390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776505/real 1775776505] req@ffff8de1d0f2e680 x1862023612786816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776505.664397:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612786816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776505.664402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776505.664404:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776505.664406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612786816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776506.623931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776507.647867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776508.671885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776509.695851:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776510.719885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776510.783815:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776510.783822:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776510.783826:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776510.783834:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12482 00000100:00080000:0.0:1775776510.783844:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776510.783850:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776510.783898:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612786944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776510.783926:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776510.783930:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776510.783932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776510.783937:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12482 00000100:00080000:0.0:1775776510.783940:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776510.783944:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776510.783953:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776510.783964:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612786944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776510.783965:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612787072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776510.783979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776510.783981:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776510.783982:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776510.783986:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12482 00000100:00080000:0.0:1775776510.783988:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776510.783991:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776510.783993:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776510.784002:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612787200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776510.784009:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776510.784012:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776510.784013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776510.784015:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12482 00000100:00080000:0.0:1775776510.784018:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776510.784020:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776510.784023:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776510.784024:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776510.784032:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612787328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776510.784039:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776510.784041:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776510.784043:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776510.784045:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12482 00000100:00080000:0.0:1775776510.784047:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776510.784050:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776510.784053:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776510.784059:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612787456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776510.784068:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776510/real 1775776510] req@ffff8de1c5682680 x1862023612786944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776510.784102:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612786944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776510.784113:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776510.784118:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776510.784122:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612786944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776510.784146:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776510.784170:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776510.784182:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776510/real 1775776510] req@ffff8de1c5682300 x1862023612787072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776510.784194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612787072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776510.784202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776510.784205:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776510.784207:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776510.784212:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776510.784231:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776510.784242:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776510/real 1775776510] req@ffff8de1c5682d80 x1862023612787200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776510.784254:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612787200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776510.784262:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776510.784266:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776510.784269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776510.784275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776510.784295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776510.784306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776510/real 1775776510] req@ffff8de1c5680700 x1862023612787328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776510.784319:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612787328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776510.784327:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776510.784331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776510.784334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776510.784341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776510.784362:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776510.784373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776510/real 1775776510] req@ffff8de1c5683b80 x1862023612787456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776510.784387:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612787456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776510.784396:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776510.784400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776510.784403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776511.743899:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776512.767896:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776513.791901:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776514.815923:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776515.839900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776515.903871:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776515.903878:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776515.903883:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776515.903893:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12487 00000100:00080000:0.0:1775776515.903906:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776515.903914:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776515.903951:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612787584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776515.903990:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776515.903995:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776515.903997:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776515.904002:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12487 00000100:00080000:0.0:1775776515.904007:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776515.904012:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776515.904021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776515.904025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612787584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776515.904038:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612787712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776515.904050:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776515.904053:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776515.904055:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776515.904060:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12487 00000100:00080000:0.0:1775776515.904064:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776515.904067:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776515.904073:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776515.904084:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612787840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776515.904098:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776515.904102:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776515.904103:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776515.904107:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12487 00000100:00080000:0.0:1775776515.904110:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776515.904114:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:3.0:1775776515.904117:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:0.0:1775776515.904119:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776515.904130:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612787968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776515.904141:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776515.904153:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776515.904155:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776515.904159:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12487 00000100:00080000:0.0:1775776515.904164:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776515.904168:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776515.904173:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776515.904185:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612788096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776515.904336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776515/real 1775776515] req@ffff8de1c5680000 x1862023612787584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776515.904414:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612787584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776515.904427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776515.904431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776515.904436:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612787584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776515.904465:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776515.904486:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776515.904496:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776515/real 1775776515] req@ffff8de1c5681f80 x1862023612787712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776515.904504:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612787712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776515.904510:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776515.904512:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776515.904514:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776515.904518:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776515.904528:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776515.904534:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776515/real 1775776515] req@ffff8de1c5682a00 x1862023612787840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776515.904541:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612787840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776515.904547:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776515.904550:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776515.904553:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776515.904559:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776515.904578:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776515.904599:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776515/real 1775776515] req@ffff8de1c5680380 x1862023612787968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776515.904612:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612787968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776515.904622:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776515.904625:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776515.904628:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612787968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776515.904634:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776515.904670:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776515.904681:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776515/real 1775776515] req@ffff8de1c5681c00 x1862023612788096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776515.904694:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612788096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776515.904703:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776515.904706:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776515.904709:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776516.863910:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776517.887893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776518.911894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776519.935964:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776520.963211:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776521.023835:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776521.023849:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776521.023854:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776521.023866:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12492 00000100:00080000:1.0:1775776521.023881:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776521.023889:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776521.023948:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612788224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776521.023979:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776521.023982:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776521.023984:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776521.023988:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12492 00000100:00080000:1.0:1775776521.023992:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776521.023995:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776521.024005:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776521.024016:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612788352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776521.024030:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776521.024035:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776521.024036:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776521.024041:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12492 00000100:00080000:1.0:1775776521.024046:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776521.024051:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776521.024056:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776521.024068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612788480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776521.024077:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612788224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776521.024092:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776521.024096:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776521.024097:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776521.024104:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12492 00000100:00080000:1.0:1775776521.024109:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776521.024114:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776521.024121:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776521.024137:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612788608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776521.024148:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776521.024149:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776521.024154:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776521.024156:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776521.024162:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12492 00000100:00080000:1.0:1775776521.024169:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776521.024174:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776521.024179:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776521.024183:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776521/real 1775776521] req@ffff8de1c2e15500 x1862023612788224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776521.024199:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612788736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776521.024200:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612788224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776521.024255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776521.024262:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776521.024266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612788224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776521.024274:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776521.024294:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776521.024300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776521/real 1775776521] req@ffff8de1c2e16680 x1862023612788352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776521.024307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612788352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776521.024312:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776521.024314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776521.024316:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776521.024334:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776521.024344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776521.024349:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776521/real 1775776521] req@ffff8de1c2e17b80 x1862023612788480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776521.024355:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612788480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776521.024359:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776521.024361:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776521.024363:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776521.024367:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776521.024376:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776521.024381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776521/real 1775776521] req@ffff8de1c2e14380 x1862023612788608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776521.024388:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612788608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776521.024392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776521.024394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776521.024395:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776521.024398:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776521.024406:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776521.024411:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776521/real 1775776521] req@ffff8de1c2e17100 x1862023612788736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776521.024417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612788736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776521.024421:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776521.024422:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776521.024424:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776521.983921:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776523.007907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776524.031915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776525.055892:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776526.079908:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776526.143944:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776526.143957:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776526.143963:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776526.143974:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12497 00000100:00080000:2.0:1775776526.143987:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776526.143995:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776526.144037:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612788864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776526.144064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776526.144068:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776526.144070:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776526.144074:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12497 00000100:00080000:2.0:1775776526.144077:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776526.144082:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776526.144093:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776526.144106:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612788992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776526.144116:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776526.144119:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776526.144120:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776526.144128:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12497 00000100:00080000:2.0:1775776526.144134:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775776526.144135:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612788864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776526.144141:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776526.144151:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776526.144168:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612789120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776526.144177:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776526.144180:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776526.144182:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776526.144186:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12497 00000100:00080000:2.0:1775776526.144189:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776526.144193:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776526.144198:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776526.144211:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612789248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776526.144220:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776526.144223:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776526.144224:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776526.144228:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12497 00000100:00080000:2.0:1775776526.144234:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775776526.144235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776526.144244:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776526.144251:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776526.144265:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612789376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776526.144283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776526/real 1775776526] req@ffff8de1d0f2c700 x1862023612788864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776526.144300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612788864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776526.144310:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776526.144314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776526.144318:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612788864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776526.144341:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776526.144366:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776526.144377:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776526/real 1775776526] req@ffff8de1d0f2f100 x1862023612788992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776526.144386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612788992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776526.144394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776526.144397:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776526.144400:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612788992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776526.144406:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776526.144427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776526.144438:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776526/real 1775776526] req@ffff8de1d0f2e680 x1862023612789120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776526.144455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612789120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776526.144463:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776526.144466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776526.144469:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776526.144475:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776526.144493:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776526.144502:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776526/real 1775776526] req@ffff8de1d0f2e300 x1862023612789248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776526.144513:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612789248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776526.144520:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776526.144523:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776526.144525:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776526.144531:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776526.144550:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776526.144559:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776526/real 1775776526] req@ffff8de1d0f2df80 x1862023612789376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776526.144570:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612789376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776526.144583:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776526.144586:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776526.144590:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776527.103917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776528.127928:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776529.151897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776530.176143:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776531.199951:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776531.263956:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776531.263963:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776531.263967:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776531.263974:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12503 00000100:00080000:3.0:1775776531.263984:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776531.263990:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776531.264018:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612789504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776531.264045:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776531.264048:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776531.264050:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776531.264052:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12503 00000100:00080000:3.0:1775776531.264055:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776531.264057:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776531.264064:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776531.264077:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612789632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776531.264084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776531.264089:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776531.264090:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776531.264093:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12503 00000100:00080000:3.0:1775776531.264097:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776531.264100:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776531.264104:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776531.264114:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612789760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776531.264123:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776531.264126:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776531.264127:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776531.264131:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12503 00000100:00080000:3.0:1775776531.264134:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776531.264138:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776531.264142:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776531.264149:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612789888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776531.264154:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776531.264156:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776531.264157:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776531.264159:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12503 00000100:00080000:3.0:1775776531.264160:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776531.264162:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776531.264165:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776531.264169:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612790016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776531.264242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612789504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776531.264333:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776531.264355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776531.264366:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776531.264375:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776532.223925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776533.247831:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776534.271857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776534.336083:0:2392:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776534.336130:0:2392:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776534.336145:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776534.336185:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776534.336195:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776534.336205:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776534.336215:0:2392:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775776534.336295:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776531/real 1775776534] req@ffff8de1c7af4e00 x1862023612789504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776534.336320:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612789504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776534.336330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776534.336335:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776534.336339:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612789504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776534.336346:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776531/real 1775776534] req@ffff8de1c7af7b80 x1862023612789632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776534.336359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612789632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776534.336365:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776534.336367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776534.336369:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776534.336374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776531/real 1775776534] req@ffff8de1c7af5c00 x1862023612789760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776534.336385:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612789760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776534.336392:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776534.336395:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776534.336399:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776534.336404:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776531/real 1775776534] req@ffff8de1c7af6d80 x1862023612789888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776534.336415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612789888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776534.336422:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776534.336425:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776534.336427:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612789888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776534.336433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776531/real 1775776534] req@ffff8de1c7af7480 x1862023612790016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776534.336444:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612790016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776534.336451:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776534.336454:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776534.336457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776535.295809:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776536.319895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776536.383825:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776536.383832:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776536.383836:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776536.383843:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12508 00000100:00080000:3.0:1775776536.383852:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776536.383857:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776536.383883:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612790144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776536.383902:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776536.383905:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776536.383906:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776536.383908:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12508 00000100:00080000:3.0:1775776536.383910:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776536.383914:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776536.383927:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776536.383940:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612790272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776536.383950:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776536.383953:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612790144:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776536.383954:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776536.383957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776536.383964:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12508 00000100:00080000:3.0:1775776536.383967:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776536.383972:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776536.383977:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776536.383987:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612790400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776536.383996:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776536.383998:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776536.383999:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776536.384003:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12508 00000100:00080000:3.0:1775776536.384007:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776536.384011:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000800:00000100:1.0:1775776536.384014:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000008:00100000:3.0:1775776536.384018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776536.384031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612790528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776536.384040:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776536.384043:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776536.384046:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776536.384050:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776536/real 1775776536] req@ffff8de1c7af7100 x1862023612790144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776536.384050:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12508 00000100:00080000:3.0:1775776536.384056:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776536.384061:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776536.384069:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776536.384077:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612790144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776536.384082:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612790656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776536.384091:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776536.384099:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776536.384103:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612790144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776536.384128:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776536.384147:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776536.384157:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776536/real 1775776536] req@ffff8de1c7af5880 x1862023612790272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776536.384170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612790272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776536.384178:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776536.384182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776536.384185:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776536.384192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776536.384207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776536.384215:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776536/real 1775776536] req@ffff8de1c7af4a80 x1862023612790400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776536.384225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612790400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776536.384233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776536.384236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776536.384238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776536.384242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776536.384259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776536.384268:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776536/real 1775776536] req@ffff8de1c7af5f80 x1862023612790528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776536.384279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612790528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776536.384287:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776536.384290:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776536.384293:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776536.384299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776536.384313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776536.384321:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776536/real 1775776536] req@ffff8de1c7af5500 x1862023612790656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776536.384332:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612790656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776536.384340:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776536.384342:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776536.384345:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776537.343834:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776538.367910:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776539.391904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776540.415968:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776541.439943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776541.503859:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776541.503867:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776541.503870:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776541.503878:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12513 00000100:00080000:2.0:1775776541.503888:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776541.503893:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776541.503923:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612790784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776541.503952:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776541.503956:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776541.503958:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776541.503962:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12513 00000100:00080000:2.0:1775776541.503966:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776541.503969:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776541.503979:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776541.503990:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612790912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776541.503998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1775776541.504000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612790784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776541.504001:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776541.504004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776541.504010:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12513 00000100:00080000:2.0:1775776541.504012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776541.504014:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776541.504018:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776541.504031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612791040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776541.504038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776541.504041:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776541.504043:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776541.504047:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12513 00000100:00080000:2.0:1775776541.504051:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776541.504053:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776541.504058:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776541.504064:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776541.504076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612791168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776541.504083:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776541/real 1775776541] req@ffff8de1d0f2ca80 x1862023612790784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776541.504085:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776541.504092:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776541.504095:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776541.504100:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12513 00000100:00080000:2.0:1775776541.504103:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776541.504105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612790784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776541.504113:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776541.504115:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775776541.504119:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000008:00100000:2.0:1775776541.504120:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776541.504124:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612790784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776541.504132:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612791296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776541.504153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776541.504168:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776541.504175:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776541/real 1775776541] req@ffff8de1d0f2d500 x1862023612790912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776541.504182:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612790912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776541.504191:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776541.504193:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776541.504195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612790912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776541.504198:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776541.504206:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776541.504210:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776541/real 1775776541] req@ffff8de1d0f2df80 x1862023612791040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776541.504216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612791040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776541.504221:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776541.504222:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776541.504224:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776541.504226:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776541.504235:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776541.504239:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776541/real 1775776541] req@ffff8de1d0f2e300 x1862023612791168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776541.504245:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612791168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776541.504249:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776541.504251:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776541.504253:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776541.504256:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776541.504264:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776541.504269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776541/real 1775776541] req@ffff8de1d0f2e680 x1862023612791296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776541.504274:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612791296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776541.504279:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776541.504280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776541.504281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776542.463923:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776543.487967:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776544.511937:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776545.535870:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776546.559885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776546.623835:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776546.623843:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776546.623848:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776546.623857:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12518 00000100:00080000:2.0:1775776546.623870:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776546.623876:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776546.623915:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612791424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776546.623948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776546.623951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776546.623953:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776546.623957:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12518 00000100:00080000:2.0:1775776546.623960:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776546.623964:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776546.623975:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776546.623989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612791552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776546.623998:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612791424:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776546.624003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776546.624006:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776546.624007:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776546.624011:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12518 00000100:00080000:2.0:1775776546.624013:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776546.624016:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776546.624021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776546.624032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612791680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776546.624038:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776546.624040:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776546.624041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776546.624043:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12518 00000100:00080000:2.0:1775776546.624045:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776546.624047:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776546.624050:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776546.624056:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612791808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776546.624061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776546.624063:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776546.624064:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776546.624068:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12518 00000800:00000100:1.0:1775776546.624072:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776546.624072:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776546.624077:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776546.624081:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776546.624088:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612791936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776546.624117:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776546/real 1775776546] req@ffff8de1d0f2f100 x1862023612791424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776546.624135:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612791424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776546.624144:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776546.624149:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776546.624153:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612791424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776546.624180:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776546.624201:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776546.624213:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776546/real 1775776546] req@ffff8de1d0f2c700 x1862023612791552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776546.624226:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612791552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776546.624233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776546.624237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776546.624240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776546.624245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776546.624262:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776546.624269:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776546/real 1775776546] req@ffff8de1d0f2e680 x1862023612791680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776546.624276:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612791680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776546.624281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776546.624283:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776546.624285:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776546.624288:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776546.624299:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776546.624307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776546/real 1775776546] req@ffff8de1d0f2e300 x1862023612791808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776546.624317:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612791808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776546.624325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776546.624328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776546.624331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776546.624337:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776546.624354:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776546.624363:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776546/real 1775776546] req@ffff8de1d0f2df80 x1862023612791936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776546.624374:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612791936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776546.624382:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776546.624385:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776546.624388:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612791936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776547.583980:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776548.607891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776549.631874:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776550.655902:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776551.679882:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776551.743830:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776551.743839:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776551.743843:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776551.743853:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12523 00000100:00080000:2.0:1775776551.743863:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776551.743869:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776551.743903:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612792064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776551.743930:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776551.743934:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776551.743936:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776551.743940:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12523 00000100:00080000:2.0:1775776551.743943:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776551.743947:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776551.743956:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776551.743973:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612792192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776551.743974:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612792064:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776551.743989:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776551.743992:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776551.743993:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776551.743998:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12523 00000100:00080000:2.0:1775776551.744002:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776551.744006:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776551.744011:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776551.744024:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612792320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776551.744033:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776551.744036:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776551.744038:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775776551.744042:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776551.744046:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12523 00000100:00080000:2.0:1775776551.744052:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776551.744056:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776551.744060:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776551.744072:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612792448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776551.744078:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776551/real 1775776551] req@ffff8de1d0f2d500 x1862023612792064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776551.744084:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776551.744091:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776551.744094:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776551.744100:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12523 00000100:00080000:2.0:1775776551.744104:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776551.744107:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776551.744112:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612792064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1775776551.744113:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775776551.744126:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1775776551.744127:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612792576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776551.744134:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776551.744142:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612792064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776551.744239:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776551.744259:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776551.744282:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776551/real 1775776551] req@ffff8de1d0f2ca80 x1862023612792192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776551.744297:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612792192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776551.744305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776551.744308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776551.744311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776551.744317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776551.744462:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776551.744471:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776551/real 1775776551] req@ffff8de1d0f2df80 x1862023612792320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776551.744480:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612792320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776551.744486:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776551.744489:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776551.744586:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776551.744591:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776551.744607:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776551.744614:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776551/real 1775776551] req@ffff8de1d0f2e300 x1862023612792448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776551.744622:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612792448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776551.744626:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776551.744628:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776551.744630:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776551.744634:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776551.744643:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776551.744648:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776551/real 1775776551] req@ffff8de1d0f2e680 x1862023612792576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776551.744654:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612792576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776551.744659:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776551.744660:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776551.744662:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776552.703857:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776553.727867:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776554.751879:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776555.775859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776556.799896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776556.863838:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776556.863848:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776556.863852:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776556.863861:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12528 00000100:00080000:0.0:1775776556.863881:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776556.863888:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776556.863922:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612792704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776556.863948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776556.863951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776556.863953:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776556.863957:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12528 00000100:00080000:0.0:1775776556.863961:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776556.863964:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776556.863974:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776556.863987:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612792832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776556.863988:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612792704:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776556.864003:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776556.864007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776556.864009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776556.864013:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12528 00000100:00080000:0.0:1775776556.864016:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776556.864020:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776556.864025:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776556.864035:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612792960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776556.864045:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776556.864048:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776556.864049:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:3.0:1775776556.864054:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776556.864055:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12528 00000100:00080000:0.0:1775776556.864062:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776556.864066:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776556.864072:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776556.864083:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612793088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776556.864092:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775776556.864093:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776556/real 1775776556] req@ffff8de1c5681880 x1862023612792704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776556.864099:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776556.864103:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776556.864112:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12528 00000100:00080000:0.0:1775776556.864117:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776556.864121:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776556.864125:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776556.864126:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612792704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776556.864138:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612793216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776556.864139:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776556.864148:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776556.864155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612792704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776556.864183:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776556.864205:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776556.864216:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776556/real 1775776556] req@ffff8de1c5683800 x1862023612792832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776556.864227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612792832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776556.864234:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776556.864237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776556.864240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776556.864245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776556.864260:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776556.864296:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776556/real 1775776556] req@ffff8de1c5681500 x1862023612792960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776556.864307:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612792960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776556.864315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776556.864317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776556.864320:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612792960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776556.864326:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776556.864344:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776556.864353:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776556/real 1775776556] req@ffff8de1c5683480 x1862023612793088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776556.864363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612793088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776556.864370:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776556.864373:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776556.864375:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776556.864380:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776556.864394:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776556.864403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776556/real 1775776556] req@ffff8de1c5680e00 x1862023612793216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776556.864413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612793216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776556.864420:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776556.864423:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776556.864426:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776557.823917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776558.847900:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776559.871865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776560.895878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776561.919902:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776561.983854:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776561.983865:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776561.983869:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776561.983879:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12533 00000100:00080000:1.0:1775776561.983889:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776561.983896:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776561.983930:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612793344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776561.983957:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776561.983962:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776561.983963:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776561.983967:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12533 00000100:00080000:1.0:1775776561.983971:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776561.983974:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776561.983983:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776561.983997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612793472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776561.984007:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776561.984011:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776561.984013:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775776561.984014:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612793344:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776561.984017:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12533 00000100:00080000:1.0:1775776561.984023:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776561.984026:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776561.984030:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776561.984036:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612793600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776561.984042:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776561.984044:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776561.984045:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776561.984047:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12533 00000100:00080000:1.0:1775776561.984049:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776561.984051:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776561.984055:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776561.984062:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612793728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776561.984067:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776561.984069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776561.984070:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776561.984072:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12533 00000100:00080000:1.0:1775776561.984074:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776561.984076:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776561.984080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775776561.984084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776561.984091:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612793856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776561.984116:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776561/real 1775776561] req@ffff8de1c2e16a00 x1862023612793344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776561.984132:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612793344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776561.984142:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776561.984146:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776561.984149:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612793344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776561.984170:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776561.984199:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776561.984207:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776561/real 1775776561] req@ffff8de1c2e17100 x1862023612793472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776561.984214:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612793472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776561.984219:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776561.984221:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776561.984223:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793472:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776561.984227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793600:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776561.984236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776561.984241:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776561/real 1775776561] req@ffff8de1c2e14380 x1862023612793600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776561.984247:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612793600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776561.984252:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776561.984254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776561.984256:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776561.984259:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776561.984268:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776561.984273:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776561/real 1775776561] req@ffff8de1c2e17b80 x1862023612793728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776561.984279:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612793728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776561.984283:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776561.984284:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776561.984286:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776561.984289:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776561.984296:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776561.984301:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776561/real 1775776561] req@ffff8de1c2e16680 x1862023612793856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776561.984311:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612793856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776561.984315:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776561.984317:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776561.984319:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612793856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776562.943871:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776563.967897:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776564.991878:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776566.015862:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776567.039862:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776567.103805:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776567.103812:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776567.103815:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776567.103823:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12538 00000100:00080000:0.0:1775776567.103833:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776567.103847:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776567.103882:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612793984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776567.103903:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776567.103905:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776567.103907:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776567.103909:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12538 00000100:00080000:0.0:1775776567.103912:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776567.103914:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776567.103923:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776567.103931:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612794112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776567.103938:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776567.103942:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775776567.103944:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612793984:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776567.103949:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776567.103953:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12538 00000100:00080000:0.0:1775776567.103955:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776567.103957:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776567.103961:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776567.103968:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612794240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776567.103973:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776567.103976:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776567.103978:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776567.103980:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12538 00000100:00080000:0.0:1775776567.103982:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776567.103985:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776567.103988:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776567.103998:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612794368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776567.103998:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776567.104006:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776567.104008:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776567.104010:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776567.104012:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12538 00000100:00080000:0.0:1775776567.104014:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776567.104016:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776567.104019:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776567.104025:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612794496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776567.104029:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776567/real 1775776567] req@ffff8de1c5680e00 x1862023612793984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776567.104047:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612793984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776567.104054:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776567.104057:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776567.104059:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612793984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776567.104076:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776567.104115:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776567.104124:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776567/real 1775776567] req@ffff8de1c5683480 x1862023612794112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776567.104131:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612794112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776567.104136:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776567.104138:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776567.104140:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776567.104143:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776567.104154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776567.104159:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776567/real 1775776567] req@ffff8de1c5681500 x1862023612794240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776567.104169:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612794240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776567.104173:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776567.104175:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776567.104176:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776567.104179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776567.104188:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776567.104192:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776567/real 1775776567] req@ffff8de1c5683800 x1862023612794368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776567.104199:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612794368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776567.104202:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776567.104204:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776567.104205:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776567.104208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776567.104216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776567.104222:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776567/real 1775776567] req@ffff8de1c5681880 x1862023612794496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776567.104232:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612794496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776567.104243:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776567.104247:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776567.104250:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776568.063863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776569.087891:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776570.111860:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776571.135946:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776572.159894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776572.223846:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776572.223854:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776572.223858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776572.223867:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12543 00000100:00080000:0.0:1775776572.223878:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776572.223885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776572.223920:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612794624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776572.223948:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776572.223951:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776572.223957:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776572.223962:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12543 00000100:00080000:0.0:1775776572.223966:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776572.223969:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776572.223978:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776572.223991:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612794752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776572.224018:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776572.224023:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:3.0:1775776572.224023:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612794624:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776572.224026:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776572.224033:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12543 00000100:00080000:0.0:1775776572.224037:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776572.224040:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776572.224046:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776572.224058:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612794880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776572.224067:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776572.224070:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776572.224072:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776572.224076:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12543 00000100:00080000:0.0:1775776572.224079:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775776572.224084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776572.224085:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776572.224092:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776572.224104:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612795008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776572.224113:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776572.224117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:3.0:1775776572.224119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776572/real 1775776572] req@ffff8de1c5681c00 x1862023612794624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776572.224120:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776572.224128:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12543 00000100:00080000:0.0:1775776572.224133:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776572.224137:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776572.224139:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612794624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775776572.224145:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775776572.224148:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776572.224152:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776572.224155:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612794624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776572.224159:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612795136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776572.224179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776572.224202:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776572.224214:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776572/real 1775776572] req@ffff8de1c5680380 x1862023612794752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776572.224225:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612794752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776572.224233:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776572.224237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776572.224240:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776572.224245:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776572.224265:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776572.224287:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776572/real 1775776572] req@ffff8de1c5682a00 x1862023612794880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776572.224299:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612794880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776572.224306:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776572.224309:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776572.224312:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612794880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776572.224317:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776572.224331:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776572.224340:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776572/real 1775776572] req@ffff8de1c5681f80 x1862023612795008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776572.224350:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612795008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776572.224357:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776572.224359:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776572.224362:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776572.224367:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776572.224386:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776572.224396:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776572/real 1775776572] req@ffff8de1c5680000 x1862023612795136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776572.224408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612795136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776572.224415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776572.224418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776572.224421:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776573.183894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776574.207857:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776575.231864:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776576.255999:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776577.279885:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776577.343855:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776577.343864:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776577.343868:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776577.343875:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12549 00000100:00080000:3.0:1775776577.343885:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776577.345096:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776577.345136:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612795264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776577.345167:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776577.345171:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776577.345173:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776577.345178:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12549 00000100:00080000:3.0:1775776577.345184:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776577.345189:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776577.345199:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776577.345211:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612795392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776577.345221:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776577.345226:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1775776577.345227:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612795264:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776577.345228:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776577.345236:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12549 00000100:00080000:3.0:1775776577.345239:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776577.345243:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776577.345247:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776577.345260:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612795520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776577.345269:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776577.345272:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776577.345274:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776577.345277:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12549 00000100:00080000:3.0:1775776577.345281:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776577.345284:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776577.345289:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776577.345297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776577.345303:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612795648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776577.345312:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776577.345316:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776577.345317:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776577.345320:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12549 00000100:00080000:3.0:1775776577.345324:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776577.345328:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776577.345333:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776577.345335:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776577/real 1775776577] req@ffff8de1c7af4380 x1862023612795264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776577.345345:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612795776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776577.345359:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612795264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776577.345369:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776577.345380:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776577.345384:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612795264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776577.345406:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776577.345429:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776577.345441:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776577/real 1775776577] req@ffff8de1c7af5180 x1862023612795392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776577.345453:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612795392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776577.345460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776577.345463:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776577.345465:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776577.345472:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776577.345490:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776577.345500:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776577/real 1775776577] req@ffff8de1c7af7800 x1862023612795520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776577.345507:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612795520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776577.345512:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776577.345514:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776577.345516:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776577.345519:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776577.345530:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776577.345535:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776577/real 1775776577] req@ffff8de1c7af5500 x1862023612795648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776577.345546:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612795648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776577.345550:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776577.345551:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776577.345553:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776577.345556:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776577.345567:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776577.345574:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776577/real 1775776577] req@ffff8de1c7af5f80 x1862023612795776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776577.345584:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612795776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776577.345591:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776577.345593:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776577.345596:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612795776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776578.304630:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776579.328014:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776580.351947:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776581.375960:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776582.399888:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776582.463791:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776582.463799:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776582.463803:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776582.463811:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12554 00000100:00080000:3.0:1775776582.463840:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776582.463847:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776582.463879:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612795904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776582.463907:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776582.463911:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776582.463913:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776582.463916:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12554 00000100:00080000:3.0:1775776582.463920:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776582.463923:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776582.463932:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776582.463947:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612796032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776582.463953:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612795904:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776582.463960:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776582.463964:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776582.463966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776582.463970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12554 00000100:00080000:3.0:1775776582.463974:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776582.463977:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776582.463981:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776582.463992:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612796160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776582.464001:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776582.464005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776582.464006:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776582.464010:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12554 00000800:00000100:1.0:1775776582.464014:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776582.464015:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776582.464019:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776582.464024:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776582.464033:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612796288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776582.464042:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776582.464045:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776582.464048:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776582.464049:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776582/real 1775776582] req@ffff8de1c7af4a80 x1862023612795904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776582.464053:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12554 00000100:00080000:3.0:1775776582.464058:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776582.464064:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776582.464068:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776582.464078:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612795904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776582.464079:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612796416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776582.464108:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776582.464112:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776582.464114:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612795904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776582.464133:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776582.464150:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776582.464158:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776582/real 1775776582] req@ffff8de1c7af5880 x1862023612796032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776582.464165:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612796032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776582.464170:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776582.464172:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776582.464174:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796032:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776582.464177:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776582.464186:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776582.464191:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776582/real 1775776582] req@ffff8de1c7af7100 x1862023612796160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776582.464197:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612796160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776582.464201:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776582.464203:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776582.464204:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776582.464208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776582.464216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776582.464221:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776582/real 1775776582] req@ffff8de1c7af7480 x1862023612796288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776582.464227:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612796288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776582.464231:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776582.464232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776582.464234:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776582.464237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776582.464245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776582.464250:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776582/real 1775776582] req@ffff8de1c7af6d80 x1862023612796416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776582.464256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612796416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776582.464260:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776582.464261:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776582.464263:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776583.423858:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776584.447891:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776585.471886:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776586.495982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776587.519949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776587.586886:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776587.586894:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776587.586898:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776587.587037:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12559 00000100:00080000:2.0:1775776587.587048:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776587.587054:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776587.587094:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612796544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776587.587123:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776587.587127:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776587.587129:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776587.587133:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12559 00000100:00080000:2.0:1775776587.587136:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776587.587140:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776587.587150:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776587.587161:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612796672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776587.587171:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776587.587174:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776587.587175:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776587.587178:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12559 00000100:00080000:2.0:1775776587.587181:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775776587.587181:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612796544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776587.587184:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776587.587188:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776587.587196:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612796800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776587.587205:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776587.587208:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776587.587209:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776587.587212:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12559 00000100:00080000:2.0:1775776587.587215:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776587.587218:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776587.587222:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776587.587230:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612796928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776587.587238:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776587.587240:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776587.587242:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776587.587245:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12559 00000100:00080000:2.0:1775776587.587248:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776587.587250:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776587.587254:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776587.587261:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612797056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776587.587297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776587.587324:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776587/real 1775776587] req@ffff8de1d0f2c700 x1862023612796544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776587.587340:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612796544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776587.587349:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776587.587353:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776587.587356:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612796544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776587.587362:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776587.587381:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776587.587392:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776587/real 1775776587] req@ffff8de1d0f2f100 x1862023612796672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776587.587408:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612796672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776587.587415:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776587.587418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776587.587420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776587.587440:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776587.587459:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776587.587467:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776587/real 1775776587] req@ffff8de1d0f2e680 x1862023612796800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776587.587492:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612796800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776587.587499:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776587.587502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776587.587505:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776587.587510:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776587.587534:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776587.587543:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776587/real 1775776587] req@ffff8de1d0f2e300 x1862023612796928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776587.587553:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612796928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776587.587566:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776587.587569:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776587.587572:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612796928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776587.587577:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776587.587592:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776587.587599:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776587/real 1775776587] req@ffff8de1d0f2df80 x1862023612797056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776587.587608:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612797056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776587.587614:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776587.587617:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776587.587620:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776588.543919:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776589.567872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776590.592596:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776591.615834:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776592.639903:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776592.703881:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776592.703890:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776592.703894:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776592.703903:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12564 00000100:00080000:0.0:1775776592.703913:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776592.703919:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776592.703952:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612797184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776592.703980:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776592.703984:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776592.703986:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776592.703990:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12564 00000100:00080000:0.0:1775776592.703994:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776592.703997:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776592.704007:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776592.704020:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612797312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776592.704025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612797184:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776592.704035:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776592.704039:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776592.704041:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776592.704045:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12564 00000100:00080000:0.0:1775776592.704049:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776592.704053:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776592.704058:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776592.704069:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612797440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776592.704080:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776592.704084:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776592.704086:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776592.704089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12564 00000800:00000100:3.0:1775776592.704094:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776592.704095:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776592.704101:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776592.704106:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776592.704116:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612797568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776592.704125:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775776592.704127:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776592/real 1775776592] req@ffff8de1c5683b80 x1862023612797184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776592.704129:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776592.704132:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776592.704141:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12564 00000100:00080000:0.0:1775776592.704147:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776592.704153:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776592.704153:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612797184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775776592.704160:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775776592.704169:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1775776592.704175:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612797696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776592.704175:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776592.704182:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612797184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776592.704208:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776592.704245:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776592.704256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776592/real 1775776592] req@ffff8de1c5680700 x1862023612797312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776592.704268:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612797312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776592.704277:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776592.704280:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776592.704283:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776592.704289:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776592.704305:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776592.704313:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776592/real 1775776592] req@ffff8de1c5682d80 x1862023612797440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776592.704335:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612797440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776592.704343:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776592.704346:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776592.704349:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776592.704355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776592.704372:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776592.704381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776592/real 1775776592] req@ffff8de1c5682300 x1862023612797568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776592.704392:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612797568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776592.704399:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776592.704402:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776592.704405:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776592.704411:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776592.704424:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776592.704432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776592/real 1775776592] req@ffff8de1c5682680 x1862023612797696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776592.704443:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612797696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776592.704456:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776592.704459:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776592.704462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776593.664531:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776594.689671:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776595.711883:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776596.736474:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776597.759945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776597.823907:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776597.823919:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776597.823925:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776597.823939:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12569 00000100:00080000:1.0:1775776597.823953:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776597.823962:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776597.824008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612797824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776597.824049:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776597.824053:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776597.824055:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776597.824059:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12569 00000100:00080000:1.0:1775776597.824063:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776597.824066:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776597.824078:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776597.824091:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612797952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776597.824101:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776597.824104:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776597.824105:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776597.824109:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12569 00000100:00080000:1.0:1775776597.824112:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776597.824115:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776597.824120:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776597.824130:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612798080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776597.824146:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776597.824160:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776597.824162:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776597.824166:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12569 00000100:00080000:1.0:1775776597.824169:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776597.824173:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776597.824178:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776597.824190:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612798208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776597.824197:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776597.824200:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776597.824202:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776597.824205:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12569 00000100:00080000:1.0:1775776597.824207:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776597.824210:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776597.824222:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776597.824231:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612798336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776597.824372:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612797824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776597.824479:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776597.824515:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776597.824548:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776597.824589:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776598.783940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776599.808184:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776600.831877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776600.896127:0:2391:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776600.896195:0:2391:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776600.896214:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776600.896270:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776600.896281:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776600.896290:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776600.896298:0:2391:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775776600.897381:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776597/real 1775776600] req@ffff8de1c2e15500 x1862023612797824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776600.897415:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612797824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776600.897426:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776600.897431:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776600.897435:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612797824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776600.897444:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776597/real 1775776600] req@ffff8de1c2e17480 x1862023612797952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776600.897454:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612797952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776600.897460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776600.897464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776600.897467:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612797952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776600.897474:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776597/real 1775776600] req@ffff8de1c2e14700 x1862023612798080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776600.897490:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612798080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776600.897496:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776600.897510:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776600.897513:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776600.897520:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776597/real 1775776600] req@ffff8de1c2e14e00 x1862023612798208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776600.897532:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612798208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776600.897539:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776600.897543:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776600.897545:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776600.897552:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776597/real 1775776600] req@ffff8de1c2e17800 x1862023612798336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776600.897562:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612798336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776600.897569:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776600.897571:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776600.897574:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776601.855824:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776602.879866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776602.943901:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776602.943908:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776602.943911:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776602.943918:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12574 00000100:00080000:2.0:1775776602.943938:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776602.943945:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776602.943979:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612798464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776602.944010:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776602.944014:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776602.944016:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776602.944021:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12574 00000100:00080000:2.0:1775776602.944024:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776602.944028:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776602.944037:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776602.944048:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612798592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776602.944058:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776602.944060:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776602.944062:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776602.944066:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12574 00000100:00080000:2.0:1775776602.944069:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776602.944072:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776602.944087:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776602.944099:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612798720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776602.944107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776602.944111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776602.944112:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776602.944115:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12574 00000100:00080000:2.0:1775776602.944119:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776602.944122:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776602.944126:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776602.944135:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612798848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776602.944143:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776602.944146:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776602.944147:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776602.944150:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12574 00000100:00080000:2.0:1775776602.944153:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776602.944156:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776602.944160:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776602.944166:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612798976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776602.944932:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612798464:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776602.945006:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776602.945044:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776602/real 1775776602] req@ffff8de1d0f2ca80 x1862023612798464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776602.945062:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612798464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776602.945071:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776602.945075:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776602.945080:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612798464:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776602.945087:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798592:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776602.945108:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776602.945119:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776602/real 1775776602] req@ffff8de1d0f2d500 x1862023612798592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776602.945130:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612798592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776602.945137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776602.945141:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776602.945144:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776602.945156:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798720:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776602.945175:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776602.945184:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776602/real 1775776602] req@ffff8de1d0f2df80 x1862023612798720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776602.945208:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612798720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776602.945216:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776602.945218:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776602.945221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776602.945226:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798848:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776602.945244:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776602.945253:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776602/real 1775776602] req@ffff8de1d0f2e300 x1862023612798848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776602.945262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612798848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776602.945269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776602.945272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776602.945275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776602.945281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798976:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776602.945297:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776602.945306:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776602/real 1775776602] req@ffff8de1d0f2e680 x1862023612798976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776602.945315:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612798976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776602.945325:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776602.945328:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776602.945331:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612798976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776603.903872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776604.927937:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776605.951924:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776606.975933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776608.000027:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776608.063860:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776608.063870:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776608.063874:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776608.063884:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12579 00000100:00080000:0.0:1775776608.063896:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776608.063903:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776608.063941:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612799104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776608.063974:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776608.063977:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776608.063979:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776608.063983:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12579 00000100:00080000:0.0:1775776608.063986:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776608.063989:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776608.063998:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776608.064008:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612799232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776608.064018:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776608.064021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776608.064024:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776608.064030:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12579 00000100:00080000:0.0:1775776608.064034:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776608.064038:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776608.064044:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776608.064055:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612799360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776608.064068:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612799104:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776608.064072:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776608.064082:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776608.064084:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776608.064089:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12579 00000100:00080000:0.0:1775776608.064093:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776608.064098:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776608.064104:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776608.064116:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612799488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776608.064135:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776608.064139:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776608.064141:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776608.064145:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12579 00000100:00080000:0.0:1775776608.064149:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776608.064154:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776608.064161:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776608.064171:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612799616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776608.064184:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776608.064245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776608/real 1775776608] req@ffff8de1c5682680 x1862023612799104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776608.064269:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612799104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776608.064281:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776608.064286:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776608.064290:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612799104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776608.064299:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776608.064325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776608.064337:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776608/real 1775776608] req@ffff8de1c5682300 x1862023612799232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776608.064349:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612799232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776608.064363:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776608.064367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776608.064371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776608.064429:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799360:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776608.064448:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776608.064457:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776608/real 1775776608] req@ffff8de1c5682d80 x1862023612799360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776608.064469:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612799360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776608.064476:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776608.064479:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776608.064483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776608.064489:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776608.064519:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776608.064530:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776608/real 1775776608] req@ffff8de1c5680700 x1862023612799488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776608.064542:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612799488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776608.064550:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776608.064553:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776608.064557:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799488:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776608.064563:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776608.064579:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776608.064587:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776608/real 1775776608] req@ffff8de1c5683b80 x1862023612799616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776608.064594:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612799616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776608.064598:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776608.064600:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776608.064602:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776609.023943:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776610.047877:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776611.071933:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776612.095872:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776613.119829:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776613.183879:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776613.183889:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776613.183893:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776613.183903:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12584 00000100:00080000:3.0:1775776613.183915:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776613.183922:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776613.183958:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612799744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776613.183985:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776613.183989:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776613.183991:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776613.183996:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12584 00000100:00080000:3.0:1775776613.184000:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776613.184004:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776613.184013:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776613.184018:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612799744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776613.184027:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612799872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776613.184038:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776613.184042:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776613.184044:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776613.184047:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12584 00000100:00080000:3.0:1775776613.184051:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776613.184055:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776613.184059:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776613.184070:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612800000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776613.184077:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776613.184084:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776613.184087:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776613.184089:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776613.184094:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12584 00000100:00080000:3.0:1775776613.184097:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776613.184102:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776613.184107:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776613/real 1775776613] req@ffff8de1c7af5c00 x1862023612799744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1775776613.184108:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776613.184122:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612800128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776613.184136:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776613.184140:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776613.184141:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1775776613.184144:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612799744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776613.184148:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12584 00000100:00080000:3.0:1775776613.184154:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776613.184161:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:1.0:1775776613.184162:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:3.0:1775776613.184166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775776613.184168:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776613.184173:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612799744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776613.184181:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612800256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776613.184196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776613.184221:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776613.184233:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776613/real 1775776613] req@ffff8de1c7af7b80 x1862023612799872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776613.184244:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612799872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776613.184251:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776613.184254:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776613.184257:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612799872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776613.184262:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776613.184282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776613.184311:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776613/real 1775776613] req@ffff8de1c7af4e00 x1862023612800000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776613.184324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612800000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776613.184348:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776613.184351:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776613.184354:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776613.184360:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776613.184380:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776613.184390:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776613/real 1775776613] req@ffff8de1c7af6680 x1862023612800128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776613.184401:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612800128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776613.184406:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776613.184408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776613.184410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776613.184414:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776613.184427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776613.184432:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776613/real 1775776613] req@ffff8de1c7af6300 x1862023612800256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776613.184439:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612800256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776613.184443:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776613.184445:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776613.184447:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776614.144004:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776615.167973:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776616.191903:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776617.215934:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776618.239915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776618.303848:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776618.303855:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776618.303860:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776618.303868:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12590 00000100:00080000:3.0:1775776618.303879:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776618.303886:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776618.303930:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6a00 x1862023612800384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776618.303960:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776618.303963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776618.303965:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776618.303970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12590 00000100:00080000:3.0:1775776618.303973:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776618.303976:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776618.303985:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776618.303996:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4000 x1862023612800512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776618.304005:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776618.304008:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776618.304009:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776618.304012:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12590 00000100:00080000:3.0:1775776618.304015:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776618.304018:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776618.304021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776618.304029:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4700 x1862023612800640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776618.304036:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776618.304039:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776618.304040:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776618.304043:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12590 00000100:00080000:3.0:1775776618.304046:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776618.304048:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776618.304052:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776618.304059:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6300 x1862023612800768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776618.304066:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776618.304069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776618.304071:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776618.304073:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12590 00000100:00080000:3.0:1775776618.304076:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776618.304079:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776618.304082:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776618.304089:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6680 x1862023612800896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776618.304710:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612800384:192.168.201.137@tcp:250:kworker.0 00000800:00000100:1.0:1775776618.304791:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776618.304823:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776618/real 1775776618] req@ffff8de1c7af6a00 x1862023612800384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776618.304842:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6a00 x1862023612800384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776618.304853:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776618.304857:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776618.304860:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612800384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776618.304868:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776618.304889:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776618.304901:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776618/real 1775776618] req@ffff8de1c7af4000 x1862023612800512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776618.304983:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4000 x1862023612800512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776618.304991:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776618.304994:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776618.304997:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776618.305003:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776618.305023:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776618.305034:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776618/real 1775776618] req@ffff8de1c7af4700 x1862023612800640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776618.305045:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4700 x1862023612800640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776618.305053:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776618.305055:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776618.305058:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776618.305064:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776618.305082:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776618.305091:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776618/real 1775776618] req@ffff8de1c7af6300 x1862023612800768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776618.305102:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6300 x1862023612800768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776618.305110:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776618.305113:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776618.305116:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776618.305121:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776618.305139:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776618.305148:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776618/real 1775776618] req@ffff8de1c7af6680 x1862023612800896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776618.305159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6680 x1862023612800896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776618.305166:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776618.305169:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776618.305172:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612800896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776619.263991:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776620.288615:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776621.311917:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776622.335981:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776623.359940:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776623.424191:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776623.424201:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776623.424207:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776623.424220:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12595 00000100:00080000:2.0:1775776623.424234:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776623.424312:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776623.424352:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612801024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776623.424384:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776623.424387:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776623.424389:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776623.424393:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12595 00000100:00080000:2.0:1775776623.424398:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776623.424414:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776623.424426:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776623.424433:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612801024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776623.424444:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612801152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776623.424456:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776623.424460:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776623.424462:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776623.424467:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12595 00000100:00080000:2.0:1775776623.424471:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776623.424476:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776623.424483:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776623.424500:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612801280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776623.424509:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776623.424522:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776623.424526:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776623.424549:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776623.424557:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12595 00000100:00080000:2.0:1775776623.424562:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776623.424564:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776623/real 1775776623] req@ffff8de1d0f2f100 x1862023612801024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776623.424572:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776623.424582:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776623.424596:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612801024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776623.424617:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612801408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776623.424621:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776623.424639:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776623.424645:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612801024:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776623.424647:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776623.424655:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776623.424657:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776623.424664:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12595 00000100:00080000:2.0:1775776623.424669:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776623.424674:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776623.424681:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801152:192.168.201.137@tcp:38:kworker.0 00000008:00100000:2.0:1775776623.424684:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776623.424703:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612801536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776623.424716:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776623.424761:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776623/real 1775776623] req@ffff8de1d0f2c700 x1862023612801152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776623.424780:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612801152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776623.424793:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776623.424801:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776623.424807:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776623.424814:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776623.424850:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776623.424868:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776623/real 1775776623] req@ffff8de1d0f2e680 x1862023612801280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776623.424879:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612801280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776623.424887:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776623.424890:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776623.424893:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776623.424899:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776623.424927:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776623.424938:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776623/real 1775776623] req@ffff8de1d0f2e300 x1862023612801408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776623.424950:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612801408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776623.424957:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776623.424961:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776623.424964:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776623.424980:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776623.425001:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776623.425014:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776623/real 1775776623] req@ffff8de1d0f2df80 x1862023612801536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776623.425029:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612801536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776623.425037:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776623.425041:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776623.425043:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776624.383985:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776625.407949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776626.431916:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776627.455949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776628.480088:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776628.543860:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776628.543869:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776628.543873:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776628.543881:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12600 00000100:00080000:3.0:1775776628.543892:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776628.543898:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776628.543937:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4e00 x1862023612801664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776628.543960:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776628.543963:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776628.543964:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776628.543967:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12600 00000100:00080000:3.0:1775776628.543970:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776628.543973:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776628.543984:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776628.543994:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612801664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776628.543999:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7b80 x1862023612801792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776628.544012:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776628.544015:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776628.544034:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776628.544039:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12600 00000100:00080000:3.0:1775776628.544043:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776628.544047:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776628.544053:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776628.544065:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5c00 x1862023612801920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776628.544075:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000800:00000100:1.0:1775776628.544079:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776628.544081:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776628.544084:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776628.544088:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12600 00000100:00080000:3.0:1775776628.544092:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776628.544096:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776628.544102:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776628.544115:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af6d80 x1862023612802048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776628.544123:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776628/real 1775776628] req@ffff8de1c7af4e00 x1862023612801664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776628.544125:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776628.544135:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776628.544137:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776628.544144:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12600 00000100:00080000:3.0:1775776628.544149:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1775776628.544156:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4e00 x1862023612801664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776628.544156:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776628.544163:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:1.0:1775776628.544175:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1775776628.544179:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7480 x1862023612802176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776628.544183:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776628.544189:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612801664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776628.544213:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776628.544234:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776628.544245:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776628/real 1775776628] req@ffff8de1c7af7b80 x1862023612801792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776628.544256:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7b80 x1862023612801792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776628.544269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776628.544272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776628.544276:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776628.544281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776628.544300:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776628.544310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776628/real 1775776628] req@ffff8de1c7af5c00 x1862023612801920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776628.544321:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5c00 x1862023612801920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776628.544328:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776628.544331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776628.544335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612801920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776628.544340:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776628.544360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776628.544369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776628/real 1775776628] req@ffff8de1c7af6d80 x1862023612802048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776628.544379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af6d80 x1862023612802048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776628.544385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776628.544387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776628.544390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776628.544395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776628.544410:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776628.544418:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776628/real 1775776628] req@ffff8de1c7af7480 x1862023612802176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776628.544427:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7480 x1862023612802176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776628.544433:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776628.544435:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776628.544438:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776629.503885:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776630.527945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776631.552270:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776632.575881:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776633.599904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776633.663997:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776633.664007:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776633.664011:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776633.664020:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12605 00000100:00080000:3.0:1775776633.664031:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776633.664037:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776633.664070:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7100 x1862023612802304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776633.664107:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776633.664111:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776633.664113:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776633.664118:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12605 00000100:00080000:3.0:1775776633.664122:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776633.664126:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776633.664135:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776633.664150:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5880 x1862023612802432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776633.664151:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612802304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776633.664167:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776633.664170:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776633.664171:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776633.664175:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12605 00000100:00080000:3.0:1775776633.664179:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776633.664183:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776633.664188:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776633.664201:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4a80 x1862023612802560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776633.664209:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776633.664213:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776633.664214:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776633.664218:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12605 00000800:00000100:1.0:1775776633.664223:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:3.0:1775776633.664224:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776633.664231:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776633.664237:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776633.664248:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612802688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776633.664257:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776633.664261:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1775776633.664262:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776633/real 1775776633] req@ffff8de1c7af7100 x1862023612802304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776633.664263:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776633.664269:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12605 00000100:00080000:3.0:1775776633.664276:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776633.664282:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776633.664287:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776633.664297:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612802816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776633.664301:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7100 x1862023612802304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776633.664317:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776633.664321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776633.664326:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612802304:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776633.664348:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776633.664365:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776633.664373:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776633/real 1775776633] req@ffff8de1c7af5880 x1862023612802432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776633.664381:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5880 x1862023612802432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776633.664386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776633.664388:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776633.664390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776633.664393:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776633.664401:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776633.664406:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776633/real 1775776633] req@ffff8de1c7af4a80 x1862023612802560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776633.664413:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4a80 x1862023612802560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776633.664417:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776633.664418:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776633.664420:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776633.664423:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776633.664434:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776633.664442:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776633/real 1775776633] req@ffff8de1c7af5f80 x1862023612802688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776633.664453:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612802688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776633.664460:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776633.664464:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776633.664466:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776633.664472:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776633.664489:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776633.664497:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776633/real 1775776633] req@ffff8de1c7af5500 x1862023612802816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776633.664503:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612802816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776633.664508:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776633.664510:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776633.664511:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612802816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776634.624024:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776635.647865:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776636.671894:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776637.695856:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776638.719965:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776638.783832:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776638.783855:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776638.783861:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776638.783873:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12610 00000100:00080000:2.0:1775776638.783887:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776638.783894:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776638.783944:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612802944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776638.783973:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776638.783977:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776638.783978:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776638.783981:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12610 00000100:00080000:2.0:1775776638.783984:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776638.783987:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776638.783997:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776638.784007:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612803072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776638.784018:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776638.784021:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776638.784022:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776638.784026:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12610 00000100:00080000:2.0:1775776638.784030:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776638.784034:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776638.784039:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776638.784048:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612802944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776638.784060:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612803200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776638.784071:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776638.784075:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776638.784076:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776638.784080:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12610 00000100:00080000:2.0:1775776638.784084:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776638.784089:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776638.784095:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776638.784106:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612803328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776638.784115:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776638.784119:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776638.784121:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776638.784125:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12610 00000100:00080000:2.0:1775776638.784129:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:1.0:1775776638.784135:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776638.784136:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776638.784143:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776638.784154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612803456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776638.784188:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776638/real 1775776638] req@ffff8de1d0f2d500 x1862023612802944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776638.784211:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612802944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776638.784222:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776638.784227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776638.784231:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612802944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776638.784253:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776638.784275:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776638.784288:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776638/real 1775776638] req@ffff8de1d0f2ca80 x1862023612803072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776638.784298:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612803072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776638.784305:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776638.784308:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776638.784311:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776638.784339:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776638.784358:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776638.784367:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776638/real 1775776638] req@ffff8de1d0f2df80 x1862023612803200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776638.784377:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612803200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776638.784382:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776638.784384:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776638.784386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776638.784390:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776638.784403:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776638.784409:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776638/real 1775776638] req@ffff8de1d0f2e300 x1862023612803328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776638.784417:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612803328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776638.784430:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776638.784432:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776638.784434:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776638.784437:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776638.784448:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776638.784453:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776638/real 1775776638] req@ffff8de1d0f2e680 x1862023612803456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776638.784460:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612803456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776638.784464:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776638.784466:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776638.784468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776639.744144:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776640.767968:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776641.791928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776642.815984:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776643.839946:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776643.903922:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776643.903933:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776643.903939:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776643.903953:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12615 00000100:00080000:2.0:1775776643.903970:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776643.903979:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776643.904032:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612803584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776643.904067:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776643.904071:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776643.904073:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776643.904078:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12615 00000100:00080000:2.0:1775776643.904082:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776643.904086:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776643.904098:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776643.904110:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612803712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776643.904120:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776643.904125:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776643.904127:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776643.904131:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12615 00000100:00080000:2.0:1775776643.904136:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776643.904140:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776643.904146:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776643.904161:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612803840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776643.904165:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612803584:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776643.904173:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776643.904179:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776643.904181:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776643.904186:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12615 00000100:00080000:2.0:1775776643.904189:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776643.904194:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776643.904200:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776643.904211:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612803968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776643.904220:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776643.904224:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776643.904226:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776643.904229:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12615 00000100:00080000:2.0:1775776643.904232:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776643.904237:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776643.904242:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776643.904254:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612804096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776643.904263:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776643.904307:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776643/real 1775776643] req@ffff8de1d0f2c700 x1862023612803584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776643.904323:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612803584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776643.904338:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776643.904343:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776643.904347:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612803584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776643.904355:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776643.904379:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776643.904391:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776643/real 1775776643] req@ffff8de1d0f2f100 x1862023612803712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776643.904403:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612803712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776643.904410:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776643.904413:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776643.904416:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803712:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776643.904445:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776643.904461:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776643.904470:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776643/real 1775776643] req@ffff8de1d0f2e680 x1862023612803840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776643.904481:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612803840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776643.904603:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776643.904606:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776643.904608:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776643.904613:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776643.904630:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776643.904637:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776643/real 1775776643] req@ffff8de1d0f2e300 x1862023612803968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776643.904645:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612803968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776643.904650:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776643.904652:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776643.904654:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612803968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776643.904657:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776643.904666:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776643.904671:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776643/real 1775776643] req@ffff8de1d0f2df80 x1862023612804096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776643.904677:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612804096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776643.904681:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776643.904683:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776643.904684:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776644.863992:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776645.887990:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776646.911988:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776647.939182:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776648.959960:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776649.023893:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776649.023909:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776649.023915:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776649.023929:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12620 00000100:00080000:0.0:1775776649.023950:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776649.023958:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776649.024001:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612804224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776649.024026:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776649.024030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776649.024032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776649.024040:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12620 00000100:00080000:0.0:1775776649.024045:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776649.024048:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776649.024060:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776649.024071:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612804352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776649.024081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776649.024084:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776649.024086:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776649.024090:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12620 00000100:00080000:0.0:1775776649.024093:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776649.024097:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776649.024100:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612804224:192.168.201.137@tcp:250:kworker.0 00000008:00100000:0.0:1775776649.024101:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776649.024109:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612804480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776649.024118:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776649.024121:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776649.024123:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776649.024126:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12620 00000100:00080000:0.0:1775776649.024129:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776649.024132:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776649.024137:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776649.024144:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612804608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776649.024151:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776649.024154:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776649.024156:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776649.024159:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12620 00000100:00080000:0.0:1775776649.024163:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776649.024166:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776649.024170:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776649.024177:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612804736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776649.024177:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776649.024217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776649/real 1775776649] req@ffff8de1c5680000 x1862023612804224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776649.024240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612804224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776649.024255:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776649.024258:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776649.024261:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612804224:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776649.024266:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804352:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776649.024284:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776649.024292:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776649/real 1775776649] req@ffff8de1c5681f80 x1862023612804352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776649.024300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612804352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776649.024311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776649.024313:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776649.024315:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776649.024338:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776649.024350:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776649.024356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776649/real 1775776649] req@ffff8de1c5682a00 x1862023612804480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776649.024363:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612804480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776649.024372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776649.024374:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776649.024376:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776649.024379:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776649.024391:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776649.024399:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776649/real 1775776649] req@ffff8de1c5680380 x1862023612804608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776649.024409:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612804608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776649.024427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776649.024433:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776649.024437:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776649.024443:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776649.024462:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776649.024471:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776649/real 1775776649] req@ffff8de1c5681c00 x1862023612804736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776649.024483:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612804736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776649.024490:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776649.024493:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776649.024497:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776649.984076:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776651.007945:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776652.031963:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776653.055978:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776654.079975:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776654.143890:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776654.143903:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776654.143909:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776654.143923:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12625 00000100:00080000:0.0:1775776654.143939:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776654.143948:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776654.143997:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612804864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776654.144031:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776654.144034:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776654.144035:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776654.144039:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12625 00000100:00080000:0.0:1775776654.144042:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776654.144045:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776654.144056:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776654.144068:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612804992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776654.144079:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612804864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776654.144081:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776654.144088:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776654.144090:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776654.144095:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12625 00000100:00080000:0.0:1775776654.144099:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776654.144103:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776654.144107:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776654.144119:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612805120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776654.144129:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776654.144132:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776654.144133:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776654.144136:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12625 00000100:00080000:0.0:1775776654.144141:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776654.144144:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776654.144148:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776654.144154:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776654.144159:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612805248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776654.144169:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776654.144173:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776654.144175:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776654.144179:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12625 00000100:00080000:0.0:1775776654.144183:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776654.144187:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776654.144196:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776654/real 1775776654] req@ffff8de1c5681880 x1862023612804864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1775776654.144201:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776654.144214:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612804864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776654.144222:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612805376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776654.144224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776654.144232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776654.144238:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612804864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776654.144267:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776654.144295:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776654.144310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776654/real 1775776654] req@ffff8de1c5683800 x1862023612804992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776654.144322:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612804992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776654.144329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776654.144332:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776654.144335:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612804992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776654.144340:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776654.144358:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776654.144369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776654/real 1775776654] req@ffff8de1c5681500 x1862023612805120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776654.144378:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612805120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776654.144385:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776654.144387:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776654.144390:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776654.144395:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776654.144416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776654.144424:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776654/real 1775776654] req@ffff8de1c5683480 x1862023612805248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776654.144434:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612805248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776654.144441:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776654.144453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776654.144456:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776654.144462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776654.144478:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776654.144486:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776654/real 1775776654] req@ffff8de1c5680e00 x1862023612805376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776654.144497:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612805376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776654.144506:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776654.144509:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776654.144513:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776655.103896:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776656.128025:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776657.152367:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776658.175949:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776659.199890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776659.263833:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776659.263840:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776659.263844:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776659.263851:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12631 00000100:00080000:0.0:1775776659.263861:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776659.263867:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776659.263896:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680e00 x1862023612805504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776659.263920:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776659.263924:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776659.263926:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776659.263930:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12631 00000100:00080000:0.0:1775776659.263934:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776659.263938:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776659.263947:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776659.263959:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683480 x1862023612805632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776659.263968:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776659.263970:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776659.263972:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776659.263975:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12631 00000100:00080000:0.0:1775776659.263978:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776659.263981:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776659.263985:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776659.263994:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681500 x1862023612805760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776659.264002:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776659.264005:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776659.264007:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776659.264010:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12631 00000100:00080000:0.0:1775776659.264013:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776659.264016:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776659.264021:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776659.264025:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612805504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776659.264034:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683800 x1862023612805888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776659.264048:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776659.264050:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776659.264052:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776659.264055:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12631 00000100:00080000:0.0:1775776659.264057:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776659.264060:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776659.264064:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776659.264072:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681880 x1862023612806016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:1.0:1775776659.264101:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776659.264130:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776659/real 1775776659] req@ffff8de1c5680e00 x1862023612805504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776659.264159:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680e00 x1862023612805504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776659.264172:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776659.264177:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776659.264181:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612805504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776659.264189:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776659.264214:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776659.264227:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776659/real 1775776659] req@ffff8de1c5683480 x1862023612805632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776659.264245:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683480 x1862023612805632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776659.264253:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776659.264255:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776659.264258:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776659.264264:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776659.264282:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776659.264294:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776659/real 1775776659] req@ffff8de1c5681500 x1862023612805760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776659.264305:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681500 x1862023612805760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776659.264311:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776659.264314:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776659.264317:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776659.264343:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776659.264363:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776659.264375:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776659/real 1775776659] req@ffff8de1c5683800 x1862023612805888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776659.264386:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683800 x1862023612805888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776659.264394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776659.264398:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776659.264401:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612805888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776659.264408:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776659.264428:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776659.264444:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776659/real 1775776659] req@ffff8de1c5681880 x1862023612806016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776659.264460:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681880 x1862023612806016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776659.264467:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776659.264470:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776659.264473:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776660.223877:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776661.247893:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776662.272705:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776663.297531:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776664.319894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776664.383861:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776664.383870:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776664.383874:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776664.383883:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12636 00000100:00080000:2.0:1775776664.383894:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776664.383900:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776664.383936:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612806144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776664.383961:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776664.383965:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776664.383966:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776664.383970:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12636 00000100:00080000:2.0:1775776664.383975:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776664.383979:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776664.383994:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776664.384000:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612806144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776664.384006:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612806272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776664.384014:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776664.384016:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776664.384017:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776664.384020:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12636 00000100:00080000:2.0:1775776664.384023:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776664.384025:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776664.384028:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776664.384040:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612806400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776664.384046:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776664.384048:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776664.384049:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776664.384051:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12636 00000100:00080000:2.0:1775776664.384053:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776664.384055:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776664.384058:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776664.384064:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612806528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776664.384069:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776664.384071:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776664.384072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776664.384074:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12636 00000100:00080000:2.0:1775776664.384076:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776664.384077:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776664.384079:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776664.384084:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612806656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776664.384117:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776664.384153:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776664.384175:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776664.384192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776665.345134:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776666.367893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776667.392147:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1775776667.456031:0:2389:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:3.0:1775776667.456072:0:2389:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1775776667.456088:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775776667.456129:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775776667.456138:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775776667.456146:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:3.0:1775776667.456153:0:2389:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:1.0:1775776667.456228:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776664/real 1775776667] req@ffff8de1d0f2d500 x1862023612806272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776667.456250:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612806272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776667.456261:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776667.456265:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776667.456269:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776667.456276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776664/real 1775776667] req@ffff8de1d0f2df80 x1862023612806400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776667.456294:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612806400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776667.456301:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776667.456304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776667.456307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776667.456312:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776664/real 1775776667] req@ffff8de1d0f2e300 x1862023612806528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776667.456324:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612806528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776667.456330:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776667.456333:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776667.456336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776667.456356:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776664/real 1775776667] req@ffff8de1d0f2e680 x1862023612806656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776667.456367:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612806656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776667.456374:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776667.456377:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776667.456380:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806656:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776667.456386:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776664/real 1775776667] req@ffff8de1d0f2ca80 x1862023612806144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776667.456398:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612806144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776667.456404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776667.456408:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776667.456410:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612806144:192.168.201.137@tcp:250:kworker.0 00010000:00010000:0.0:1775776668.415863:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776669.439860:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776669.503843:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776669.503851:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776669.503856:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776669.503864:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12641 00000100:00080000:2.0:1775776669.503876:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776669.503889:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776669.503923:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612806784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776669.503959:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776669.503962:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776669.503964:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776669.503968:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12641 00000100:00080000:2.0:1775776669.503972:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776669.503976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776669.503985:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776669.503996:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612806912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776669.504005:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776669.504007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776669.504009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776669.504012:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12641 00000100:00080000:2.0:1775776669.504014:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776669.504017:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776669.504021:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776669.504030:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612807040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776669.504037:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612806784:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776669.504040:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776669.504046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776669.504048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776669.504060:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12641 00000100:00080000:2.0:1775776669.504065:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776669.504069:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776669.504074:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:1.0:1775776669.504095:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776669.504099:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612807168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776669.504110:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776669.504113:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776669.504115:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776669.504118:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12641 00000100:00080000:2.0:1775776669.504121:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776669.504124:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776669.504128:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776669.504129:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776669/real 1775776669] req@ffff8de1d0f2f100 x1862023612806784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776669.504140:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612807296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776669.504222:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612806784/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776669.504232:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776669.504236:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776669.504239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612806784:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776669.504247:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806912:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776669.504285:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776669.504297:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776669/real 1775776669] req@ffff8de1d0f2c700 x1862023612806912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776669.504322:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612806912/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776669.504329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776669.504334:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776669.504336:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612806912:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776669.504358:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807040:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776669.504376:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776669.504384:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776669/real 1775776669] req@ffff8de1d0f2ca80 x1862023612807040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776669.504395:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612807040/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776669.504402:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776669.504405:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776669.504408:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807040:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776669.504413:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807168:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776669.504427:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776669.504435:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776669/real 1775776669] req@ffff8de1d0f2e680 x1862023612807168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776669.504445:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612807168/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776669.504452:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776669.504454:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776669.504457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807168:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776669.504462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807296:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776669.504476:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776669.504483:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776669/real 1775776669] req@ffff8de1d0f2e300 x1862023612807296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776669.504494:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612807296/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776669.504501:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776669.504504:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776669.504507:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807296:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776670.464278:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776671.490603:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776672.511912:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776673.538757:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776674.560320:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776674.623923:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776674.623932:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776674.623937:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776674.623946:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12646 00000100:00080000:1.0:1775776674.623960:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776674.623967:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776674.624000:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612807424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776674.624024:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776674.624027:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776674.624028:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776674.624033:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12646 00000100:00080000:1.0:1775776674.624036:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776674.624039:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776674.624048:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776674.624062:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612807552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776674.624072:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776674.624074:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776674.624076:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776674.624079:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12646 00000100:00080000:1.0:1775776674.624083:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776674.624086:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776674.624090:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776674.624100:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612807680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776674.624108:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776674.624111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776674.624112:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776674.624116:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12646 00000100:00080000:1.0:1775776674.624119:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776674.624122:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776674.624127:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776674.624136:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612807808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776674.624144:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776674.624147:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776674.624149:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776674.624152:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12646 00000100:00080000:1.0:1775776674.624155:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776674.624158:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776674.624162:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776674.624170:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612807936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776674.624269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612807424:192.168.201.137@tcp:250:kworker.0 00000800:00000100:2.0:1775776674.624325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776674.624355:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776674/real 1775776674] req@ffff8de1c2e14a80 x1862023612807424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776674.624371:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612807424/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776674.624380:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776674.624383:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776674.624386:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612807424:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776674.624394:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807552:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776674.624416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776674.624427:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776674/real 1775776674] req@ffff8de1c2e17800 x1862023612807552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776674.624438:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612807552/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776674.624444:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776674.624447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776674.624450:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807552:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776674.624455:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807680:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776674.624473:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776674.624482:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776674/real 1775776674] req@ffff8de1c2e14e00 x1862023612807680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776674.624495:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612807680/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776674.624500:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776674.624502:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776674.624504:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807680:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776674.624507:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807808:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776674.624521:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776674.624527:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776674/real 1775776674] req@ffff8de1c2e14700 x1862023612807808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776674.624533:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612807808/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776674.624538:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776674.624539:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776674.624541:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807808:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776674.624555:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807936:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776674.624565:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776674.624571:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776674/real 1775776674] req@ffff8de1c2e17480 x1862023612807936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776674.624577:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612807936/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776674.624585:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776674.624587:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776674.624588:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612807936:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776675.583948:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776676.607956:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776677.632113:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776678.657216:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776679.680178:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776679.743835:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776679.743843:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776679.743847:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776679.743856:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12651 00000100:00080000:1.0:1775776679.743868:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776679.743874:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776679.743910:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612808064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776679.743941:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776679.743944:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776679.743946:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776679.743950:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12651 00000100:00080000:1.0:1775776679.743953:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776679.743956:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776679.743964:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776679.743974:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612808192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776679.743994:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776679.743997:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776679.743998:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776679.744002:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12651 00000100:00080000:1.0:1775776679.744005:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776679.744008:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776679.744013:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776679.744023:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612808320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776679.744031:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776679.744034:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776679.744036:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776679.744039:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12651 00000100:00080000:1.0:1775776679.744042:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776679.744045:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776679.744049:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776679.744057:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612808448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776679.744065:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776679.744068:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776679.744069:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776679.744072:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12651 00000100:00080000:1.0:1775776679.744075:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776679.744078:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776679.744083:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776679.744091:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612808576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1775776679.744286:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612808064:192.168.201.137@tcp:250:kworker.0 00000800:00000100:2.0:1775776679.744343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776679.744374:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776679/real 1775776679] req@ffff8de1c2e15500 x1862023612808064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776679.744389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612808064/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776679.744398:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776679.744402:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776679.744406:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612808064:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776679.744412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808192:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776679.744431:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776679.744440:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776679/real 1775776679] req@ffff8de1c2e16680 x1862023612808192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776679.744450:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612808192/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776679.744457:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776679.744460:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776679.744462:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808192:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776679.744467:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808320:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776679.744482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776679.744490:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776679/real 1775776679] req@ffff8de1c2e17b80 x1862023612808320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776679.744501:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612808320/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776679.744507:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776679.744510:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776679.744513:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808320:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776679.744518:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808448:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776679.744535:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776679.744543:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776679/real 1775776679] req@ffff8de1c2e14380 x1862023612808448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776679.744553:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612808448/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776679.744560:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776679.744563:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776679.744566:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808448:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776679.744571:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808576:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776679.744587:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776679.744595:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776679/real 1775776679] req@ffff8de1c2e17100 x1862023612808576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776679.744605:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612808576/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776679.744612:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776679.744614:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776679.744617:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808576:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776680.704282:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776681.728029:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776682.752086:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776683.775913:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776684.799925:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776684.863838:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776684.863853:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776684.863858:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776684.863867:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12656 00000100:00080000:1.0:1775776684.863878:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776684.863885:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776684.863921:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612808704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776684.863949:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776684.863953:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776684.863955:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776684.863958:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12656 00000100:00080000:1.0:1775776684.863962:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776684.863966:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776684.863974:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776684.863987:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612808832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776684.863998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776684.864002:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776684.864004:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776684.864008:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12656 00000100:00080000:1.0:1775776684.864012:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776684.864015:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776684.864020:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776684.864030:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612808704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776684.864031:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612808960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776684.864061:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776684.864064:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776684.864066:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776684.864071:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12656 00000100:00080000:1.0:1775776684.864075:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776684.864079:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776684.864085:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776684.864098:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612809088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776684.864107:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776684.864111:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776684.864112:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776684.864116:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12656 00000100:00080000:1.0:1775776684.864120:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776684.864124:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776684.864130:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776684.864140:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612809216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1775776684.864152:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776684.864204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776684/real 1775776684] req@ffff8de1c2e16a00 x1862023612808704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776684.864234:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612808704/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776684.864246:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776684.864252:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776684.864259:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612808704:192.168.201.137@tcp:250:kworker.0 00000100:00100000:2.0:1775776684.864269:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808832:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776684.864302:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776684.864327:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776684/real 1775776684] req@ffff8de1c2e17100 x1862023612808832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776684.864347:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612808832/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776684.864362:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776684.864367:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776684.864371:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808832:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776684.864410:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808960:192.168.201.137@tcp:38:kworker.0 00000800:00000100:2.0:1775776684.864434:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776684.864446:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776684/real 1775776684] req@ffff8de1c2e14380 x1862023612808960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776684.864458:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612808960/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776684.864466:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776684.864469:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776684.864472:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612808960:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776684.864478:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809088:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776684.864499:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776684.864510:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776684/real 1775776684] req@ffff8de1c2e17b80 x1862023612809088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776684.864522:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612809088/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776684.864529:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776684.864533:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776684.864536:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809088:192.168.201.137@tcp:8:kworker.0 00000100:00100000:2.0:1775776684.864543:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809216:192.168.201.137@tcp:8:kworker.0 00000800:00000100:2.0:1775776684.864562:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776684.864572:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776684/real 1775776684] req@ffff8de1c2e16680 x1862023612809216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776684.864583:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612809216/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776684.864589:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1775776684.864592:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:2.0:1775776684.864594:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809216:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776685.823882:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776686.847901:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776687.871912:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776688.895913:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776689.920440:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776689.983885:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776689.983891:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776689.983895:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776689.983903:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12661 00000100:00080000:2.0:1775776689.983913:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776689.983920:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776689.983967:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612809344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776689.984031:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612809344:192.168.201.137@tcp:250:kworker.0 00000800:00000100:1.0:1775776689.984085:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776689.984112:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776689.984115:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776689.984118:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776689.984122:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12661 00000100:00080000:2.0:1775776689.984126:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776689.984130:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776689.984139:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776689.984151:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612809472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776689.984200:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776689/real 1775776689] req@ffff8de1d0f2df80 x1862023612809344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776689.984219:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612809344/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776689.984228:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776689.984232:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776689.984235:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612809344:192.168.201.137@tcp:250:kworker.0 00000100:00100000:1.0:1775776689.984257:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809472:192.168.201.137@tcp:38:kworker.0 00000800:00000100:1.0:1775776689.984278:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776689.984289:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776689/real 1775776689] req@ffff8de1d0f2d500 x1862023612809472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776689.984300:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612809472/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776689.984307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776689.984310:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776689.984314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809472:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775776689.984364:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776689.984372:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776689.984375:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776689.984379:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12661 00000100:00080000:2.0:1775776689.984384:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776689.984388:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776689.984394:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776689.984408:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612809600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776689.984424:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776689.984428:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776689.984430:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776689.984434:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12661 00000100:00080000:2.0:1775776689.984438:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776689.984444:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776689.984449:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776689.984454:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776689.984462:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612809728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776689.984473:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776689.984476:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776689.984478:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776689.984484:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12661 00000800:00000100:1.0:1775776689.984486:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776689.984489:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776689.984494:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776689.984499:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776689.984504:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776689/real 1775776689] req@ffff8de1d0f2d500 x1862023612809600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776689.984514:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612809856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1775776689.984521:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612809600/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776689.984535:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776689.984539:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776689.984543:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809600:192.168.201.137@tcp:38:kworker.0 00000100:00100000:1.0:1775776689.984557:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809728:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776689.984575:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776689.984590:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776689/real 1775776689] req@ffff8de1d0f2df80 x1862023612809728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776689.984603:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612809728/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776689.984611:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776689.984614:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776689.984617:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809728:192.168.201.137@tcp:8:kworker.0 00000100:00100000:1.0:1775776689.984622:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809856:192.168.201.137@tcp:8:kworker.0 00000800:00000100:1.0:1775776689.984640:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:1.0:1775776689.984650:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776689/real 1775776689] req@ffff8de1d0f2e300 x1862023612809856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1775776689.984661:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612809856/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1775776689.984669:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1775776689.984672:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:1.0:1775776689.984682:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612809856:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776690.943893:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776691.968049:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776692.991959:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776694.016121:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776695.040042:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776695.103832:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776695.103840:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776695.103844:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776695.103873:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12666 00000100:00080000:2.0:1775776695.103885:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776695.103895:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776695.103934:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612809984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776695.103971:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776695.103974:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776695.103975:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776695.103982:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12666 00000100:00080000:2.0:1775776695.103986:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776695.103988:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776695.103996:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776695.104007:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612810112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776695.104018:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776695.104021:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776695.104023:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776695.104027:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12666 00000100:00080000:2.0:1775776695.104030:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776695.104034:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776695.104039:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776695.104051:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612810240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776695.104060:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776695.104063:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776695.104065:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776695.104069:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12666 00000100:00080000:2.0:1775776695.104072:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776695.104075:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776695.104080:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776695.104091:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612810368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776695.104099:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776695.104102:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776695.104103:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776695.104107:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12666 00000100:00080000:2.0:1775776695.104109:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776695.104113:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776695.104119:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776695.104131:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612810496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776695.104412:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612809984:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776695.104470:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776695.104497:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776695/real 1775776695] req@ffff8de1d0f2e680 x1862023612809984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776695.104515:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612809984/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776695.104524:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776695.104527:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776695.104531:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612809984:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776695.104538:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810112:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776695.104560:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776695.104571:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776695/real 1775776695] req@ffff8de1d0f2ca80 x1862023612810112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776695.104799:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612810112/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776695.104807:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776695.104810:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776695.104813:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810112:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776695.104818:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810240:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776695.104841:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776695.104874:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776695/real 1775776695] req@ffff8de1d0f2c700 x1862023612810240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776695.104886:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612810240/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776695.104894:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776695.104898:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776695.104901:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810240:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776695.104906:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810368:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776695.104927:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776695.104938:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776695/real 1775776695] req@ffff8de1d0f2f100 x1862023612810368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776695.104949:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612810368/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776695.104956:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776695.104959:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776695.104962:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810368:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776695.104967:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810496:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776695.104986:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776695.104994:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776695/real 1775776695] req@ffff8de1d0f2e300 x1862023612810496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776695.105004:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612810496/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776695.105012:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776695.105014:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776695.105017:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810496:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776696.064099:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776697.088043:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776698.112352:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776699.137123:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776700.159949:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776700.223889:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776700.223899:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776700.223904:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776700.223915:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12671 00000100:00080000:2.0:1775776700.223929:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776700.223938:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776700.223989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612810624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776700.224028:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776700.224032:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776700.224034:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776700.224039:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12671 00000100:00080000:2.0:1775776700.224043:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776700.224046:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776700.224059:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776700.224071:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612810752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776700.224082:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776700.224086:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776700.224088:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776700.224099:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12671 00000100:00080000:2.0:1775776700.224103:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776700.224110:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776700.224115:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776700.224128:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612810880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776700.224138:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776700.224141:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776700.224144:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776700.224147:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12671 00000100:00080000:2.0:1775776700.224151:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776700.224155:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776700.224160:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776700.224275:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612810624:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776700.224360:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776700.224403:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776700/real 1775776700] req@ffff8de1d0f2df80 x1862023612810624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776700.224431:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612810624/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776700.224442:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776700.224447:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776700.224451:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612810624:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776700.224459:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810752:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776700.224482:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776700.224493:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776700/real 1775776700] req@ffff8de1d0f2d500 x1862023612810752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776700.224506:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612810752/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776700.224514:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776700.224516:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776700.224520:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810752:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776700.224525:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810880:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776700.224545:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776700.224554:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776700/real 1775776700] req@ffff8de1d0f2e300 x1862023612810880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776700.224564:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612810880/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776700.224578:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776700.224581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776700.224584:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612810880:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776700.224656:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612811008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776700.224675:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776700.224679:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776700.224681:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776700.224685:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12671 00000100:00080000:2.0:1775776700.224690:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776700.224694:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776700.224700:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776700.224711:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612811136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776700.224796:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811008:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776700.224814:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776700.224822:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776700/real 1775776700] req@ffff8de1d0f2f100 x1862023612811008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776700.224830:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612811008/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776700.224835:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776700.224837:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776700.224839:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811008:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776700.224842:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811136:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776700.224851:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776700.224856:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776700/real 1775776700] req@ffff8de1d0f2c700 x1862023612811136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776700.224863:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612811136/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776700.224867:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776700.224868:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776700.224871:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811136:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776701.183907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776702.207966:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776703.231982:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776704.256073:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776705.280327:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776705.343966:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776705.343980:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776705.343986:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776705.343999:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12677 00000100:00080000:1.0:1775776705.344015:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776705.344023:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776705.344076:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612811264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776705.344114:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776705.344119:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776705.344121:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776705.344126:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12677 00000100:00080000:1.0:1775776705.344130:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776705.344134:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776705.344147:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776705.344160:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612811392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776705.344171:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776705.344174:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776705.344177:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776705.344194:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12677 00000100:00080000:1.0:1775776705.344198:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776705.344201:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776705.344207:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776705.344217:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612811520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776705.344232:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776705.344235:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776705.344237:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776705.344241:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12677 00000100:00080000:1.0:1775776705.344245:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776705.344249:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776705.344254:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776705.344265:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612811648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776705.344275:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776705.344278:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776705.344280:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776705.344285:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12677 00000100:00080000:1.0:1775776705.344290:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776705.344294:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776705.344299:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776705.344326:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612811776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776705.344329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612811264:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776705.344419:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776705.344458:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776705/real 1775776705] req@ffff8de1c2e15500 x1862023612811264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776705.344477:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612811264/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776705.344487:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776705.344491:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776705.344495:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612811264:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776705.344502:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811392:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776705.344524:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776705.344545:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776705/real 1775776705] req@ffff8de1c2e17480 x1862023612811392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776705.344557:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612811392/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776705.344564:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776705.344567:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776705.344570:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811392:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776705.344577:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811520:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776705.344596:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776705.344606:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776705/real 1775776705] req@ffff8de1c2e14700 x1862023612811520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776705.344617:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612811520/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776705.344625:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776705.344628:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776705.344631:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811520:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776705.344637:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811648:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776705.344664:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776705.344673:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776705/real 1775776705] req@ffff8de1c2e14e00 x1862023612811648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776705.344697:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612811648/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776705.344705:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776705.344708:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776705.344711:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811648:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776705.344785:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811776:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776705.344803:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776705.344812:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776705/real 1775776705] req@ffff8de1c2e17800 x1862023612811776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776705.344829:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612811776/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776705.344836:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776705.344839:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776705.344849:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612811776:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776706.304056:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776707.327964:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776708.351895:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776709.376023:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776710.399915:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776710.463860:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776710.463869:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776710.463873:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776710.463882:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12682 00000100:00080000:1.0:1775776710.463892:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776710.463899:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776710.463950:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612811904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776710.464028:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612811904:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776710.464084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776710.464114:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776710.464117:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776710.464119:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776710.464123:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12682 00000100:00080000:1.0:1775776710.464127:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776710.464130:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776710.464139:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776710.464152:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612812032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776710.465653:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776710/real 1775776710] req@ffff8de1c2e14a80 x1862023612811904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776710.465675:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612811904/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776710.465684:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776710.465687:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776710.465690:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612811904:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776710.465717:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812032:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776710.465769:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776710.465784:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776710/real 1775776710] req@ffff8de1c2e17800 x1862023612812032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776710.465801:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612812032/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776710.465809:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776710.465812:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776710.465815:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812032:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775776710.465893:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776710.465897:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776710.465899:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776710.465904:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12682 00000100:00080000:1.0:1775776710.465909:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776710.465913:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776710.465976:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776710.465989:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612812160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776710.465998:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776710.466000:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776710.466001:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776710.466004:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12682 00000100:00080000:1.0:1775776710.466006:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776710.466009:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776710.466012:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776710.466016:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612812288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776710.466022:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776710.466023:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776710.466024:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776710.466026:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12682 00000100:00080000:1.0:1775776710.466028:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776710.466029:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776710.466031:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776710.466035:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612812416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776710.466084:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812160:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776710.466107:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776710.466120:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776710/real 1775776710] req@ffff8de1c2e14e00 x1862023612812160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776710.466131:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612812160/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776710.466137:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776710.466139:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776710.466141:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812160:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776710.466145:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812288:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776710.466158:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776710.466164:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776710/real 1775776710] req@ffff8de1c2e14700 x1862023612812288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776710.466170:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612812288/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776710.466179:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776710.466182:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776710.466185:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812288:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776710.466190:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812416:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776710.466207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776710.466217:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776710/real 1775776710] req@ffff8de1c2e17480 x1862023612812416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776710.466228:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612812416/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776710.466235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776710.466238:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776710.466241:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812416:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776711.425935:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776712.447890:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776713.471866:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776714.496394:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776715.519904:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776715.583815:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776715.583822:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776715.583825:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776715.583832:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12687 00000100:00080000:1.0:1775776715.583841:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776715.583846:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776715.583874:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612812544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776715.583896:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776715.583898:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776715.583899:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776715.583902:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12687 00000100:00080000:1.0:1775776715.583903:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776715.583905:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776715.583912:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776715.583920:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612812672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776715.583926:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776715.583929:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776715.583930:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776715.583932:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12687 00000100:00080000:1.0:1775776715.583934:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775776715.583938:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612812544:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776715.583939:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776715.583945:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776715.583950:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612812800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776715.583957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776715.583959:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776715.583960:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776715.583962:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12687 00000100:00080000:1.0:1775776715.583964:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776715.583966:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776715.583968:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776715.583976:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612812928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776715.583981:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776715.583983:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776715.583984:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776715.583985:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12687 00000100:00080000:1.0:1775776715.583988:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776715.583990:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776715.583993:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776715.583999:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612813056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776715.584003:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776715.584038:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776715/real 1775776715] req@ffff8de1c2e15500 x1862023612812544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776715.584053:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612812544/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776715.584060:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776715.584063:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776715.584066:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612812544:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776715.584070:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812672:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776715.584084:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776715.584094:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776715/real 1775776715] req@ffff8de1c2e16680 x1862023612812672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776715.584105:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612812672/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776715.584112:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776715.584115:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776715.584118:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812672:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776715.584140:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812800:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776715.584159:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776715.584169:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776715/real 1775776715] req@ffff8de1c2e17b80 x1862023612812800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776715.584180:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612812800/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776715.584188:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776715.584191:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776715.584194:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812800:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776715.584200:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812928:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776715.584216:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776715.584224:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776715/real 1775776715] req@ffff8de1c2e14380 x1862023612812928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776715.584231:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612812928/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776715.584235:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776715.584237:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776715.584239:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612812928:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776715.584242:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813056:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776715.584252:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776715.584256:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776715/real 1775776715] req@ffff8de1c2e17100 x1862023612813056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776715.584262:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612813056/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776715.584267:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776715.584270:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776715.584273:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813056:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776716.543875:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776717.567907:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776718.591859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776719.615890:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776720.639898:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776720.703835:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776720.703844:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776720.703849:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776720.703858:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12692 00000100:00080000:0.0:1775776720.703868:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776720.703875:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776720.703908:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681c00 x1862023612813184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776720.703935:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776720.703938:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776720.703940:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776720.703948:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12692 00000100:00080000:0.0:1775776720.703952:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776720.703955:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776720.703964:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776720.703975:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680380 x1862023612813312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776720.703983:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776720.703986:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776720.703988:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776720.703991:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12692 00000100:00080000:0.0:1775776720.703999:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776720.704003:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776720.704008:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776720.704018:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682a00 x1862023612813440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776720.704027:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776720.704030:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776720.704032:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776720.704037:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12692 00000100:00080000:0.0:1775776720.704041:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776720.704045:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776720.704050:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776720.704053:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612813184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776720.704063:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5681f80 x1862023612813568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776720.704073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776720.704076:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776720.704078:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776720.704082:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12692 00000100:00080000:0.0:1775776720.704086:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776720.704089:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776720.704094:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775776720.704105:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776720.704108:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680000 x1862023612813696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776720.704133:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776720/real 1775776720] req@ffff8de1c5681c00 x1862023612813184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776720.704147:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681c00 x1862023612813184/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776720.704154:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776720.704156:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776720.704167:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612813184:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776720.704174:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813312:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776720.704194:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776720.704204:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776720/real 1775776720] req@ffff8de1c5680380 x1862023612813312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776720.704216:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680380 x1862023612813312/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776720.704224:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776720.704227:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776720.704230:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813312:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776720.704237:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813440:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776720.704251:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776720.704258:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776720/real 1775776720] req@ffff8de1c5682a00 x1862023612813440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776720.704264:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682a00 x1862023612813440/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776720.704273:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776720.704275:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776720.704277:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813440:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776720.704294:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813568:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776720.704303:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776720.704308:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776720/real 1775776720] req@ffff8de1c5681f80 x1862023612813568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776720.704314:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5681f80 x1862023612813568/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776720.704318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776720.704320:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776720.704322:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813568:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776720.704325:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813696:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776720.704332:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776720.704336:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776720/real 1775776720] req@ffff8de1c5680000 x1862023612813696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776720.704342:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680000 x1862023612813696/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776720.704346:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776720.704348:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776720.704350:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813696:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776721.663894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776722.688055:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776723.711931:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776724.735950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776725.759936:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776725.823886:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776725.823900:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776725.823907:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776725.823921:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12697 00000100:00080000:2.0:1775776725.823936:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776725.823944:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776725.823992:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612813824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776725.824025:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776725.824029:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776725.824030:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776725.824034:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12697 00000100:00080000:2.0:1775776725.824037:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776725.824041:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776725.824053:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776725.824075:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612813952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776725.824086:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776725.824090:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776725.824092:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775776725.824094:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612813824:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776725.824099:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12697 00000100:00080000:2.0:1775776725.824103:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776725.824107:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776725.824112:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776725.824127:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612814080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776725.824137:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776725.824141:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776725.824142:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776725.824146:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12697 00000100:00080000:2.0:1775776725.824157:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776725.824162:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776725.824166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775776725.824174:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776725.824179:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612814208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776725.824189:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776725.824193:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776725.824195:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776725.824199:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12697 00000100:00080000:2.0:1775776725.824202:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776725.824205:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776725.824210:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776725.824220:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776725/real 1775776725] req@ffff8de1d0f2ca80 x1862023612813824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776725.824221:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612814336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776725.824260:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612813824/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776725.824272:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776725.824277:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776725.824281:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612813824:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776725.824306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813952:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776725.824365:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776725.824377:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776725/real 1775776725] req@ffff8de1d0f2e680 x1862023612813952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776725.824389:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612813952/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776725.824396:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776725.824400:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776725.824403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612813952:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776725.824409:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814080:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776725.824425:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776725.824433:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776725/real 1775776725] req@ffff8de1d0f2c700 x1862023612814080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776725.824443:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612814080/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776725.824451:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776725.824453:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776725.824457:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814080:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776725.824462:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814208:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776725.824477:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776725.824485:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776725/real 1775776725] req@ffff8de1d0f2f100 x1862023612814208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776725.824495:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612814208/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776725.824503:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776725.824506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776725.824509:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814208:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776725.824513:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814336:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776725.824526:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776725.824534:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776725/real 1775776725] req@ffff8de1d0f2e300 x1862023612814336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776725.824551:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612814336/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776725.824559:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776725.824561:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776725.824564:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814336:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776726.783925:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776727.807879:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776728.831859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776729.855859:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776730.879859:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776730.943839:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776730.943847:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776730.943851:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776730.943858:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12702 00000100:00080000:2.0:1775776730.943867:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776730.943874:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776730.943906:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612814464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776730.943928:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776730.943930:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776730.943932:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776730.943935:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12702 00000100:00080000:2.0:1775776730.943939:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776730.943944:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776730.943953:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776730.943965:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612814592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776730.943969:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612814464:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776730.943980:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776730.943984:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776730.943985:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776730.943991:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12702 00000100:00080000:2.0:1775776730.943994:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776730.943999:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776730.944003:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776730.944015:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612814720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776730.944023:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776730.944026:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776730.944028:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776730.944032:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12702 00000100:00080000:2.0:1775776730.944036:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776730.944040:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776730.944045:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776730.944056:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612814848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776730.944062:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814592:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775776730.944073:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776730.944075:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776730.944077:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776730.944081:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12702 00000100:00080000:2.0:1775776730.944085:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776730.944088:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776730.944092:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814720:192.168.201.137@tcp:38:kworker.0 00000008:00100000:2.0:1775776730.944095:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776730.944108:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612814976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776730.944192:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776730.944207:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814976:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776731.903894:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776732.928048:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776733.952648:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1775776734.016124:0:2390:0:(lib-socket.c:454:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.137:988 00000400:00000100:2.0:1775776734.016223:0:2390:0:(acceptor.c:111:lnet_connect_console_error()) Connection to 192.168.201.137@tcp at host 192.168.201.137 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:2.0:1775776734.016244:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776734.016309:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776734.016319:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776734.016328:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000800:00000100:2.0:1775776734.016336:0:2390:0:(socklnd_cb.c:422:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.137@tcp 00000100:00100000:3.0:1775776734.016615:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776730/real 1775776734] req@ffff8de1d0f2f100 x1862023612814848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776734.016647:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612814848/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776734.016660:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776734.016665:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776734.016670:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814848:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776734.016678:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776730/real 1775776734] req@ffff8de1d0f2c700 x1862023612814976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776734.016689:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612814976/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776734.016695:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776734.016698:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776734.016701:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814976:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776734.016708:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776730/real 1775776734] req@ffff8de1d0f2df80 x1862023612814592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776734.016719:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612814592/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776734.016766:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776734.016770:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776734.016773:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814592:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776734.016780:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776730/real 1775776734] req@ffff8de1d0f2e300 x1862023612814720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776734.016793:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612814720/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776734.016800:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776734.016803:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776734.016807:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612814720:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776734.016815:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776730/real 1775776734] req@ffff8de1d0f2d500 x1862023612814464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776734.016825:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612814464/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776734.016831:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776734.016835:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776734.016838:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612814464:192.168.201.137@tcp:250:kworker.0 00010000:00010000:3.0:1775776734.976362:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776736.000553:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776736.064244:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776736.064253:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776736.064256:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776736.064266:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12707 00000100:00080000:2.0:1775776736.064277:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776736.064284:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776736.064317:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612815104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776736.064351:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776736.064355:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776736.064356:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776736.064360:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12707 00000100:00080000:2.0:1775776736.064364:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776736.064367:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776736.064377:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776736.064389:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612815232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776736.064399:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776736.064401:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776736.064403:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776736.064407:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12707 00000100:00080000:2.0:1775776736.064410:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776736.064414:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776736.064418:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776736.064429:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612815360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776736.064437:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776736.064440:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776736.064443:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776736.064446:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12707 00000100:00080000:2.0:1775776736.064449:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775776736.064634:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612815104:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776736.064957:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776736.064992:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776736/real 1775776736] req@ffff8de1d0f2e680 x1862023612815104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776736.065012:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612815104/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776736.065022:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776736.065027:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776736.065031:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612815104:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776736.065039:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815232:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776736.065065:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776736.065077:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776736/real 1775776736] req@ffff8de1d0f2ca80 x1862023612815232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776736.065094:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612815232/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776736.065101:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776736.065104:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776736.065107:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815232:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776736.065112:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815360:192.168.201.137@tcp:38:kworker.0 00000100:00080000:2.0:1775776736.065218:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776736.065225:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776736.065239:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612815488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776736.065251:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776736.065254:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776736.065257:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776736.065261:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12707 00000800:00000100:3.0:1775776736.068109:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776736.068155:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776736/real 1775776736] req@ffff8de1d0f2d500 x1862023612815360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776736.068177:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612815360/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776736.068187:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776736.068192:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776736.068195:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815360:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776736.068230:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815488:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776736.068271:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776736.068283:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776736/real 1775776736] req@ffff8de1d0f2e300 x1862023612815488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776736.068295:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612815488/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776736.068307:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776736.068311:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776736.068314:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815488:192.168.201.137@tcp:8:kworker.0 00000100:00080000:2.0:1775776736.068394:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776736.068402:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776736.068414:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776736.068436:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612815616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776736.069065:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815616:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776736.069093:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776736.069105:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776736/real 1775776736] req@ffff8de1d0f2df80 x1862023612815616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776736.069116:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612815616/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776736.069124:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776736.069128:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776736.069131:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815616:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776737.023940:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776738.047872:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776739.071985:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776740.096294:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776741.119867:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776741.183827:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776741.183834:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776741.183837:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776741.183843:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12712 00000100:00080000:1.0:1775776741.183852:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776741.183857:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776741.183892:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16a00 x1862023612815744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776741.183914:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776741.183917:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776741.183918:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776741.183921:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12712 00000100:00080000:1.0:1775776741.183923:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776741.183926:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776741.183933:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776741.183947:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612815872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776741.183957:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1775776741.183959:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612815744:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776741.183963:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776741.183966:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776741.183970:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12712 00000100:00080000:1.0:1775776741.183973:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776741.183976:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776741.183981:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776741.183994:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612816000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776741.184004:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776741.184007:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776741.184009:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776741.184012:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12712 00000100:00080000:1.0:1775776741.184016:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000800:00000100:3.0:1775776741.184019:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776741.184023:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776741.184028:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776741.184038:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612816128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776741.184044:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776741.184046:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776741.184048:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776741.184051:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12712 00000100:00080000:1.0:1775776741.184078:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776741.184080:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776741.184084:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776741.184092:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612816256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776741.184176:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776741/real 1775776741] req@ffff8de1c2e16a00 x1862023612815744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776741.184194:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16a00 x1862023612815744/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776741.184214:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776741.184217:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776741.184221:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612815744:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776741.184243:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815872:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776741.184265:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776741.184276:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776741/real 1775776741] req@ffff8de1c2e17100 x1862023612815872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776741.184287:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612815872/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776741.184294:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776741.184298:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776741.184301:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612815872:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776741.184306:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816000:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776741.184325:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776741.184334:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776741/real 1775776741] req@ffff8de1c2e14380 x1862023612816000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776741.184346:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612816000/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776741.184353:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776741.184356:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776741.184359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816000:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776741.184365:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816128:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776741.184383:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776741.184393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776741/real 1775776741] req@ffff8de1c2e17b80 x1862023612816128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776741.184404:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612816128/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776741.184411:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776741.184414:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776741.184418:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816128:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776741.184422:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816256:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776741.184436:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776741.184445:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776741/real 1775776741] req@ffff8de1c2e16680 x1862023612816256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776741.184455:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612816256/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776741.184462:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776741.184465:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776741.184468:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816256:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776742.143921:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776743.167918:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776744.191895:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776745.216328:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776746.239952:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776746.303983:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776746.303994:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776746.304000:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776746.304013:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12718 00000100:00080000:2.0:1775776746.304076:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776746.304086:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776746.304133:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612816384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776746.304165:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776746.304169:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776746.304174:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776746.304179:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12718 00000100:00080000:2.0:1775776746.304183:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776746.304186:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776746.304197:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776746.304209:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612816512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776746.304224:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612816384:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776746.304225:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776746.304231:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776746.304233:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776746.304240:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12718 00000100:00080000:2.0:1775776746.304243:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776746.304246:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776746.304251:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776746.304262:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612816640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776746.304271:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776746.304275:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776746.304277:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776746.304281:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12718 00000100:00080000:2.0:1775776746.304292:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776746.304296:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776746.304302:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775776746.304311:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776746.304313:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612816768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776746.304323:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776746.304327:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776746.304328:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776746.304332:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12718 00000100:00080000:2.0:1775776746.304336:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776746.304340:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776746.304345:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776746.304354:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612816896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776746.304359:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776746/real 1775776746] req@ffff8de1d0f2c700 x1862023612816384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776746.304382:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612816384/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776746.304394:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776746.304399:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776746.304403:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612816384:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776746.304428:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816512:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776746.304447:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776746.304457:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776746/real 1775776746] req@ffff8de1d0f2f100 x1862023612816512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776746.304469:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612816512/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776746.304477:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776746.304480:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776746.304483:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816512:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776746.304488:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816640:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776746.304502:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776746.304519:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776746/real 1775776746] req@ffff8de1d0f2df80 x1862023612816640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776746.304538:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612816640/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776746.304544:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776746.304547:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776746.304550:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816640:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776746.304555:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816768:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776746.304574:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776746.304582:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776746/real 1775776746] req@ffff8de1d0f2e300 x1862023612816768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776746.304592:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612816768/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776746.304599:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776746.304612:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776746.304615:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816768:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776746.304620:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816896:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776746.304635:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776746.304643:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776746/real 1775776746] req@ffff8de1d0f2d500 x1862023612816896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776746.304659:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612816896/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776746.304672:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776746.304675:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776746.304678:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612816896:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776747.264660:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776748.293397:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776749.312150:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776750.338008:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776751.360140:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776751.423902:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776751.423914:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776751.423920:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776751.423933:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12723 00000100:00080000:2.0:1775776751.423948:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776751.423955:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776751.424012:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612817024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776751.424046:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776751.424056:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776751.424058:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776751.424062:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12723 00000100:00080000:2.0:1775776751.424065:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776751.424069:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776751.424079:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776751.424090:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612817152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776751.424100:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776751.424105:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776751.424107:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776751.424111:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12723 00000100:00080000:2.0:1775776751.424127:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776751.424133:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776751.424134:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612817024:192.168.201.137@tcp:250:kworker.0 00000008:00100000:2.0:1775776751.424139:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776751.424154:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612817280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776751.424165:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776751.424169:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776751.424171:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776751.424175:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12723 00000100:00080000:2.0:1775776751.424188:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776751.424192:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776751.424197:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775776751.424208:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776751.424218:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612817408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776751.424229:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776751.424238:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776751.424240:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776751.424244:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12723 00000100:00080000:2.0:1775776751.424247:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1775776751.424252:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776751/real 1775776751] req@ffff8de1d0f2ca80 x1862023612817024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776751.424253:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776751.424261:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776751.424273:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612817536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776751.424275:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612817024/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776751.424300:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776751.424304:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776751.424307:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612817024:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776751.424313:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817152:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776751.424331:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776751.424338:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776751/real 1775776751] req@ffff8de1d0f2e680 x1862023612817152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776751.424345:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612817152/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776751.424355:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776751.424357:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776751.424359:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817152:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776751.424379:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817280:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776751.424388:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776751.424393:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776751/real 1775776751] req@ffff8de1d0f2d500 x1862023612817280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776751.424399:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612817280/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776751.424404:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776751.424406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776751.424407:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817280:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776751.424410:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817408:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776751.424419:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776751.424424:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776751/real 1775776751] req@ffff8de1d0f2e300 x1862023612817408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776751.424430:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612817408/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776751.424434:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776751.424436:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776751.424438:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817408:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776751.424442:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817536:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776751.424451:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776751.424458:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776751/real 1775776751] req@ffff8de1d0f2df80 x1862023612817536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776751.424467:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612817536/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776751.424475:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776751.424477:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776751.424480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817536:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776752.384282:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776753.408503:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776754.433142:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776755.458357:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776756.479942:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775776756.543968:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776756.543981:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1775776756.543986:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776756.543999:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12728 00000100:00080000:3.0:1775776756.544015:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776756.544023:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:3.0:1775776756.544073:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af7800 x1862023612817664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776756.544109:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776756.544112:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1775776756.544114:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776756.544118:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12728 00000100:00080000:3.0:1775776756.544122:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776756.544124:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776756.544134:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776756.544144:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5180 x1862023612817792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776756.544153:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776756.544156:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1775776756.544157:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1775776756.544163:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612817664:192.168.201.137@tcp:250:kworker.0 00000100:00080000:3.0:1775776756.544164:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12728 00000100:00080000:3.0:1775776756.544170:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776756.544175:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776756.544180:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1775776756.544193:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af4380 x1862023612817920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776756.544202:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776756.544205:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1775776756.544206:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776756.544210:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12728 00000100:00080000:3.0:1775776756.544213:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776756.544217:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776756.544222:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776756.544233:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5500 x1862023612818048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776756.544242:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1775776756.544245:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1775776756.544246:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1775776756.544250:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12728 00000100:00080000:3.0:1775776756.544253:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1775776756.544256:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:3.0:1775776756.544259:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776756.544267:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c7af5f80 x1862023612818176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1775776756.544313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776756.544358:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776756/real 1775776756] req@ffff8de1c7af7800 x1862023612817664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776756.544380:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af7800 x1862023612817664/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776756.544390:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776756.544394:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776756.544398:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612817664:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776756.544428:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817792:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776756.544452:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776756.544464:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776756/real 1775776756] req@ffff8de1c7af5180 x1862023612817792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776756.544477:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5180 x1862023612817792/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776756.544485:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776756.544488:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776756.544492:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817792:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776756.544497:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817920:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776756.544517:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776756.544527:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776756/real 1775776756] req@ffff8de1c7af4380 x1862023612817920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776756.544538:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af4380 x1862023612817920/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776756.544545:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776756.544549:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776756.544552:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612817920:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776756.544557:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818048:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776756.544575:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776756.544584:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776756/real 1775776756] req@ffff8de1c7af5500 x1862023612818048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776756.544596:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5500 x1862023612818048/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776756.544609:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776756.544612:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776756.544614:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818048:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776756.544619:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818176:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776756.544637:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776756.544646:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776756/real 1775776756] req@ffff8de1c7af5f80 x1862023612818176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776756.544657:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c7af5f80 x1862023612818176/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776756.544664:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776756.544667:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776756.544669:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c7af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818176:192.168.201.137@tcp:8:kworker.0 00010000:00010000:3.0:1775776757.503968:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776758.529055:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776759.552295:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776760.576260:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775776761.601380:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776761.670524:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776761.670544:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776761.670550:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776761.670564:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12733 00000100:00080000:1.0:1775776761.670650:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776761.670660:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776761.670761:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612818304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776761.670877:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612818304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776761.672043:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776761.672050:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776761.672052:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000800:00000100:0.0:1775776761.672207:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776761.672259:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776761/real 1775776761] req@ffff8de1c2e15500 x1862023612818304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776761.672284:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612818304/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776761.672295:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776761.672300:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776761.672304:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612818304:192.168.201.137@tcp:250:kworker.0 00000100:00080000:1.0:1775776761.672369:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12733 00000100:00080000:1.0:1775776761.672375:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776761.672381:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776761.672394:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776761.672413:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612818432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776761.672435:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776761.672542:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776761.672544:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776761.672548:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12733 00000100:00080000:1.0:1775776761.672551:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776761.672554:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776761.672558:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776761.672567:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612818560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776761.672582:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776761.672586:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776761.672587:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776761.672589:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12733 00000100:00080000:1.0:1775776761.672593:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776761.672595:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776761.672599:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776761.672605:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612818688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776761.672611:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776761.672613:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776761.672614:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776761.672616:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12733 00000100:00080000:1.0:1775776761.672617:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776761.672619:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776761.672621:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776761.672626:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612818816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1775776761.672740:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818432:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776761.672763:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776761.672774:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776761/real 1775776761] req@ffff8de1c2e17480 x1862023612818432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776761.672782:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612818432/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776761.672788:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776761.672790:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776761.672792:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818432:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776761.672797:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818560:192.168.201.137@tcp:38:kworker.0 00000800:00000100:0.0:1775776761.672807:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776761.672812:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776761/real 1775776761] req@ffff8de1c2e14700 x1862023612818560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776761.672818:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612818560/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776761.672823:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776761.672824:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776761.672826:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818560:192.168.201.137@tcp:38:kworker.0 00000100:00100000:0.0:1775776761.672829:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818688:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776761.672839:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776761.672844:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776761/real 1775776761] req@ffff8de1c2e14e00 x1862023612818688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776761.672851:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612818688/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776761.672855:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776761.672857:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776761.672858:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818688:192.168.201.137@tcp:8:kworker.0 00000100:00100000:0.0:1775776761.672861:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818816:192.168.201.137@tcp:8:kworker.0 00000800:00000100:0.0:1775776761.672869:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:0.0:1775776761.672873:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776761/real 1775776761] req@ffff8de1c2e17800 x1862023612818816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776761.672879:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612818816/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776761.672883:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1775776761.672884:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:0.0:1775776761.672886:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612818816:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776762.624704:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776763.647950:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776764.672850:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776765.695955:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776766.719941:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776766.784463:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776766.784469:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776766.784473:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776766.784483:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12738 00000100:00080000:1.0:1775776766.784493:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776766.784499:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776766.784530:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14a80 x1862023612818944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776766.784559:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776766.784563:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776766.784564:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776766.784569:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12738 00000100:00080000:1.0:1775776766.784573:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776766.784576:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776766.784585:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776766.784596:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17800 x1862023612819072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776766.784604:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776766.784617:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776766.784618:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776766.784622:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12738 00000100:00080000:1.0:1775776766.784625:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776766.784627:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776766.784631:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776766.784640:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14e00 x1862023612819200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776766.784647:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776766.784650:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776766.784651:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776766.784654:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12738 00000100:00080000:1.0:1775776766.784657:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776766.784660:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776766.784665:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776766.784671:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14700 x1862023612819328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776766.784678:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776766.784681:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776766.784683:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776766.784685:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12738 00000100:00080000:1.0:1775776766.784688:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776766.784690:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776766.784694:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776766.784701:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17480 x1862023612819456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776766.784795:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612818944:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776766.784854:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776766.784883:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776766/real 1775776766] req@ffff8de1c2e14a80 x1862023612818944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776766.784900:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14a80 x1862023612818944/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776766.784909:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776766.784912:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776766.784916:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612818944:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776766.784923:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819072:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776766.784945:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776766.784956:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776766/real 1775776766] req@ffff8de1c2e17800 x1862023612819072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776766.784968:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17800 x1862023612819072/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776766.784975:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776766.784978:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776766.784980:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819072:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776766.784985:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819200:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776766.785002:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776766.785010:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776766/real 1775776766] req@ffff8de1c2e14e00 x1862023612819200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776766.785020:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14e00 x1862023612819200/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776766.785028:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776766.785031:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776766.785034:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819200:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776766.785040:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819328:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776766.785057:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776766.785065:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776766/real 1775776766] req@ffff8de1c2e14700 x1862023612819328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776766.785080:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14700 x1862023612819328/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776766.785087:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776766.785090:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776766.785093:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819328:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776766.785098:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819456:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776766.785115:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776766.785124:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776766/real 1775776766] req@ffff8de1c2e17480 x1862023612819456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776766.785133:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17480 x1862023612819456/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776766.785139:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776766.785142:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776766.785145:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819456:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776767.743942:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776768.767924:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776769.791982:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776770.816148:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776771.840127:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1775776771.905494:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776771.905504:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1775776771.905509:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776771.905545:0:168768:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12743 00000100:00080000:1.0:1775776771.905556:0:168768:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776771.905562:0:168768:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:1.0:1775776771.905598:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e15500 x1862023612819584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776771.905679:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612819584:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776771.905765:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:1.0:1775776771.906432:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776771.906437:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1775776771.906440:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776771.906445:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12743 00000100:00080000:1.0:1775776771.906450:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776771.906454:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776771.906464:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776771.906479:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e16680 x1862023612819712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776771.909491:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776771/real 1775776771] req@ffff8de1c2e15500 x1862023612819584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776771.909531:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e15500 x1862023612819584/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776771.909548:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776771.909553:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776771.909557:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612819584:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776771.909590:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819712:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776771.909658:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776771.909674:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776771/real 1775776771] req@ffff8de1c2e16680 x1862023612819712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776771.909686:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e16680 x1862023612819712/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776771.909693:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776771.909696:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776771.909699:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819712:192.168.201.137@tcp:38:kworker.0 00000100:00080000:1.0:1775776771.910548:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776771.910554:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1775776771.910557:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776771.910564:0:168768:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12743 00000100:00080000:1.0:1775776771.910571:0:168768:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776771.910577:0:168768:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776771.910589:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1775776771.910616:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17b80 x1862023612819840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776771.910630:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776771.910633:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1775776771.910635:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776771.910639:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12743 00000100:00080000:1.0:1775776771.910641:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776771.910645:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776771.910649:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776771.910657:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e14380 x1862023612819968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1775776771.910671:0:168768:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1775776771.910674:0:168768:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1775776771.910676:0:168768:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1775776771.910679:0:168768:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12743 00000100:00080000:1.0:1775776771.910682:0:168768:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1775776771.910685:0:168768:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:1.0:1775776771.910689:0:168768:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:1.0:1775776771.910695:0:168768:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c2e17100 x1862023612820096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776771.910873:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819840:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776771.910911:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776771.910927:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776771/real 1775776771] req@ffff8de1c2e17b80 x1862023612819840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776771.910940:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17b80 x1862023612819840/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776771.910948:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776771.910951:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776771.910955:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819840:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776771.910961:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819968:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776771.910976:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776771.910984:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776771/real 1775776771] req@ffff8de1c2e14380 x1862023612819968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776771.910996:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e14380 x1862023612819968/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776771.911003:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776771.911006:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776771.911009:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612819968:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776771.911014:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820096:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776771.911030:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776771.911038:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776771/real 1775776771] req@ffff8de1c2e17100 x1862023612820096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776771.911048:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c2e17100 x1862023612820096/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776771.911055:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776771.911058:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776771.911061:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c2e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820096:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776772.870026:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776773.888453:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776774.913989:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776775.936522:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776776.960962:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776777.026029:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776777.026038:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776777.026043:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776777.026052:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12748 00000100:00080000:2.0:1775776777.026071:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776777.026078:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776777.026113:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2f100 x1862023612820224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776777.026179:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612820224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776777.026187:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776777.026190:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776777.026192:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776777.026196:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12748 00000100:00080000:2.0:1775776777.026200:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776777.026203:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776777.026212:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776777.026223:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2c700 x1862023612820352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776777.026232:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776777.026235:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000800:00000100:3.0:1775776777.026236:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:2.0:1775776777.026237:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776777.026240:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12748 00000100:00080000:2.0:1775776777.026242:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776777.026245:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776777.026249:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776777.026259:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612820480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776777.026266:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776777.026269:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1775776777.026270:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776777/real 1775776777] req@ffff8de1d0f2f100 x1862023612820224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1775776777.026271:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776777.026274:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12748 00000100:00080000:2.0:1775776777.026277:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776777.026280:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776777.026284:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776777.026286:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2f100 x1862023612820224/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1775776777.026292:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612820608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1775776777.026296:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776777.026299:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00080000:2.0:1775776777.026300:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776777.026302:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:3.0:1775776777.026303:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612820224:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776777.026304:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776777.026307:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12748 00000100:00080000:2.0:1775776777.026310:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776777.026313:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776777.026316:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776777.026323:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:2.0:1775776777.026324:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612820736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1775776777.026343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776777.026354:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776777/real 1775776777] req@ffff8de1d0f2c700 x1862023612820352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776777.026365:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2c700 x1862023612820352/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776777.026372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776777.026375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776777.026378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820352:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776777.026384:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820480:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776777.026402:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776777.026412:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776777/real 1775776777] req@ffff8de1d0f2df80 x1862023612820480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776777.026423:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612820480/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776777.026454:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776777.026457:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776777.026460:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820480:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776777.026465:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820608:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776777.026484:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776777.026492:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776777/real 1775776777] req@ffff8de1d0f2e300 x1862023612820608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776777.026500:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612820608/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776777.026504:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776777.026506:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776777.026508:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820608:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776777.026518:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820736:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776777.026529:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776777.026534:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776777/real 1775776777] req@ffff8de1d0f2d500 x1862023612820736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776777.026540:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612820736/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776777.026544:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776777.026545:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776777.026548:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820736:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776777.985721:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776779.008011:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776780.032203:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776781.056145:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776782.080002:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775776782.143980:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776782.143993:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1775776782.143998:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776782.144010:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12753 00000100:00080000:2.0:1775776782.144025:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776782.144032:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:2.0:1775776782.144093:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e680 x1862023612820864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776782.144126:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776782.144130:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1775776782.144132:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776782.144136:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12753 00000100:00080000:2.0:1775776782.144140:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776782.144144:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776782.144157:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776782.144171:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2ca80 x1862023612820992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776782.144182:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776782.144186:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1775776782.144187:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776782.144192:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12753 00000100:00080000:2.0:1775776782.144196:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776782.144200:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776782.144205:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1775776782.144219:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2d500 x1862023612821120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776782.144229:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612820864:192.168.201.137@tcp:250:kworker.0 00000100:00080000:2.0:1775776782.144233:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776782.144244:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1775776782.144247:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776782.144252:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12753 00000100:00080000:2.0:1775776782.144256:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776782.144260:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776782.144266:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:2.0:1775776782.144276:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2e300 x1862023612821248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1775776782.144283:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1775776782.144286:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1775776782.144287:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1775776782.144292:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12753 00000100:00080000:2.0:1775776782.144303:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1775776782.144306:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:2.0:1775776782.144309:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000800:00000100:3.0:1775776782.144313:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:2.0:1775776782.144324:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1d0f2df80 x1862023612821376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776782.144369:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776782/real 1775776782] req@ffff8de1d0f2e680 x1862023612820864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776782.144390:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e680 x1862023612820864/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776782.144400:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776782.144406:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776782.144409:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612820864:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776782.144417:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820992:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776782.144442:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776782.144455:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776782/real 1775776782] req@ffff8de1d0f2ca80 x1862023612820992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776782.144466:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2ca80 x1862023612820992/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776782.144474:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776782.144477:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776782.144480:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612820992:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776782.144506:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821120:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776782.144526:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776782.144537:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776782/real 1775776782] req@ffff8de1d0f2d500 x1862023612821120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776782.144549:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2d500 x1862023612821120/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776782.144569:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776782.144581:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776782.144585:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821120:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776782.144592:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821248:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776782.144614:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776782.144625:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776782/real 1775776782] req@ffff8de1d0f2e300 x1862023612821248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776782.144636:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2e300 x1862023612821248/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776782.144643:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776782.144647:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776782.144650:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821248:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776782.144656:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821376:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776782.144687:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776782.144697:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776782/real 1775776782] req@ffff8de1d0f2df80 x1862023612821376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776782.144720:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1d0f2df80 x1862023612821376/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776782.144769:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776782.144773:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776782.144776:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1d0f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821376:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776783.103962:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776784.131401:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776785.153926:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776786.176174:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776787.199994:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776787.263846:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776787.263855:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776787.263859:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776787.263868:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12759 00000100:00080000:0.0:1775776787.263878:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776787.263885:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776787.263935:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612821504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776787.263964:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776787.263967:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776787.263969:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776787.263973:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12759 00000100:00080000:0.0:1775776787.263976:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776787.263980:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776787.263990:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776787.264005:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612821632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776787.264005:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612821504:192.168.201.137@tcp:250:kworker.0 00000100:00080000:0.0:1775776787.264022:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776787.264025:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776787.264028:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776787.264032:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12759 00000100:00080000:0.0:1775776787.264035:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776787.264039:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776787.264044:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776787.264055:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612821760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776787.264064:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776787.264069:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000800:00000100:3.0:1775776787.264070:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00080000:0.0:1775776787.264072:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776787.264077:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12759 00000100:00080000:0.0:1775776787.264081:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776787.264085:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776787.264090:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:3.0:1775776787.264106:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776787/real 1775776787] req@ffff8de1c5683b80 x1862023612821504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1775776787.264110:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612821888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776787.264133:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776787.264137:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776787.264140:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1775776787.264140:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612821504/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1775776787.264148:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12759 00000100:00080000:0.0:1775776787.264154:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776787.264159:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00080000:3.0:1775776787.264159:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000008:00100000:0.0:1775776787.264166:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00080000:3.0:1775776787.264167:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776787.264174:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612821504:192.168.201.137@tcp:250:kworker.0 00000100:00100000:0.0:1775776787.264182:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612822016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776787.264199:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821632:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776787.264219:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776787.264229:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776787/real 1775776787] req@ffff8de1c5680700 x1862023612821632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776787.264240:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612821632/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776787.264247:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776787.264263:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776787.264266:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821632:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776787.264272:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821760:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776787.264288:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776787.264300:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776787/real 1775776787] req@ffff8de1c5682d80 x1862023612821760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776787.264311:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612821760/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776787.264318:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776787.264321:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776787.264324:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821760:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776787.264329:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821888:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776787.264343:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776787.264350:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776787/real 1775776787] req@ffff8de1c5682300 x1862023612821888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776787.264366:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612821888/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776787.264372:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776787.264375:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776787.264378:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612821888:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776787.264383:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822016:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776787.264397:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776787.264408:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776787/real 1775776787] req@ffff8de1c5682680 x1862023612822016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776787.264419:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612822016/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776787.264427:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776787.264429:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776787.264432:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822016:192.168.201.137@tcp:8:kworker.0 00010000:00010000:2.0:1775776788.224289:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776789.247928:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776790.271897:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775776791.296449:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776792.320007:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1775776792.384525:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0911ed57-d55c-4715-b8b0-3d1bd45f9c5c->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776792.384539:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1775776792.384546:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776792.384561:0:123972:0:(import.c:509:import_select_connection()) MGC192.168.201.137@tcp: connect to NID 192.168.201.137@tcp last attempt 12764 00000100:00080000:0.0:1775776792.384578:0:123972:0:(import.c:588:import_select_connection()) MGC192.168.201.137@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776792.384588:0:123972:0:(import.c:623:import_select_connection()) MGC192.168.201.137@tcp: import ffff8de1e0069800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000100:00100000:0.0:1775776792.384639:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682680 x1862023612822144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776792.384682:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776792.384686:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1775776792.384688:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776792.384693:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12764 00000100:00080000:0.0:1775776792.384697:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776792.384701:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff8de1e006a000: import ffff8de1c3008000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776792.384712:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776792.384748:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682300 x1862023612822272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776792.384758:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776792.384761:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1775776792.384763:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776792.384768:0:123972:0:(import.c:509:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12764 00000100:00080000:0.0:1775776792.384772:0:123972:0:(import.c:588:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776792.384776:0:123972:0:(import.c:623:import_select_connection()) lustre-MDT0001-mdc-ffff8de1e006a000: import ffff8de1c7278800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776792.384781:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681676 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1775776792.384793:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5682d80 x1862023612822400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776792.384802:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776792.384805:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1775776792.384807:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776792.384811:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12764 00000100:00080000:0.0:1775776792.384814:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776792.384818:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff8de1e006a000: import ffff8de1c727b000 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776792.384823:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776792.384833:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5680700 x1862023612822528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1775776792.384842:0:123972:0:(pinger.c:229:ptlrpc_pinger_process_import()) 73a027f8-bfcb-4fff-aef1-8eea1b45c79e->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1775776792.384845:0:123972:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1775776792.384847:0:123972:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1775776792.384850:0:123972:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: connect to NID 192.168.201.137@tcp last attempt 12764 00000100:00080000:0.0:1775776792.384853:0:123972:0:(import.c:588:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1775776792.384856:0:123972:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-ffff8de1e006a000: import ffff8de1c727b800 using connection 192.168.201.137@tcp/192.168.201.137@tcp 00000008:00100000:0.0:1775776792.384861:0:123972:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34681676 ocd_grant: 8388608, lost: 0. 00000100:00100000:0.0:1775776792.384869:0:123972:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8de1c5683b80 x1862023612822656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775776792.385022:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612822144:192.168.201.137@tcp:250:kworker.0 00000800:00000100:3.0:1775776792.385097:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776792.385139:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776792/real 1775776792] req@ffff8de1c5682680 x1862023612822144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776792.385158:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682680 x1862023612822144/t0(0) o250->MGC192.168.201.137@tcp@192.168.201.137@tcp:26/25 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776792.385180:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1e0069800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776792.385184:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776792.385188:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0911ed57-d55c-4715-b8b0-3d1bd45f9c5c:2401:1862023612822144:192.168.201.137@tcp:250:kworker.0 00000100:00100000:3.0:1775776792.385196:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822272:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776792.385220:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776792.385232:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776792/real 1775776792] req@ffff8de1c5682300 x1862023612822272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776792.385244:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682300 x1862023612822272/t0(0) o38->lustre-MDT0000-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776792.385269:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c3008000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776792.385272:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776792.385275:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822272:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776792.385281:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822400:192.168.201.137@tcp:38:kworker.0 00000800:00000100:3.0:1775776792.385301:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776792.385310:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776792/real 1775776792] req@ffff8de1c5682d80 x1862023612822400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776792.385322:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5682d80 x1862023612822400/t0(0) o38->lustre-MDT0001-mdc-ffff8de1e006a000@192.168.201.137@tcp:12/10 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776792.385329:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c7278800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776792.385331:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776792.385334:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822400:192.168.201.137@tcp:38:kworker.0 00000100:00100000:3.0:1775776792.385339:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822528:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776792.385358:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776792.385368:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776792/real 1775776792] req@ffff8de1c5680700 x1862023612822528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776792.385379:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5680700 x1862023612822528/t0(0) o8->lustre-OST0000-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776792.385386:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776792.385389:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776792.385393:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822528:192.168.201.137@tcp:8:kworker.0 00000100:00100000:3.0:1775776792.385399:0:2401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822656:192.168.201.137@tcp:8:kworker.0 00000800:00000100:3.0:1775776792.385416:0:2401:0:(socklnd_cb.c:976:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.137@tcp 00000100:00100000:3.0:1775776792.385426:0:2401:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775776792/real 1775776792] req@ffff8de1c5683b80 x1862023612822656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1775776792.385437:0:2401:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8de1c5683b80 x1862023612822656/t0(0) o8->lustre-OST0001-osc-ffff8de1e006a000@192.168.201.137@tcp:28/4 lens 520/544 e 0 to 1 dl 1775776817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1775776792.385558:0:2401:0:(import.c:65:import_set_state_nolock()) ffff8de1c727b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1775776792.385562:0:2401:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.137@tcp failed (-110) 00000100:00100000:3.0:1775776792.385566:0:2401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8de1c5683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a027f8-bfcb-4fff-aef1-8eea1b45c79e:2401:1862023612822656:192.168.201.137@tcp:8:kworker.0 00010000:00010000:0.0:1775776793.345013:0:160426:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775776794.367953:0:160425:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 76480 lines, 76480 kept, 0 dropped, 0 bad.